-- Logs begin at Tue 2022-06-21 19:22:36 UTC, end at Tue 2022-06-21 21:12:43 UTC. -- Jun 21 20:07:18.254039 dv-cinder-835384-8-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 21 20:07:18.261871 dv-cinder-835384-8-iscsi devstack@keystone.service[80123]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 21 20:07:18.263882 dv-cinder-835384-8-iscsi devstack@keystone.service[80123]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 21 20:07:18 2022] *** Jun 21 20:07:18.263882 dv-cinder-835384-8-iscsi devstack@keystone.service[80123]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 21 20:07:18.263882 dv-cinder-835384-8-iscsi devstack@keystone.service[80123]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 21 20:07:18.263882 dv-cinder-835384-8-iscsi devstack@keystone.service[80123]: nodename: dv-cinder-835384-8-iscsi Jun 21 20:07:18.263882 dv-cinder-835384-8-iscsi devstack@keystone.service[80123]: machine: x86_64 Jun 21 20:07:18.263882 dv-cinder-835384-8-iscsi devstack@keystone.service[80123]: clock source: unix Jun 21 20:07:18.263882 dv-cinder-835384-8-iscsi devstack@keystone.service[80123]: pcre jit disabled Jun 21 20:07:18.263882 dv-cinder-835384-8-iscsi devstack@keystone.service[80123]: detected number of CPU cores: 4 Jun 21 20:07:18.264372 dv-cinder-835384-8-iscsi devstack@keystone.service[80123]: current working directory: / Jun 21 20:07:18.264372 dv-cinder-835384-8-iscsi devstack@keystone.service[80123]: detected binary path: /usr/bin/uwsgi-core Jun 21 20:07:18.264372 dv-cinder-835384-8-iscsi devstack@keystone.service[80123]: your processes number limit is 47680 Jun 21 20:07:18.264372 dv-cinder-835384-8-iscsi devstack@keystone.service[80123]: your memory page size is 4096 bytes Jun 21 20:07:18.266306 dv-cinder-835384-8-iscsi devstack@keystone.service[80123]: detected max file descriptor number: 2048 Jun 21 20:07:18.266306 dv-cinder-835384-8-iscsi devstack@keystone.service[80123]: lock engine: pthread robust mutexes Jun 21 20:07:18.266306 dv-cinder-835384-8-iscsi devstack@keystone.service[80123]: thunder lock: enabled Jun 21 20:07:18.266306 dv-cinder-835384-8-iscsi devstack@keystone.service[80123]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 21 20:07:18.266306 dv-cinder-835384-8-iscsi devstack@keystone.service[80123]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 21 20:07:18.308680 dv-cinder-835384-8-iscsi devstack@keystone.service[80123]: Python main interpreter initialized at 0x56198a0779c0 Jun 21 20:07:18.308680 dv-cinder-835384-8-iscsi devstack@keystone.service[80123]: python threads support enabled Jun 21 20:07:18.308680 dv-cinder-835384-8-iscsi devstack@keystone.service[80123]: your server socket listen backlog is limited to 100 connections Jun 21 20:07:18.308680 dv-cinder-835384-8-iscsi devstack@keystone.service[80123]: your mercy for graceful operations on workers is 90 seconds Jun 21 20:07:18.309037 dv-cinder-835384-8-iscsi devstack@keystone.service[80123]: mapped 403077 bytes (393 KB) for 2 cores Jun 21 20:07:18.309111 dv-cinder-835384-8-iscsi devstack@keystone.service[80123]: *** Operational MODE: preforking *** Jun 21 20:07:18.309390 dv-cinder-835384-8-iscsi devstack@keystone.service[80123]: *** uWSGI is running in multiple interpreter mode *** Jun 21 20:07:18.309390 dv-cinder-835384-8-iscsi devstack@keystone.service[80123]: spawned uWSGI master process (pid: 80123) Jun 21 20:07:18.309592 dv-cinder-835384-8-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 21 20:07:18.310670 dv-cinder-835384-8-iscsi devstack@keystone.service[80123]: spawned uWSGI worker 1 (pid: 80135, cores: 1) Jun 21 20:07:18.310670 dv-cinder-835384-8-iscsi devstack@keystone.service[80123]: spawned uWSGI worker 2 (pid: 80136, cores: 1) Jun 21 20:07:18.310670 dv-cinder-835384-8-iscsi devstack@keystone.service[80123]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 21 20:07:23.735509 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 20:07:23.735509 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: from cryptography.utils import int_from_bytes Jun 21 20:07:23.736583 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 20:07:23.736583 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: from cryptography.utils import int_from_bytes Jun 21 20:07:23.737000 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 20:07:23.737000 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: from cryptography.utils import int_from_bytes Jun 21 20:07:23.737110 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 20:07:23.737110 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: from cryptography.utils import int_from_bytes Jun 21 20:07:23.785195 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 21 20:07:23.785380 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 21 20:07:23.785461 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 21 20:07:23.785548 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 21 20:07:23.785625 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] command line args: [] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 21 20:07:23.785696 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] command line args: [] {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 21 20:07:23.785830 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 21 20:07:23.785937 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 21 20:07:23.786014 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ================================================================================ {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 21 20:07:23.786120 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] ================================================================================ {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 21 20:07:23.786251 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] admin_token = **** {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.786382 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] admin_token = **** {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.786497 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] config_dir = [] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.786632 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] config_dir = [] {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.786709 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.786823 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.786905 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] config_source = [] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.787008 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] config_source = [] {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.787095 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] debug = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.787191 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] debug = True {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.787269 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.787513 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.787670 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.787793 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.787913 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.788060 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.788176 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.788299 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.788452 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.788571 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.788685 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] list_limit = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.788803 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] list_limit = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.788922 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] log_config_append = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.789042 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] log_config_append = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.789163 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.789277 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.789396 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] log_dir = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.789508 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] log_dir = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.789626 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] log_file = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.789749 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] log_file = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.789868 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.789987 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.790126 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.790265 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.790430 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.790603 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.790734 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.790817 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.790941 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.791018 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.791145 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.791221 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.791348 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.791424 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.791539 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.791613 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.791739 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.791815 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.791944 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.792030 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.792108 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.792224 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.792306 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.792391 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.792467 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.792595 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.792670 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.792791 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.792873 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.792989 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.793063 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.793183 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.793271 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] publish_errors = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.793342 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] publish_errors = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.793457 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.793530 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.793654 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.793735 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.793805 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.793919 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.793993 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.794123 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.794206 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.794283 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.794435 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] standard_threads = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.794520 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] standard_threads = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.794667 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.794796 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.794911 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.794989 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.795092 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.795169 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.795250 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] use_journal = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.795321 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] use_journal = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.795432 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] use_json = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.795515 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] use_json = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.795607 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] use_stderr = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.795683 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] use_stderr = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.795782 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] use_syslog = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.795860 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] use_syslog = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.796035 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.796122 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 20:07:23.796291 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.796367 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.796529 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.796605 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.796788 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.796863 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.797028 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.797102 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.797275 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.797352 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.797514 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.797595 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.797762 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.797837 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.797997 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.798073 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.798243 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.798325 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.798489 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.798564 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.798737 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.798819 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.798971 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.799047 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.799217 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.799306 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.799452 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.799539 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.799699 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.799776 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.799967 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.800056 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.800205 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.800278 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.800451 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.800534 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.800703 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.800779 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.800946 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.801023 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.801180 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.801257 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.801431 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.801508 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.801691 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.801768 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.801941 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.802024 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.802187 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.802263 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.802417 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.802495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.802645 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.802721 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.802875 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.802962 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.803107 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.803183 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.803354 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.803436 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.803598 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.803688 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.803827 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.803904 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.804124 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.804241 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.804353 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.804482 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.805095 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.805216 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.805329 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.805441 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.805554 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.805665 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.805778 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.805890 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.806004 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.806122 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.806235 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.806423 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.806546 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.806660 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.806773 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.806890 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.807004 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.807126 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.807240 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.807359 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.807472 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.807593 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.807706 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.807831 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.808001 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.808118 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.808231 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.808343 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.808455 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.808579 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.808694 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.808813 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.808926 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.809022 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.809116 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.809223 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.809328 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.809422 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.809516 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.809610 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.809745 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.809855 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.809959 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.810056 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.810171 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.810286 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.810399 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.810524 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.810630 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.810741 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.810855 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.810968 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.811089 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.811204 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.811326 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.811441 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.811563 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.811692 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.811816 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.811946 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.812061 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.812177 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.812293 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.812407 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.812511 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.812622 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.812736 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.812857 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.812978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.813092 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.813196 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.813308 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.813433 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.813554 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.813669 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.813785 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.813898 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.814012 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.814133 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.814238 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.814350 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.814465 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.814585 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.814699 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.814821 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.814936 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.815050 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.815165 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.815278 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.815397 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.815521 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.815636 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.815750 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.815864 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.816026 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.816142 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.816142 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.816370 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.816491 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.816612 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.816727 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.816840 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.816962 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.817077 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.817190 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.817311 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.817426 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.817541 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.817729 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.817846 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.817966 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.818087 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.818201 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.818315 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.818436 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.818559 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.818687 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.818802 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.818915 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.819029 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.819142 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.819255 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.819376 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.819491 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.819613 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.819728 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.819842 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.819978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.820102 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.820223 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.820964 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.821081 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.821203 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.821318 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.821441 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.821562 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.821678 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.821793 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.821908 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.822030 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.822145 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] auth.external = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.822265 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] auth.external = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.822380 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.822494 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.822615 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.822761 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.822892 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.823017 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.823133 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] auth.password = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.823249 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] auth.password = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.823364 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] auth.token = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.823479 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] auth.token = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.823602 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.823729 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.823849 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.823977 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.824093 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.824208 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.824323 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.824452 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.824570 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.824686 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.824801 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.824917 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.825032 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.825158 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.825275 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] credential.caching = True {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.825390 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] credential.caching = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.825505 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.825620 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.825734 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.825841 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.825958 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.826073 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.826189 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.826310 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.826425 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.826548 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.826664 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.826778 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.826893 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.827008 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.827122 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.827245 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.827368 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.827484 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.827600 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.827720 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.827842 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.827982 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.828102 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.828229 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.828345 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.828460 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.828581 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.828706 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.828822 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.828937 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.829052 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] federation.caching = True {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.829173 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] federation.caching = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.829289 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.829412 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.829529 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.829643 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.829758 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.829872 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.829988 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.830111 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.830228 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.830343 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.830459 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.830573 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.830573 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.830796 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.830912 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.831027 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.831147 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.831263 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.831378 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.831501 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.831618 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.831732 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.831847 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.caching = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.831985 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] identity.caching = True {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.832109 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.832311 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.832431 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.832547 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.832662 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.832776 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.832899 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.833016 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.833131 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.833246 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.833361 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.833476 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.833598 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.833714 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.833832 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.833948 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.834062 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.834177 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.834300 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.834416 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.834530 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.834645 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.834759 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.834874 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.834997 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.835113 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.835229 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.835352 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.835468 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.835585 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.835708 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.835824 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.835953 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.836063 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.836170 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.836269 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.836373 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.836472 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.836568 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.836665 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.836761 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.836865 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.836970 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.837067 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.837169 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.837273 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.837377 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.837474 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.837578 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.837676 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.837778 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.837874 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.837970 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.838065 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.838177 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.838282 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.838383 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.838480 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.838576 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.838685 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.838791 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.838888 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.838997 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.839101 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.839198 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.839293 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.839397 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.839500 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.839597 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.839692 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.839788 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.839890 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.840021 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.840121 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.840217 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.840319 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.840416 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.840511 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.840616 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.840719 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.840816 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.840911 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.841007 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.841108 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.841213 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.841336 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.841453 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.841567 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.841683 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.841798 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.841922 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.842038 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.842154 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.842269 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.842384 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.842498 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.842621 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.842738 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.842853 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.842967 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.843082 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.843204 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.user = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.843321 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.843435 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.843556 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.843673 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.843799 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.843965 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.844085 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.844200 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.844315 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.844429 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.844544 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.844670 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.844788 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.844903 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.845017 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.845132 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.845247 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.845370 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.845487 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.845603 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.845718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.845833 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.845947 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.846074 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.846191 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.846307 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.846421 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.846535 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.846650 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.846772 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.846889 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.847004 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.847119 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.847233 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.847348 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.847470 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.847586 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.847701 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.847815 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.847944 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.848062 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.848188 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.848306 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.848420 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.848535 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.848650 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.848764 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.848886 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.849004 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.849119 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.849240 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.849355 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.849469 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.849592 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.849708 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.849822 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.849936 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.850052 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.850167 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.850293 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.850409 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.850524 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.850639 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.850753 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.850868 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.850991 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.851109 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.851224 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.851339 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.851454 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.851569 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.851692 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.851808 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] resource.caching = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.851990 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] resource.caching = True {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.852102 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.852199 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.852295 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.852403 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.852503 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.852600 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.852697 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.852793 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.852889 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.852993 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.853091 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.853196 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.853294 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.853390 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.853485 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.853651 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.853751 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.853858 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.853956 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] role.caching = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.854052 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] role.caching = True {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.854148 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] role.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.854253 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] role.driver = sql {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.854350 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.854445 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.854578 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.854683 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.854830 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.854943 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.855080 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.855183 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.855328 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.855431 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.855576 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.855681 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.855825 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.855958 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.856097 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.856212 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.856856 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.856975 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.857093 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.857263 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.857388 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.857513 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.857630 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.857745 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.857861 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.857976 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.858091 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.858214 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.858330 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.858446 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.858561 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.858675 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.858796 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.858923 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.859040 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.859155 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.859271 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.859386 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.859501 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.859625 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.859741 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.859856 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.860016 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.860134 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.860249 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.860377 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.860494 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.860858 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.860974 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.861089 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.861203 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.861327 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.861444 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.861560 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.861675 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.861790 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.861913 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.862029 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.862144 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.862259 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.862373 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.862488 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.862611 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.862727 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.862842 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.862980 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.863097 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] token.caching = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.863212 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] token.caching = True {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.863336 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.863452 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.863566 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.863682 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.863797 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.863912 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.864060 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.864178 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.864293 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.864408 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.864523 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.864637 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.864761 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.864868 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.864982 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.865097 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.865212 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.865327 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.865449 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.865565 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.865680 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.865795 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.865910 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.866024 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.866147 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.866263 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.866377 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.866492 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.866606 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.866720 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.866844 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.866960 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.867075 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.867677 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.867791 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] database.connection = **** {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.867955 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] database.connection = **** {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.868090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.868216 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.868332 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.868456 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.868573 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.868688 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.868803 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.868919 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.869034 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.869157 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.869274 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.869389 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.869504 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.869619 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.869734 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.869857 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.869975 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.870090 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.870205 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.870319 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.870435 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.870558 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.870674 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.870790 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.870905 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.871022 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.871137 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.871260 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.871377 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.871492 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.871607 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.871722 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.871842 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.871987 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.872107 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.872222 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 20:07:23.872337 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 21 20:07:23.872452 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 21 20:07:23.902412 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80136) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 20:07:23.902577 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 20:07:23.902658 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80136) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 20:07:23.902732 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 20:07:23.902860 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80136) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 20:07:23.902946 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 20:07:23.911347 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80136) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 20:07:23.911441 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 20:07:23.939179 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 20:07:23.939380 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80136) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 20:07:23.939466 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 20:07:23.939618 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80136) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 20:07:24.080947 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 20:07:24.081123 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80136) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 20:07:24.129972 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 20:07:24.130211 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 20:07:24.133260 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80136) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 20:07:24.133503 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80136) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 20:07:24.193867 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 20:07:24.194099 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 20:07:24.194311 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80136) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 20:07:24.194415 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 20:07:24.194539 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 20:07:24.194620 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80136) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 20:07:24.194762 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 20:07:24.194843 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80136) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 20:07:24.194984 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80136) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 20:07:24.195077 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 20:07:24.195703 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80136) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 20:07:24.195956 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80136) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 20:07:24.220500 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 20:07:24.220737 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 20:07:24.220838 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80136) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 20:07:24.220970 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 20:07:24.221054 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80136) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 20:07:24.221198 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 20:07:24.221281 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80136) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 20:07:24.221421 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 20:07:24.221504 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80136) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 20:07:24.221641 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 20:07:24.221723 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80136) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 20:07:24.221860 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80136) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 20:07:24.221941 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 20:07:24.222077 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80136) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 20:07:24.232889 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 20:07:24.233139 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80136) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 20:07:24.245686 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 20:07:24.245936 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 20:07:24.246042 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80136) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 20:07:24.246146 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 20:07:24.246282 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80136) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 20:07:24.246374 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 20:07:24.246511 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80136) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 20:07:24.246601 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 20:07:24.246736 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80136) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 20:07:24.246818 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 20:07:24.246955 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80136) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 20:07:24.247039 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 20:07:24.247173 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80136) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 20:07:24.247393 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80136) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 20:07:24.264680 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.264893 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 21 20:07:24.265232 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.265423 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.265525 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 21 20:07:24.265603 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 21 20:07:24.265703 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.265941 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.266022 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.266146 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 21 20:07:24.266236 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.266420 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.266501 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.266685 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.266944 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.267199 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.277873 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.278153 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.278426 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.278610 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.278712 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.278889 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.279157 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.279436 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.287039 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 20:07:24.287796 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80136) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 20:07:24.290394 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 20:07:24.290673 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.290954 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.291148 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80136) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 20:07:24.291231 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.291426 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.291509 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.291707 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.291788 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.292020 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.292116 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.292293 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.292373 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.292554 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.292633 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.292820 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.292910 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.293085 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.293164 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.293360 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.293631 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.293896 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.319636 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.321026 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.321804 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 20:07:24.322083 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.322656 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80136) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 20:07:24.322937 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.327371 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 20:07:24.327760 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.328069 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.328313 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80136) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 20:07:24.328707 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.328991 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.335442 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 20:07:24.335684 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.336900 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80136) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 20:07:24.337186 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.340901 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 20:07:24.341187 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.341467 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.341713 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80136) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 20:07:24.341810 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.342000 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.342082 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.342273 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.342355 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.342542 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.342633 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.342810 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.342893 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.343084 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.343354 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.343622 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.361901 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.362181 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.362677 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.362957 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.366847 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 20:07:24.367674 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80136) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 20:07:24.370524 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.370923 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.371359 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.371766 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.375991 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 20:07:24.376843 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80136) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 20:07:24.379616 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 20:07:24.380510 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80136) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 20:07:24.383861 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.384180 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.384463 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.384748 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.384837 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.385033 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.385130 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.385315 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.385397 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.385599 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.385881 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.386167 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.405044 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 20:07:24.405327 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.405605 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.405880 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.405975 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80136) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 20:07:24.406258 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.406528 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.406802 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.413786 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.414783 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.415551 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.415841 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.416510 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.416799 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.419054 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 20:07:24.419337 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.419620 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.419956 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.420040 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80136) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 20:07:24.420263 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.420357 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.420544 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.420831 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.421118 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.433637 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 20:07:24.433918 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.434209 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.434454 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80136) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 20:07:24.434538 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.434735 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.435028 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.435310 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.436029 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.436327 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.436626 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.436869 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.437165 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.437464 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.455117 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 20:07:24.455941 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80136) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 20:07:24.458457 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 20:07:24.459259 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80136) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 20:07:24.462339 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.463253 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.464109 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.465025 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.465756 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 20:07:24.466038 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.466320 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.466678 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80136) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 20:07:24.466957 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.467240 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.473708 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.474689 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.475324 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 20:07:24.476330 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80136) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 20:07:24.478648 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.478937 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.479329 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.479610 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.479690 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.479897 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.480308 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.480589 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.489071 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 20:07:24.489356 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.489646 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.490015 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80136) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 20:07:24.490298 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.490575 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.497615 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 20:07:24.497896 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.498178 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.498456 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.498539 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80136) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 20:07:24.498727 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.498819 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.499065 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.499155 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.499344 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.499431 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.499615 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.499698 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.499895 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.500048 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.500194 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.500290 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.500474 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.500558 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.500738 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.500821 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.501005 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.501095 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.501274 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.501356 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.501578 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.501844 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.502122 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 20:07:24.540681 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56198a0779c0 pid: 80135 (default app) Jun 21 20:07:24.541369 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56198a0779c0 pid: 80136 (default app) Jun 21 20:07:24.544058 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72233971-227b-4b41-a175-43b112ec5c0a None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:24.544365 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72233971-227b-4b41-a175-43b112ec5c0a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:24.544645 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72233971-227b-4b41-a175-43b112ec5c0a None None] PATH_INFO: `/v3` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:24.548835 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 791 bytes} [Tue Jun 21 20:07:24 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:07:32.147113 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a52436-8d00-4ee2-bdcf-027fedfa82fd None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:32.147706 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a52436-8d00-4ee2-bdcf-027fedfa82fd None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:32.147706 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a52436-8d00-4ee2-bdcf-027fedfa82fd None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:32.152488 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1/2] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:07:32 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 20:07:32.157748 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b212db6-7fe6-45b2-bc55-9da643a11b12 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:32.158193 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b212db6-7fe6-45b2-bc55-9da643a11b12 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:32.158332 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b212db6-7fe6-45b2-bc55-9da643a11b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:32.227888 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: INFO dbcounter [None req-1b212db6-7fe6-45b2-bc55-9da643a11b12 None None] Registered counter for database keystone Jun 21 20:07:32.249025 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG oslo_db.sqlalchemy.engines [None req-1b212db6-7fe6-45b2-bc55-9da643a11b12 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80135) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 20:07:32.255367 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writer thread running {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 20:07:32.431285 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG passlib.handlers.bcrypt [None req-1b212db6-7fe6-45b2-bc55-9da643a11b12 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80135) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 21 20:07:32.431627 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG passlib.handlers.bcrypt [None req-1b212db6-7fe6-45b2-bc55-9da643a11b12 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80135) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 21 20:07:32.485952 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-1b212db6-7fe6-45b2-bc55-9da643a11b12 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:07:32.487552 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1b212db6-7fe6-45b2-bc55-9da643a11b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:07:32.613309 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 2/3] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:07:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 457 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 21 20:07:32.745341 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a52436-8d00-4ee2-bdcf-027fedfa82fd None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:32.816299 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: INFO dbcounter [None req-c6a52436-8d00-4ee2-bdcf-027fedfa82fd None None] Registered counter for database keystone Jun 21 20:07:32.835699 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG oslo_db.sqlalchemy.engines [None req-c6a52436-8d00-4ee2-bdcf-027fedfa82fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80136) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 20:07:32.841927 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writer thread running {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 20:07:32.961122 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a52436-8d00-4ee2-bdcf-027fedfa82fd None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:32.965333 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8009680-fa75-4e6d-84e2-9e53fd784999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:32.965991 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8009680-fa75-4e6d-84e2-9e53fd784999 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:32.966280 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8009680-fa75-4e6d-84e2-9e53fd784999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:32.966562 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8009680-fa75-4e6d-84e2-9e53fd784999 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:32.974657 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8009680-fa75-4e6d-84e2-9e53fd784999 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:33.027076 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f8009680-fa75-4e6d-84e2-9e53fd784999 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 21 20:07:33.027366 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8009680-fa75-4e6d-84e2-9e53fd784999 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:33.036865 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 2/4] 10.222.0.15 () {58 vars in 1324 bytes} [Tue Jun 21 20:07:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 21 20:07:33.042724 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b212db6-7fe6-45b2-bc55-9da643a11b12 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:33.057669 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b212db6-7fe6-45b2-bc55-9da643a11b12 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:33.062094 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae625e09-3d93-4e50-b27f-946944b20322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:33.063208 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae625e09-3d93-4e50-b27f-946944b20322 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:33.063501 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae625e09-3d93-4e50-b27f-946944b20322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:33.063786 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae625e09-3d93-4e50-b27f-946944b20322 admin admin] PATH_INFO: `/v3/projects/ef19f22f6a3d44fc841048b493a62bd9` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:33.067906 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae625e09-3d93-4e50-b27f-946944b20322 admin admin] RBAC: Authorizing `identity:get_project(project_id=ef19f22f6a3d44fc841048b493a62bd9)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:33.118994 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ae625e09-3d93-4e50-b27f-946944b20322 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 21 20:07:33.119343 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae625e09-3d93-4e50-b27f-946944b20322 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:33.123891 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 3/5] 10.222.0.15 () {56 vars in 1207 bytes} [Tue Jun 21 20:07:33 2022] GET /identity/v3/projects/ef19f22f6a3d44fc841048b493a62bd9 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:07:35.117782 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c754b6-290e-4ca1-a7f2-6f44279207a2 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:35.118268 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c754b6-290e-4ca1-a7f2-6f44279207a2 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:35.118364 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c754b6-290e-4ca1-a7f2-6f44279207a2 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:35.122459 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 3/6] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:07:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 20:07:35.127867 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc1193-0acb-4d0d-a7be-d1a5bf1fb605 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:35.128261 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc1193-0acb-4d0d-a7be-d1a5bf1fb605 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:35.128467 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc1193-0acb-4d0d-a7be-d1a5bf1fb605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:35.147020 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-cddc1193-0acb-4d0d-a7be-d1a5bf1fb605 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:07:35.149108 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-cddc1193-0acb-4d0d-a7be-d1a5bf1fb605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:07:35.156969 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 4/7] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:07:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 21 20:07:35.179743 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c754b6-290e-4ca1-a7f2-6f44279207a2 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:35.191582 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c754b6-290e-4ca1-a7f2-6f44279207a2 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:35.195717 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095509f6-a96f-4241-81e2-a5f540643d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:35.196378 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095509f6-a96f-4241-81e2-a5f540643d50 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:35.196665 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095509f6-a96f-4241-81e2-a5f540643d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:35.196939 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095509f6-a96f-4241-81e2-a5f540643d50 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:35.204524 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095509f6-a96f-4241-81e2-a5f540643d50 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:35.206273 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095509f6-a96f-4241-81e2-a5f540643d50 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:35.215417 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 4/8] 10.222.0.15 () {58 vars in 1324 bytes} [Tue Jun 21 20:07:35 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 20:07:35.220464 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc1193-0acb-4d0d-a7be-d1a5bf1fb605 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:35.229897 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc1193-0acb-4d0d-a7be-d1a5bf1fb605 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:35.234294 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76696236-938a-4f8b-91cf-deb801aa6d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:35.235150 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76696236-938a-4f8b-91cf-deb801aa6d77 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:35.235443 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76696236-938a-4f8b-91cf-deb801aa6d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:35.236029 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76696236-938a-4f8b-91cf-deb801aa6d77 admin admin] PATH_INFO: `/v3/users/6983efac1f89435f94ebc2dacd0b3544` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:35.237422 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76696236-938a-4f8b-91cf-deb801aa6d77 admin admin] RBAC: Authorizing `identity:get_user(user_id=6983efac1f89435f94ebc2dacd0b3544)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:35.239237 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76696236-938a-4f8b-91cf-deb801aa6d77 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:35.240889 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 5/9] 10.222.0.15 () {56 vars in 1198 bytes} [Tue Jun 21 20:07:35 2022] GET /identity/v3/users/6983efac1f89435f94ebc2dacd0b3544 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:07:37.307547 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95c819-f60e-4b95-853f-142c1fb8b811 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:37.308118 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95c819-f60e-4b95-853f-142c1fb8b811 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:37.308118 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95c819-f60e-4b95-853f-142c1fb8b811 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:37.309492 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 5/10] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:07:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:07:37.314652 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a89db8-336c-46b8-b725-9c5ec1d8f19d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:37.315086 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a89db8-336c-46b8-b725-9c5ec1d8f19d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:37.315233 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a89db8-336c-46b8-b725-9c5ec1d8f19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:37.332269 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-92a89db8-336c-46b8-b725-9c5ec1d8f19d None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:07:37.333466 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-92a89db8-336c-46b8-b725-9c5ec1d8f19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:07:37.350233 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed36e5-61a3-4ba9-b13c-47a86b1819f7 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:37.350521 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed36e5-61a3-4ba9-b13c-47a86b1819f7 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:37.350801 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed36e5-61a3-4ba9-b13c-47a86b1819f7 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:37.352174 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 6/11] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:07:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 20:07:37.357022 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61ec48-23b7-443f-adc6-aa92026f874f None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:37.357316 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61ec48-23b7-443f-adc6-aa92026f874f None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:37.357598 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61ec48-23b7-443f-adc6-aa92026f874f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:37.397612 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG passlib.handlers.bcrypt [None req-7a61ec48-23b7-443f-adc6-aa92026f874f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80136) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 21 20:07:37.398049 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG passlib.handlers.bcrypt [None req-7a61ec48-23b7-443f-adc6-aa92026f874f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80136) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 21 20:07:37.415480 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 6/12] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:07:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 20:07:37.439214 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a89db8-336c-46b8-b725-9c5ec1d8f19d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:37.443242 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-7a61ec48-23b7-443f-adc6-aa92026f874f None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:07:37.444850 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-7a61ec48-23b7-443f-adc6-aa92026f874f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:07:37.462217 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:37.543320 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a89db8-336c-46b8-b725-9c5ec1d8f19d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:37.548087 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 7/13] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:07:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 20:07:37.565781 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a61ec48-23b7-443f-adc6-aa92026f874f None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:37.583174 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d47b50-a165-41e9-b461-9b167bca2fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:37.584017 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d47b50-a165-41e9-b461-9b167bca2fab None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:37.584312 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d47b50-a165-41e9-b461-9b167bca2fab None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:37.584599 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d47b50-a165-41e9-b461-9b167bca2fab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:37.595774 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d47b50-a165-41e9-b461-9b167bca2fab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:07:37.607058 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-34d47b50-a165-41e9-b461-9b167bca2fab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 20:07:37.607058 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:07:37.607058 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:07:37.607058 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:07:37.607058 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:07:37.607058 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:07:37.607058 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:07:37.607058 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:07:37.607058 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:07:37.607058 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:07:37.607058 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:07:37.607058 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:07:37.607058 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:07:37.607058 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:07:37.607058 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:07:37.607058 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:07:37.608010 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:07:37.608010 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:07:37.608010 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:07:37.608010 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:07:37.608010 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:07:37.608010 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:07:37.608010 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:07:37.608010 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:07:37.608010 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:07:37.608010 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:07:37.608010 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:07:37.608010 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:07:37.608010 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:07:37.608010 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:07:37.608010 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:07:37.608010 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:07:37.608863 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:07:37.608863 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:07:37.608863 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:07:37.608863 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:07:37.608863 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:07:37.608863 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:07:37.608863 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:07:37.608863 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:07:37.608863 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:07:37.608863 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:07:37.608863 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 20:07:37.608863 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:07:37.608863 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 7/14] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jun 21 20:07:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:07:37.614177 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d47b50-a165-41e9-b461-9b167bca2fab None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:37.665470 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a61ec48-23b7-443f-adc6-aa92026f874f None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:37.667795 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:37.697314 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:37.705248 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb7536a-2f22-4363-b50c-ba494871a647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:37.706231 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7536a-2f22-4363-b50c-ba494871a647 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:37.706523 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7536a-2f22-4363-b50c-ba494871a647 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:37.706806 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7536a-2f22-4363-b50c-ba494871a647 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:37.715031 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d47b50-a165-41e9-b461-9b167bca2fab None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:37.748352 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a969da-f8b0-4987-8d75-0beb5a2644d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:37.749018 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a969da-f8b0-4987-8d75-0beb5a2644d9 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:37.749300 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a969da-f8b0-4987-8d75-0beb5a2644d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:37.749575 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a969da-f8b0-4987-8d75-0beb5a2644d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:37.750329 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a969da-f8b0-4987-8d75-0beb5a2644d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:07:37.750628 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a969da-f8b0-4987-8d75-0beb5a2644d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:37.752026 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a969da-f8b0-4987-8d75-0beb5a2644d9 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:37.767772 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 8/15] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:07:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:07:37.768802 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a969da-f8b0-4987-8d75-0beb5a2644d9 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:37.774851 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb7536a-2f22-4363-b50c-ba494871a647 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:37.776406 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb7536a-2f22-4363-b50c-ba494871a647 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:37.867994 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a969da-f8b0-4987-8d75-0beb5a2644d9 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:37.879274 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 8/16] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:07:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 21 20:07:37.884937 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb7536a-2f22-4363-b50c-ba494871a647 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:37.887533 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:37.902220 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e1490f-84c3-46fa-854b-2c33fbe90d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:37.903094 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e1490f-84c3-46fa-854b-2c33fbe90d8d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:37.903388 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e1490f-84c3-46fa-854b-2c33fbe90d8d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:37.903670 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e1490f-84c3-46fa-854b-2c33fbe90d8d None admin] PATH_INFO: `/v3/users/6983efac1f89435f94ebc2dacd0b3544` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:37.904920 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e1490f-84c3-46fa-854b-2c33fbe90d8d None admin] RBAC: Authorizing `identity:get_user(user_id=6983efac1f89435f94ebc2dacd0b3544)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:37.906387 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e1490f-84c3-46fa-854b-2c33fbe90d8d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:37.908178 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 9/17] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jun 21 20:07:37 2022] GET /identity/v3/users/6983efac1f89435f94ebc2dacd0b3544 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:07:37.913221 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e1490f-84c3-46fa-854b-2c33fbe90d8d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:37.927601 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:37.982485 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb7536a-2f22-4363-b50c-ba494871a647 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:38.012134 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e1490f-84c3-46fa-854b-2c33fbe90d8d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:38.016632 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70511bd6-74c3-412a-8999-f60f4b4abdcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:38.017436 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70511bd6-74c3-412a-8999-f60f4b4abdcb None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:38.017724 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70511bd6-74c3-412a-8999-f60f4b4abdcb None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:38.018006 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70511bd6-74c3-412a-8999-f60f4b4abdcb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:38.037436 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70511bd6-74c3-412a-8999-f60f4b4abdcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:38.039435 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70511bd6-74c3-412a-8999-f60f4b4abdcb None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:38.046472 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbcdaf7-f266-461d-bfdd-9ee8ee1a8d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:38.047270 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbcdaf7-f266-461d-bfdd-9ee8ee1a8d63 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:38.047560 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbcdaf7-f266-461d-bfdd-9ee8ee1a8d63 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:38.047845 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbcdaf7-f266-461d-bfdd-9ee8ee1a8d63 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:38.049071 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbcdaf7-f266-461d-bfdd-9ee8ee1a8d63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:38.050503 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbcdaf7-f266-461d-bfdd-9ee8ee1a8d63 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:38.052141 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 10/18] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:07:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:07:38.058270 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbcdaf7-f266-461d-bfdd-9ee8ee1a8d63 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:38.060327 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-70511bd6-74c3-412a-8999-f60f4b4abdcb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:07:38.060327 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:07:38.060327 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:07:38.060327 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:07:38.060327 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:07:38.060327 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:07:38.060327 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:07:38.060327 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:07:38.060327 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:07:38.060327 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:07:38.060327 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:07:38.060327 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:07:38.060327 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:07:38.060327 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:07:38.060327 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:07:38.061198 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:07:38.061198 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:07:38.061198 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:07:38.061198 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:07:38.061198 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:07:38.061198 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:07:38.061198 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:07:38.061198 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:07:38.061198 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:07:38.061198 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:07:38.061198 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:07:38.061198 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:07:38.061198 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:07:38.061198 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:07:38.061198 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:07:38.061198 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:07:38.061198 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:07:38.062125 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:07:38.062125 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:07:38.062125 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:07:38.062125 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:07:38.062125 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 9/19] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:07:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:07:38.066893 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70511bd6-74c3-412a-8999-f60f4b4abdcb None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:38.122633 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:38.137631 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:38.156989 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbcdaf7-f266-461d-bfdd-9ee8ee1a8d63 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:38.166747 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70511bd6-74c3-412a-8999-f60f4b4abdcb None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:38.189956 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf091f6-0fc6-4fdb-86e9-1cafba389f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:38.190612 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf091f6-0fc6-4fdb-86e9-1cafba389f25 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:38.190896 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf091f6-0fc6-4fdb-86e9-1cafba389f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:38.191171 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf091f6-0fc6-4fdb-86e9-1cafba389f25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:38.192020 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf091f6-0fc6-4fdb-86e9-1cafba389f25 None admin] RBAC: Adding query filter params (role.id=1f5332f48d9e4c2aac866d0d546c94d5, scope.domain.id=default, user.id=6983efac1f89435f94ebc2dacd0b3544) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:07:38.192332 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf091f6-0fc6-4fdb-86e9-1cafba389f25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:38.193748 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf091f6-0fc6-4fdb-86e9-1cafba389f25 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:38.200325 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 11/20] 10.222.0.15 () {56 vars in 1322 bytes} [Tue Jun 21 20:07:38 2022] GET /identity/v3/role_assignments?user.id=6983efac1f89435f94ebc2dacd0b3544&scope.domain.id=default&role.id=1f5332f48d9e4c2aac866d0d546c94d5 => generated 233 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:07:38.200442 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef42943-9dae-45fa-8a39-f5cd2223c7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:38.201090 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef42943-9dae-45fa-8a39-f5cd2223c7f9 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:38.201381 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef42943-9dae-45fa-8a39-f5cd2223c7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:38.201667 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef42943-9dae-45fa-8a39-f5cd2223c7f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:38.202404 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef42943-9dae-45fa-8a39-f5cd2223c7f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:07:38.202721 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef42943-9dae-45fa-8a39-f5cd2223c7f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:38.204161 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef42943-9dae-45fa-8a39-f5cd2223c7f9 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:38.224424 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 10/21] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:07:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:07:40.428683 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26d64e-fb34-44a8-aacd-40e3ad84a75d None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:40.429193 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26d64e-fb34-44a8-aacd-40e3ad84a75d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:40.429792 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26d64e-fb34-44a8-aacd-40e3ad84a75d None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:40.431292 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 12/22] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:07:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:07:40.440904 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a85bfd-dd78-4cca-a439-3e91c6e42b48 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:40.441356 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a85bfd-dd78-4cca-a439-3e91c6e42b48 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:40.441553 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a85bfd-dd78-4cca-a439-3e91c6e42b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:40.464784 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-09a85bfd-dd78-4cca-a439-3e91c6e42b48 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:07:40.465998 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-09a85bfd-dd78-4cca-a439-3e91c6e42b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:07:40.563239 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 11/23] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:07:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:07:40.596329 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26d64e-fb34-44a8-aacd-40e3ad84a75d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:40.711822 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1486e-c165-4ed9-b312-d6795e1d1af7 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:40.712135 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1486e-c165-4ed9-b312-d6795e1d1af7 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:40.712335 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1486e-c165-4ed9-b312-d6795e1d1af7 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:40.713894 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 12/24] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:07:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 20:07:40.719244 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79d0d2-7215-4824-ae37-57901d6475cb None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:40.719536 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79d0d2-7215-4824-ae37-57901d6475cb None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:40.719818 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79d0d2-7215-4824-ae37-57901d6475cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:40.752267 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-0d79d0d2-7215-4824-ae37-57901d6475cb None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:07:40.753473 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-0d79d0d2-7215-4824-ae37-57901d6475cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:07:40.760569 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26d64e-fb34-44a8-aacd-40e3ad84a75d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:40.840877 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b157012-31f8-4c37-b0e3-0894e690d1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:40.841681 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b157012-31f8-4c37-b0e3-0894e690d1e1 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:40.841970 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b157012-31f8-4c37-b0e3-0894e690d1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:40.842251 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b157012-31f8-4c37-b0e3-0894e690d1e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:40.880273 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:40.880871 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b157012-31f8-4c37-b0e3-0894e690d1e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:07:40.890944 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-7b157012-31f8-4c37-b0e3-0894e690d1e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 20:07:40.890944 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:07:40.890944 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:07:40.890944 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:07:40.890944 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:07:40.890944 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:07:40.890944 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:07:40.890944 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:07:40.890944 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:07:40.890944 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:07:40.890944 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:07:40.890944 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:07:40.890944 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:07:40.890944 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:07:40.890944 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:07:40.890944 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:07:40.891841 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:07:40.891841 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:07:40.891841 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:07:40.891841 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:07:40.891841 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:07:40.891841 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:07:40.891841 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:07:40.891841 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:07:40.891841 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:07:40.891841 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:07:40.891841 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:07:40.891841 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:07:40.891841 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:07:40.891841 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:07:40.891841 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:07:40.891841 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:07:40.892663 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:07:40.892663 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:07:40.892663 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:07:40.892663 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:07:40.892663 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:07:40.892663 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:07:40.892663 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:07:40.892663 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:07:40.892663 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:07:40.892663 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:07:40.892663 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 20:07:40.892663 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:07:40.898856 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 13/25] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jun 21 20:07:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:07:40.910289 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b157012-31f8-4c37-b0e3-0894e690d1e1 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:40.919254 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:40.941705 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 13/26] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:07:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 20:07:40.981947 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d79d0d2-7215-4824-ae37-57901d6475cb None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:41.078767 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b157012-31f8-4c37-b0e3-0894e690d1e1 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:41.151135 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb78da-3b7b-45a8-a524-7047468f3963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:41.151890 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb78da-3b7b-45a8-a524-7047468f3963 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:41.152204 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb78da-3b7b-45a8-a524-7047468f3963 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:41.152653 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb78da-3b7b-45a8-a524-7047468f3963 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:41.153555 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb78da-3b7b-45a8-a524-7047468f3963 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:07:41.154013 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb78da-3b7b-45a8-a524-7047468f3963 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:41.155546 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb78da-3b7b-45a8-a524-7047468f3963 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:41.164863 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 14/27] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:07:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:07:41.166466 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f058d4b-c4d3-44c4-b46a-0d1bce8308b0 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:41.166901 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f058d4b-c4d3-44c4-b46a-0d1bce8308b0 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:41.167344 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f058d4b-c4d3-44c4-b46a-0d1bce8308b0 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:41.168965 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 15/28] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:07:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:07:41.174562 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d67e1-426f-4071-9257-1ad382d7bedd None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:41.175032 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d67e1-426f-4071-9257-1ad382d7bedd None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:41.175454 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d67e1-426f-4071-9257-1ad382d7bedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:41.192616 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-503d67e1-426f-4071-9257-1ad382d7bedd None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:07:41.194025 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-503d67e1-426f-4071-9257-1ad382d7bedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:07:41.231177 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d79d0d2-7215-4824-ae37-57901d6475cb None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:41.260378 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:41.268352 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 16/29] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:07:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:07:41.269234 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d67e1-426f-4071-9257-1ad382d7bedd None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:41.297965 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ce8f8a-e805-4ca3-af82-7a22427a784e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:41.298847 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce8f8a-e805-4ca3-af82-7a22427a784e None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:41.299145 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce8f8a-e805-4ca3-af82-7a22427a784e None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:41.299489 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce8f8a-e805-4ca3-af82-7a22427a784e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:41.312761 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ce8f8a-e805-4ca3-af82-7a22427a784e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:41.314296 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ce8f8a-e805-4ca3-af82-7a22427a784e None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:41.334948 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-44ce8f8a-e805-4ca3-af82-7a22427a784e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:07:41.334948 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:07:41.334948 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:07:41.334948 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:07:41.334948 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:07:41.334948 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:07:41.334948 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:07:41.334948 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:07:41.334948 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:07:41.334948 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:07:41.334948 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:07:41.334948 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:07:41.334948 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:07:41.334948 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:07:41.334948 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:07:41.336413 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:07:41.336413 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:07:41.336413 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:07:41.336413 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:07:41.336413 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:07:41.336413 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:07:41.336413 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:07:41.336413 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:07:41.336413 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:07:41.336413 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:07:41.336413 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:07:41.336413 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:07:41.336413 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:07:41.336413 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:07:41.336413 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:07:41.336413 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:07:41.336413 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:07:41.337885 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:07:41.337885 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:07:41.337885 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:07:41.337885 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:07:41.337885 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 14/30] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:07:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:07:41.338164 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ed591-a2ad-4a23-adbc-db5e40dfbd90 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:41.338687 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ed591-a2ad-4a23-adbc-db5e40dfbd90 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:41.339127 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ed591-a2ad-4a23-adbc-db5e40dfbd90 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:41.344883 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 15/31] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:07:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:07:41.345837 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ed591-a2ad-4a23-adbc-db5e40dfbd90 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:41.377356 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:41.398482 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d67e1-426f-4071-9257-1ad382d7bedd None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:41.435479 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d191e-b9d0-4344-a323-87a4e8662589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:41.437179 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d191e-b9d0-4344-a323-87a4e8662589 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:41.437612 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d191e-b9d0-4344-a323-87a4e8662589 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:41.438030 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d191e-b9d0-4344-a323-87a4e8662589 None admin] PATH_INFO: `/v3/users/6983efac1f89435f94ebc2dacd0b3544` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:41.439485 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d191e-b9d0-4344-a323-87a4e8662589 None admin] RBAC: Authorizing `identity:get_user(user_id=6983efac1f89435f94ebc2dacd0b3544)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:41.441251 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d191e-b9d0-4344-a323-87a4e8662589 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:41.443017 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 17/32] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jun 21 20:07:41 2022] GET /identity/v3/users/6983efac1f89435f94ebc2dacd0b3544 => generated 247 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:07:41.443942 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d191e-b9d0-4344-a323-87a4e8662589 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:41.472318 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ed591-a2ad-4a23-adbc-db5e40dfbd90 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:41.511346 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2afb37-bafb-40c4-b77d-58713c77606a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:41.511971 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2afb37-bafb-40c4-b77d-58713c77606a None admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:41.512476 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2afb37-bafb-40c4-b77d-58713c77606a None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:41.513073 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:41.513742 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2afb37-bafb-40c4-b77d-58713c77606a None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:41.514768 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2afb37-bafb-40c4-b77d-58713c77606a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:41.516370 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2afb37-bafb-40c4-b77d-58713c77606a None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:41.553233 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d191e-b9d0-4344-a323-87a4e8662589 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:41.589035 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4602558-5046-4db0-bbb6-d683bc551749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:41.589935 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4602558-5046-4db0-bbb6-d683bc551749 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:41.590375 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4602558-5046-4db0-bbb6-d683bc551749 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:41.590809 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4602558-5046-4db0-bbb6-d683bc551749 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:41.591681 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4602558-5046-4db0-bbb6-d683bc551749 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:07:41.592302 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4602558-5046-4db0-bbb6-d683bc551749 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:41.593893 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4602558-5046-4db0-bbb6-d683bc551749 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:41.611615 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 18/33] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:07:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:07:41.613101 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004b1c0-c3c7-4f20-903e-48fe3858b053 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:41.613575 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004b1c0-c3c7-4f20-903e-48fe3858b053 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:41.614026 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004b1c0-c3c7-4f20-903e-48fe3858b053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:41.630568 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-b004b1c0-c3c7-4f20-903e-48fe3858b053 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:07:41.632016 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b004b1c0-c3c7-4f20-903e-48fe3858b053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:07:41.657415 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 16/34] 10.222.0.15 () {60 vars in 1131 bytes} [Tue Jun 21 20:07:41 2022] POST /identity/v3/roles => generated 219 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:07:41.658505 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2afb37-bafb-40c4-b77d-58713c77606a None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:41.705278 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 19/35] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:07:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:07:41.706486 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b004b1c0-c3c7-4f20-903e-48fe3858b053 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:41.764104 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:41.767104 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:41.782043 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2afb37-bafb-40c4-b77d-58713c77606a None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:41.814424 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b004b1c0-c3c7-4f20-903e-48fe3858b053 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:41.832919 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0929c27-6f07-4d2d-80f4-f149a5ee35fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:41.833755 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0929c27-6f07-4d2d-80f4-f149a5ee35fb None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:41.834052 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0929c27-6f07-4d2d-80f4-f149a5ee35fb None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:41.834436 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0929c27-6f07-4d2d-80f4-f149a5ee35fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:41.836612 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0929c27-6f07-4d2d-80f4-f149a5ee35fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:41.838301 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0929c27-6f07-4d2d-80f4-f149a5ee35fb None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:41.840363 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 17/36] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:07:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:07:41.844852 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0929c27-6f07-4d2d-80f4-f149a5ee35fb None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:41.857651 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af86fa50-c1dd-4a15-8855-23d048bd5d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:41.858593 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af86fa50-c1dd-4a15-8855-23d048bd5d26 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:41.859079 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af86fa50-c1dd-4a15-8855-23d048bd5d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:41.859565 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af86fa50-c1dd-4a15-8855-23d048bd5d26 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:41.860815 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af86fa50-c1dd-4a15-8855-23d048bd5d26 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:41.862559 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af86fa50-c1dd-4a15-8855-23d048bd5d26 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:41.974681 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0929c27-6f07-4d2d-80f4-f149a5ee35fb None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:42.012295 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a802b2b4-9288-4665-8782-5c80a11065ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:42.013029 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a802b2b4-9288-4665-8782-5c80a11065ea None admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:42.013324 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a802b2b4-9288-4665-8782-5c80a11065ea None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:42.013608 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a802b2b4-9288-4665-8782-5c80a11065ea None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:42.014497 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a802b2b4-9288-4665-8782-5c80a11065ea None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:42.015892 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a802b2b4-9288-4665-8782-5c80a11065ea None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:42.032167 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 20/37] 10.222.0.15 () {60 vars in 1141 bytes} [Tue Jun 21 20:07:41 2022] POST /identity/v3/projects => generated 301 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:07:42.032167 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af86fa50-c1dd-4a15-8855-23d048bd5d26 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:42.041388 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 18/38] 10.222.0.15 () {60 vars in 1131 bytes} [Tue Jun 21 20:07:41 2022] POST /identity/v3/roles => generated 225 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:07:42.042909 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6134a90-9aea-4f70-8927-9c7b4228806e None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:42.043277 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6134a90-9aea-4f70-8927-9c7b4228806e None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:42.043668 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6134a90-9aea-4f70-8927-9c7b4228806e None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:42.045230 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 19/39] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:07:42.051009 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0fdb77-b81d-4089-98c0-f35689821619 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:42.051385 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0fdb77-b81d-4089-98c0-f35689821619 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:42.051720 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0fdb77-b81d-4089-98c0-f35689821619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:42.073222 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-fa0fdb77-b81d-4089-98c0-f35689821619 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:07:42.075222 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-fa0fdb77-b81d-4089-98c0-f35689821619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:07:42.090820 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:42.230720 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 20/40] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:07:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:07:42.258990 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0fdb77-b81d-4089-98c0-f35689821619 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:42.350267 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af86fa50-c1dd-4a15-8855-23d048bd5d26 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:42.359283 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:42.388496 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0fdb77-b81d-4089-98c0-f35689821619 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:42.391157 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e770c9e-7dfd-46cf-9d86-57b82b983f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:42.392095 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e770c9e-7dfd-46cf-9d86-57b82b983f7f None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:42.392394 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e770c9e-7dfd-46cf-9d86-57b82b983f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:42.392686 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e770c9e-7dfd-46cf-9d86-57b82b983f7f None admin] PATH_INFO: `/v3/domains/default/users/6983efac1f89435f94ebc2dacd0b3544/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:42.394873 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e770c9e-7dfd-46cf-9d86-57b82b983f7f None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=6983efac1f89435f94ebc2dacd0b3544, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:42.396507 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e770c9e-7dfd-46cf-9d86-57b82b983f7f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:42.411732 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 21/41] 10.222.0.15 () {58 vars in 1361 bytes} [Tue Jun 21 20:07:42 2022] PUT /identity/v3/domains/default/users/6983efac1f89435f94ebc2dacd0b3544/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:07:42.413127 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0022d-3275-4d18-b489-cf6153c09d0b None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:42.413426 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0022d-3275-4d18-b489-cf6153c09d0b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:42.413761 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0022d-3275-4d18-b489-cf6153c09d0b None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:42.415059 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 22/42] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:07:42.420744 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd987a-90c9-4d02-911f-1b3a87cd3c62 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:42.421043 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd987a-90c9-4d02-911f-1b3a87cd3c62 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:42.421339 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd987a-90c9-4d02-911f-1b3a87cd3c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:42.436364 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b055e-47bf-446d-8a15-9735226083ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:42.437066 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b055e-47bf-446d-8a15-9735226083ce None admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:42.437358 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b055e-47bf-446d-8a15-9735226083ce None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:42.437637 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b055e-47bf-446d-8a15-9735226083ce None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:42.438524 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6b055e-47bf-446d-8a15-9735226083ce None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:42.439337 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-0afd987a-90c9-4d02-911f-1b3a87cd3c62 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:07:42.440000 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6b055e-47bf-446d-8a15-9735226083ce None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:42.441079 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0afd987a-90c9-4d02-911f-1b3a87cd3c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:07:42.457185 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 21/43] 10.222.0.15 () {60 vars in 1131 bytes} [Tue Jun 21 20:07:42 2022] POST /identity/v3/roles => generated 223 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 20:07:42.523841 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 23/44] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:07:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 20:07:42.547897 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b055e-47bf-446d-8a15-9735226083ce None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:42.558398 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:42.662112 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b055e-47bf-446d-8a15-9735226083ce None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:42.696639 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f8636-9fef-496b-b5e3-e8d6e58075e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:42.697457 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f8636-9fef-496b-b5e3-e8d6e58075e6 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:42.697753 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f8636-9fef-496b-b5e3-e8d6e58075e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:42.698038 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f8636-9fef-496b-b5e3-e8d6e58075e6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:42.699235 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f8636-9fef-496b-b5e3-e8d6e58075e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:42.700742 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f8636-9fef-496b-b5e3-e8d6e58075e6 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:42.702552 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 22/45] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:07:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:07:42.707854 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd987a-90c9-4d02-911f-1b3a87cd3c62 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:42.800901 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:42.807944 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd987a-90c9-4d02-911f-1b3a87cd3c62 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:42.843746 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d3eec-506e-412b-9c8e-9370b31a56bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:42.844479 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d3eec-506e-412b-9c8e-9370b31a56bf None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:42.844776 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d3eec-506e-412b-9c8e-9370b31a56bf None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:42.845063 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d3eec-506e-412b-9c8e-9370b31a56bf None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:42.845796 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8d3eec-506e-412b-9c8e-9370b31a56bf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:42.847264 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8d3eec-506e-412b-9c8e-9370b31a56bf None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:42.873202 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 24/46] 10.222.0.15 () {60 vars in 1141 bytes} [Tue Jun 21 20:07:42 2022] POST /identity/v3/projects => generated 312 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:07:44.456162 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75194774-779b-40c3-a12b-6722b63235b2 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:44.456680 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75194774-779b-40c3-a12b-6722b63235b2 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:44.456764 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75194774-779b-40c3-a12b-6722b63235b2 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:44.458086 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 23/47] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:07:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:07:44.463758 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08eb20-9d32-4646-bbf8-b2e910d36637 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:44.464191 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08eb20-9d32-4646-bbf8-b2e910d36637 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:44.464375 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08eb20-9d32-4646-bbf8-b2e910d36637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:44.480860 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-bd08eb20-9d32-4646-bbf8-b2e910d36637 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:07:44.482065 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-bd08eb20-9d32-4646-bbf8-b2e910d36637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:07:44.547035 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 25/48] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:07:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:07:44.570410 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75194774-779b-40c3-a12b-6722b63235b2 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:44.645188 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:44.670627 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75194774-779b-40c3-a12b-6722b63235b2 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:44.702721 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f95b4-d601-457b-a221-555739f712cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:44.703518 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f95b4-d601-457b-a221-555739f712cd None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:44.703803 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f95b4-d601-457b-a221-555739f712cd None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:44.704113 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f95b4-d601-457b-a221-555739f712cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:44.716018 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f95b4-d601-457b-a221-555739f712cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:07:44.724542 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-e80f95b4-d601-457b-a221-555739f712cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 20:07:44.724542 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:07:44.724542 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:07:44.724542 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:07:44.724542 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:07:44.724542 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:07:44.724542 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:07:44.724542 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:07:44.724542 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:07:44.724542 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:07:44.724542 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:07:44.724542 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:07:44.724542 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:07:44.724542 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:07:44.724542 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:07:44.724542 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:07:44.725374 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:07:44.725374 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:07:44.725374 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:07:44.725374 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:07:44.725374 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:07:44.725374 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:07:44.725374 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:07:44.725374 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:07:44.725374 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:07:44.725374 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:07:44.725374 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:07:44.725374 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:07:44.725374 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:07:44.725374 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:07:44.725374 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:07:44.725374 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:07:44.726564 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:07:44.726564 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:07:44.726564 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:07:44.726564 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:07:44.726564 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:07:44.726564 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:07:44.726564 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:07:44.726564 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:07:44.726564 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:07:44.726564 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:07:44.726564 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 20:07:44.726564 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:07:44.726564 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 24/49] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jun 21 20:07:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:07:44.731425 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08eb20-9d32-4646-bbf8-b2e910d36637 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:44.807621 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:44.829909 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08eb20-9d32-4646-bbf8-b2e910d36637 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:44.863792 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c175acf-a0e3-4028-9a28-59bb5914d576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:44.864498 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c175acf-a0e3-4028-9a28-59bb5914d576 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:44.864786 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c175acf-a0e3-4028-9a28-59bb5914d576 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:44.865069 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c175acf-a0e3-4028-9a28-59bb5914d576 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:44.865827 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c175acf-a0e3-4028-9a28-59bb5914d576 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:07:44.866140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c175acf-a0e3-4028-9a28-59bb5914d576 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:44.868041 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c175acf-a0e3-4028-9a28-59bb5914d576 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:44.876019 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 26/50] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:07:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:07:44.881381 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f95b4-d601-457b-a221-555739f712cd None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:44.893567 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904259a7-ecb5-4cdf-80e5-cb6d2040b713 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:44.893865 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904259a7-ecb5-4cdf-80e5-cb6d2040b713 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:44.894156 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904259a7-ecb5-4cdf-80e5-cb6d2040b713 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:44.895661 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 27/51] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:07:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 20:07:44.900277 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ebea0-1351-45e8-9068-5eaf39dd5b89 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:44.900577 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ebea0-1351-45e8-9068-5eaf39dd5b89 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:44.900873 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ebea0-1351-45e8-9068-5eaf39dd5b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:44.917192 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-2c9ebea0-1351-45e8-9068-5eaf39dd5b89 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:07:44.918408 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2c9ebea0-1351-45e8-9068-5eaf39dd5b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:07:44.978579 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f95b4-d601-457b-a221-555739f712cd None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:44.983253 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 28/52] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:07:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 20:07:45.006619 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ebea0-1351-45e8-9068-5eaf39dd5b89 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:45.012629 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614f6d0-51f0-47e5-a1dc-c0b5e38b659b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:45.013503 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614f6d0-51f0-47e5-a1dc-c0b5e38b659b None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:45.013789 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614f6d0-51f0-47e5-a1dc-c0b5e38b659b None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:45.014067 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614f6d0-51f0-47e5-a1dc-c0b5e38b659b None admin] PATH_INFO: `/v3/users/6983efac1f89435f94ebc2dacd0b3544` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:45.015487 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1614f6d0-51f0-47e5-a1dc-c0b5e38b659b None admin] RBAC: Authorizing `identity:get_user(user_id=6983efac1f89435f94ebc2dacd0b3544)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:45.016984 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1614f6d0-51f0-47e5-a1dc-c0b5e38b659b None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:45.018608 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 25/53] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jun 21 20:07:44 2022] GET /identity/v3/users/6983efac1f89435f94ebc2dacd0b3544 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:07:45.023692 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614f6d0-51f0-47e5-a1dc-c0b5e38b659b None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:45.026291 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:45.078825 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:45.108999 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ebea0-1351-45e8-9068-5eaf39dd5b89 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:45.123625 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614f6d0-51f0-47e5-a1dc-c0b5e38b659b None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:45.143704 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7838c2-1cba-47bc-8f34-88922966b621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:45.144536 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7838c2-1cba-47bc-8f34-88922966b621 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:45.144898 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7838c2-1cba-47bc-8f34-88922966b621 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:45.145187 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7838c2-1cba-47bc-8f34-88922966b621 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:45.146395 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7838c2-1cba-47bc-8f34-88922966b621 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:45.147801 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7838c2-1cba-47bc-8f34-88922966b621 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:45.149437 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 29/54] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:07:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:07:45.154770 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7838c2-1cba-47bc-8f34-88922966b621 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:45.156579 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae01ac3c-cbfb-478c-ac6c-c7a6240c8dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:45.157381 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01ac3c-cbfb-478c-ac6c-c7a6240c8dd0 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:45.157672 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01ac3c-cbfb-478c-ac6c-c7a6240c8dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:45.157963 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01ac3c-cbfb-478c-ac6c-c7a6240c8dd0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:45.159139 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae01ac3c-cbfb-478c-ac6c-c7a6240c8dd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:45.160627 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae01ac3c-cbfb-478c-ac6c-c7a6240c8dd0 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:45.162230 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 26/55] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:07:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:07:45.167707 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae01ac3c-cbfb-478c-ac6c-c7a6240c8dd0 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:45.238180 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:45.254626 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7838c2-1cba-47bc-8f34-88922966b621 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:45.291267 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f7dd8b-54e2-4a33-b364-a9a9ebd23eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:45.291978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7dd8b-54e2-4a33-b364-a9a9ebd23eb2 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:45.292271 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7dd8b-54e2-4a33-b364-a9a9ebd23eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:45.292556 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7dd8b-54e2-4a33-b364-a9a9ebd23eb2 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:45.293287 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f7dd8b-54e2-4a33-b364-a9a9ebd23eb2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:45.294775 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f7dd8b-54e2-4a33-b364-a9a9ebd23eb2 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:45.303652 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:45.323001 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 30/56] 10.222.0.15 () {60 vars in 1140 bytes} [Tue Jun 21 20:07:45 2022] POST /identity/v3/projects => generated 298 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 20:07:45.377684 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae01ac3c-cbfb-478c-ac6c-c7a6240c8dd0 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:45.413430 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b4f8e7-bab0-45b6-b0f6-99a305a98bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:45.414733 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4f8e7-bab0-45b6-b0f6-99a305a98bbe None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:45.415027 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4f8e7-bab0-45b6-b0f6-99a305a98bbe None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:45.415311 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4f8e7-bab0-45b6-b0f6-99a305a98bbe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:45.416203 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b4f8e7-bab0-45b6-b0f6-99a305a98bbe None admin] RBAC: Adding query filter params (role.id=1f5332f48d9e4c2aac866d0d546c94d5, scope.domain.id=default, user.id=6983efac1f89435f94ebc2dacd0b3544) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:07:45.416524 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b4f8e7-bab0-45b6-b0f6-99a305a98bbe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:45.418003 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b4f8e7-bab0-45b6-b0f6-99a305a98bbe None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:45.427529 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 27/57] 10.222.0.15 () {56 vars in 1322 bytes} [Tue Jun 21 20:07:45 2022] GET /identity/v3/role_assignments?user.id=6983efac1f89435f94ebc2dacd0b3544&scope.domain.id=default&role.id=1f5332f48d9e4c2aac866d0d546c94d5 => generated 530 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:07:47.347727 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92deeb27-da84-4431-8bcd-b8ec9e228144 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:47.348276 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92deeb27-da84-4431-8bcd-b8ec9e228144 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:47.348358 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92deeb27-da84-4431-8bcd-b8ec9e228144 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:47.349724 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 31/58] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:07:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:07:47.354777 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96c918-febb-4cc4-879c-5768ad6cbd69 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:47.355185 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96c918-febb-4cc4-879c-5768ad6cbd69 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:47.355346 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96c918-febb-4cc4-879c-5768ad6cbd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:47.372446 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-0d96c918-febb-4cc4-879c-5768ad6cbd69 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:07:47.373643 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-0d96c918-febb-4cc4-879c-5768ad6cbd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:07:47.437571 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 28/59] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:07:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:07:47.462306 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92deeb27-da84-4431-8bcd-b8ec9e228144 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:47.562508 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92deeb27-da84-4431-8bcd-b8ec9e228144 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:47.593643 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb9216-ca72-4dad-9949-142e1c1ec575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:47.594433 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb9216-ca72-4dad-9949-142e1c1ec575 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:47.594722 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb9216-ca72-4dad-9949-142e1c1ec575 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:47.595006 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb9216-ca72-4dad-9949-142e1c1ec575 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:47.596207 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb9216-ca72-4dad-9949-142e1c1ec575 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:47.598063 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb9216-ca72-4dad-9949-142e1c1ec575 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:47.599438 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 32/60] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:07:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:07:47.605765 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96c918-febb-4cc4-879c-5768ad6cbd69 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:47.668171 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:47.705149 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96c918-febb-4cc4-879c-5768ad6cbd69 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:47.737883 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef9a8b5-edba-4e86-ad06-aa53b5d18d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:47.738555 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9a8b5-edba-4e86-ad06-aa53b5d18d54 None admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:47.738846 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9a8b5-edba-4e86-ad06-aa53b5d18d54 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:47.739128 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9a8b5-edba-4e86-ad06-aa53b5d18d54 None admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:47.739845 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef9a8b5-edba-4e86-ad06-aa53b5d18d54 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:47.741381 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef9a8b5-edba-4e86-ad06-aa53b5d18d54 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:47.766410 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 29/61] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Jun 21 20:07:47 2022] POST /identity/v3/users => generated 275 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:07:50.930577 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472d40e-67a8-4535-b3c8-a401cda68824 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:50.931112 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472d40e-67a8-4535-b3c8-a401cda68824 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:50.931112 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472d40e-67a8-4535-b3c8-a401cda68824 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:50.932545 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 33/62] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:07:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:07:50.937919 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c193349b-8910-4fb9-a86a-4f4790391d36 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:50.938750 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c193349b-8910-4fb9-a86a-4f4790391d36 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:50.939243 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c193349b-8910-4fb9-a86a-4f4790391d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:50.958348 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-c193349b-8910-4fb9-a86a-4f4790391d36 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:07:50.959845 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-c193349b-8910-4fb9-a86a-4f4790391d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:07:51.060208 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 30/63] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:07:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:07:51.075211 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70a674-3f19-46e0-bbcf-2a8ee24e4062 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:51.075784 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70a674-3f19-46e0-bbcf-2a8ee24e4062 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:51.076317 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70a674-3f19-46e0-bbcf-2a8ee24e4062 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:51.077886 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 34/64] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:07:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:07:51.083129 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca95bf-36b4-4839-88c9-6a1712cf3c97 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:51.083645 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca95bf-36b4-4839-88c9-6a1712cf3c97 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:51.084174 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca95bf-36b4-4839-88c9-6a1712cf3c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:51.097315 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70a674-3f19-46e0-bbcf-2a8ee24e4062 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:51.112729 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-afca95bf-36b4-4839-88c9-6a1712cf3c97 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:07:51.114227 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-afca95bf-36b4-4839-88c9-6a1712cf3c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:07:51.182345 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:51.187550 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:51.215409 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 31/65] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:07:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:07:51.221167 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e6746-72fd-4b1b-afe3-6c21a1d39847 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:51.221376 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e6746-72fd-4b1b-afe3-6c21a1d39847 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:51.223939 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e6746-72fd-4b1b-afe3-6c21a1d39847 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:51.223939 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 32/66] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:07:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:07:51.230990 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f665bb0-5c98-4ad5-ab11-867546ebe211 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:51.231281 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f665bb0-5c98-4ad5-ab11-867546ebe211 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:51.231567 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f665bb0-5c98-4ad5-ab11-867546ebe211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:51.256985 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-1f665bb0-5c98-4ad5-ab11-867546ebe211 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:07:51.258914 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-1f665bb0-5c98-4ad5-ab11-867546ebe211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:07:51.259439 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70a674-3f19-46e0-bbcf-2a8ee24e4062 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:51.305607 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273e9a1-04fc-4550-ab89-3c31033798e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:51.306602 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273e9a1-04fc-4550-ab89-3c31033798e3 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:51.307350 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273e9a1-04fc-4550-ab89-3c31033798e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:51.308170 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273e9a1-04fc-4550-ab89-3c31033798e3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:51.322546 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0273e9a1-04fc-4550-ab89-3c31033798e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:07:51.331053 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-0273e9a1-04fc-4550-ab89-3c31033798e3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 20:07:51.331053 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:07:51.331053 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:07:51.331053 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:07:51.331053 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:07:51.331053 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:07:51.331053 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:07:51.331053 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:07:51.331053 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:07:51.331053 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:07:51.331053 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:07:51.331053 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:07:51.331053 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:07:51.331053 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:07:51.331053 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:07:51.331053 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:07:51.332014 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:07:51.332014 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:07:51.332014 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:07:51.332014 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:07:51.332014 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:07:51.332014 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:07:51.332014 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:07:51.332014 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:07:51.332014 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:07:51.332014 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:07:51.332014 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:07:51.332014 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:07:51.332014 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:07:51.332014 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:07:51.332014 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:07:51.332014 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:07:51.332777 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:07:51.332777 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:07:51.332777 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:07:51.332777 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:07:51.332777 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:07:51.332777 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:07:51.332777 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:07:51.332777 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:07:51.332777 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:07:51.332777 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:07:51.332777 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 20:07:51.332777 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:07:51.334537 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 33/67] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:07:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:07:51.336069 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f665bb0-5c98-4ad5-ab11-867546ebe211 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:51.336275 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 35/68] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:07:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:07:51.342045 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273e9a1-04fc-4550-ab89-3c31033798e3 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:51.448339 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273e9a1-04fc-4550-ab89-3c31033798e3 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:51.452841 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f665bb0-5c98-4ad5-ab11-867546ebe211 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:51.463847 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:51.466900 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:51.484263 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eef8cc-07bb-41bf-b1d6-207e39dc616b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:51.484937 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eef8cc-07bb-41bf-b1d6-207e39dc616b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:51.485234 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eef8cc-07bb-41bf-b1d6-207e39dc616b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:51.485778 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eef8cc-07bb-41bf-b1d6-207e39dc616b None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:51.486535 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eef8cc-07bb-41bf-b1d6-207e39dc616b None admin] RBAC: Adding query filter params (name=member) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:07:51.486852 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eef8cc-07bb-41bf-b1d6-207e39dc616b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:51.487414 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ffbf30-6e78-44a3-9656-0188c4189a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:51.488250 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffbf30-6e78-44a3-9656-0188c4189a87 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:51.488340 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eef8cc-07bb-41bf-b1d6-207e39dc616b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:51.488540 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffbf30-6e78-44a3-9656-0188c4189a87 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:51.488820 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffbf30-6e78-44a3-9656-0188c4189a87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:51.501742 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 36/69] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Jun 21 20:07:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:07:51.501742 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eef8cc-07bb-41bf-b1d6-207e39dc616b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:51.502886 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ffbf30-6e78-44a3-9656-0188c4189a87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:07:51.511075 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-85ffbf30-6e78-44a3-9656-0188c4189a87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 20:07:51.511075 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:07:51.511075 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:07:51.511075 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:07:51.511075 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:07:51.511075 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:07:51.511075 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:07:51.511075 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:07:51.511075 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:07:51.511075 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:07:51.511075 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:07:51.511075 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:07:51.511075 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:07:51.511075 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:07:51.511075 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:07:51.511075 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:07:51.512140 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:07:51.512140 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:07:51.512140 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:07:51.512140 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:07:51.512140 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:07:51.512140 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:07:51.512140 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:07:51.512140 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:07:51.512140 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:07:51.512140 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:07:51.512140 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:07:51.512140 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:07:51.512140 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:07:51.512140 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:07:51.512140 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:07:51.512140 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:07:51.512904 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:07:51.512904 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:07:51.512904 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:07:51.512904 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:07:51.512904 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:07:51.512904 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:07:51.512904 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:07:51.512904 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:07:51.512904 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:07:51.512904 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:07:51.512904 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 20:07:51.512904 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:07:51.512904 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 34/70] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jun 21 20:07:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:07:51.513723 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565bd43-7ece-41e7-853e-42d65ab7b925 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:51.513929 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565bd43-7ece-41e7-853e-42d65ab7b925 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:51.514218 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565bd43-7ece-41e7-853e-42d65ab7b925 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:51.515590 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 35/71] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:07:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:07:51.516690 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf72ff-5e0d-4f79-81f8-0b3591bbe3fc None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:51.516989 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf72ff-5e0d-4f79-81f8-0b3591bbe3fc None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:51.517269 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf72ff-5e0d-4f79-81f8-0b3591bbe3fc None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:51.518470 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 36/72] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:07:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:07:51.519433 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf72ff-5e0d-4f79-81f8-0b3591bbe3fc None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:51.602836 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eef8cc-07bb-41bf-b1d6-207e39dc616b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:51.621684 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf72ff-5e0d-4f79-81f8-0b3591bbe3fc None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:51.636900 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ba95c-637e-4383-af2e-fa79c9e4484d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:51.637709 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ba95c-637e-4383-af2e-fa79c9e4484d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:51.638013 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ba95c-637e-4383-af2e-fa79c9e4484d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:51.638300 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ba95c-637e-4383-af2e-fa79c9e4484d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:51.648703 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284ba95c-637e-4383-af2e-fa79c9e4484d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:07:51.654518 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62a751-5c21-4a0a-8372-8542aa96d1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:51.655391 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62a751-5c21-4a0a-8372-8542aa96d1c9 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:51.655680 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62a751-5c21-4a0a-8372-8542aa96d1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:51.655985 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62a751-5c21-4a0a-8372-8542aa96d1c9 None admin] PATH_INFO: `/v3/users/4cd92ad55d0048e4947a9eb9038bc935` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:51.656843 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-284ba95c-637e-4383-af2e-fa79c9e4484d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 20:07:51.656843 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:07:51.656843 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:07:51.656843 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:07:51.656843 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:07:51.656843 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:07:51.656843 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:07:51.656843 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:07:51.656843 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:07:51.656843 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:07:51.656843 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:07:51.656843 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:07:51.656843 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:07:51.656843 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:07:51.656843 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:07:51.656843 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:07:51.657695 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:07:51.657695 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:07:51.657695 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:07:51.657695 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:07:51.657695 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:07:51.657695 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:07:51.657695 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:07:51.657695 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:07:51.657695 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:07:51.657695 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:07:51.657695 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:07:51.657695 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:07:51.657695 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:07:51.657695 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:07:51.657695 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:07:51.657695 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:07:51.658450 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:07:51.658450 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:07:51.658450 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:07:51.658450 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:07:51.658450 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:07:51.658450 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:07:51.658450 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:07:51.658450 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:07:51.658450 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:07:51.658450 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:07:51.658450 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 20:07:51.658450 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:07:51.658450 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 37/73] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Jun 21 20:07:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:07:51.659107 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ba95c-637e-4383-af2e-fa79c9e4484d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:51.673217 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e62a751-5c21-4a0a-8372-8542aa96d1c9 None admin] RBAC: Authorizing `identity:get_user(user_id=4cd92ad55d0048e4947a9eb9038bc935)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:51.674699 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e62a751-5c21-4a0a-8372-8542aa96d1c9 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:51.676445 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 37/74] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jun 21 20:07:51 2022] GET /identity/v3/users/4cd92ad55d0048e4947a9eb9038bc935 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:07:51.677713 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670d7f4-af92-48db-8a78-d6604ff7d4f2 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:51.678021 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670d7f4-af92-48db-8a78-d6604ff7d4f2 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:51.678308 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670d7f4-af92-48db-8a78-d6604ff7d4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:51.695225 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-b670d7f4-af92-48db-8a78-d6604ff7d4f2 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:07:51.696460 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-b670d7f4-af92-48db-8a78-d6604ff7d4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:07:51.701866 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:51.719391 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:51.760205 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ba95c-637e-4383-af2e-fa79c9e4484d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:51.763145 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 38/75] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:07:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:07:51.764416 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d37f19-c5b5-4a76-a482-f279a9f949f1 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:51.764712 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d37f19-c5b5-4a76-a482-f279a9f949f1 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:51.765000 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d37f19-c5b5-4a76-a482-f279a9f949f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:51.783635 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-41d37f19-c5b5-4a76-a482-f279a9f949f1 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:07:51.784930 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-41d37f19-c5b5-4a76-a482-f279a9f949f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:07:51.794277 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e36808-f4e3-4d3b-9de2-ad0a296bb1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:51.794959 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e36808-f4e3-4d3b-9de2-ad0a296bb1a6 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:51.795257 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e36808-f4e3-4d3b-9de2-ad0a296bb1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:51.795544 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e36808-f4e3-4d3b-9de2-ad0a296bb1a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:51.796349 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e36808-f4e3-4d3b-9de2-ad0a296bb1a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:07:51.796670 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e36808-f4e3-4d3b-9de2-ad0a296bb1a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:51.798060 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e36808-f4e3-4d3b-9de2-ad0a296bb1a6 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:51.806698 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 38/76] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:07:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:07:51.807495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e36808-f4e3-4d3b-9de2-ad0a296bb1a6 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:51.851859 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 39/77] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:07:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:07:51.852820 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d37f19-c5b5-4a76-a482-f279a9f949f1 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:51.917961 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e36808-f4e3-4d3b-9de2-ad0a296bb1a6 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:51.919471 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:51.941139 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:51.952934 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e3c31-f7ee-4c4f-ac37-03aa13f6fa04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:51.953539 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e3c31-f7ee-4c4f-ac37-03aa13f6fa04 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:51.953831 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e3c31-f7ee-4c4f-ac37-03aa13f6fa04 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:51.954117 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e3c31-f7ee-4c4f-ac37-03aa13f6fa04 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:51.954402 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d37f19-c5b5-4a76-a482-f279a9f949f1 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:51.954873 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944e3c31-f7ee-4c4f-ac37-03aa13f6fa04 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:07:51.955190 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944e3c31-f7ee-4c4f-ac37-03aa13f6fa04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:51.956617 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944e3c31-f7ee-4c4f-ac37-03aa13f6fa04 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:51.964504 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 39/78] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jun 21 20:07:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:07:51.965296 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e3c31-f7ee-4c4f-ac37-03aa13f6fa04 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:51.994281 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2d8f4-1145-4cfe-ad8b-57665edc7125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:51.994942 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2d8f4-1145-4cfe-ad8b-57665edc7125 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:51.995236 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2d8f4-1145-4cfe-ad8b-57665edc7125 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:51.995519 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2d8f4-1145-4cfe-ad8b-57665edc7125 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:52.063105 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d2d8f4-1145-4cfe-ad8b-57665edc7125 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:52.063895 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e3c31-f7ee-4c4f-ac37-03aa13f6fa04 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:52.064609 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d2d8f4-1145-4cfe-ad8b-57665edc7125 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:52.096216 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35faeb9-b5de-4cb3-97c7-da07a0345ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:52.097009 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35faeb9-b5de-4cb3-97c7-da07a0345ca2 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:52.097300 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35faeb9-b5de-4cb3-97c7-da07a0345ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:52.097584 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35faeb9-b5de-4cb3-97c7-da07a0345ca2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:52.098762 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35faeb9-b5de-4cb3-97c7-da07a0345ca2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:52.100277 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35faeb9-b5de-4cb3-97c7-da07a0345ca2 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:52.102419 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 40/79] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:07:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:07:52.103206 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35faeb9-b5de-4cb3-97c7-da07a0345ca2 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:52.137514 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:52.148771 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:52.161731 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 40/80] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:07:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 20:07:52.162555 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2d8f4-1145-4cfe-ad8b-57665edc7125 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:52.206979 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35faeb9-b5de-4cb3-97c7-da07a0345ca2 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:52.240373 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a89bc-3103-44d2-acad-14525d585a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:52.241250 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a89bc-3103-44d2-acad-14525d585a43 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:52.241658 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a89bc-3103-44d2-acad-14525d585a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:52.242446 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a89bc-3103-44d2-acad-14525d585a43 None admin] PATH_INFO: `/v3/users/6983efac1f89435f94ebc2dacd0b3544` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:52.243662 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7a89bc-3103-44d2-acad-14525d585a43 None admin] RBAC: Authorizing `identity:get_user(user_id=6983efac1f89435f94ebc2dacd0b3544)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:52.245155 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7a89bc-3103-44d2-acad-14525d585a43 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:52.246791 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 41/81] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jun 21 20:07:52 2022] GET /identity/v3/users/6983efac1f89435f94ebc2dacd0b3544 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:07:52.251222 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a89bc-3103-44d2-acad-14525d585a43 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:52.259220 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2d8f4-1145-4cfe-ad8b-57665edc7125 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:52.292515 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde27ad3-3969-4aa5-853d-b73388570c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:52.293313 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde27ad3-3969-4aa5-853d-b73388570c60 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:52.293603 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde27ad3-3969-4aa5-853d-b73388570c60 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:52.293886 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde27ad3-3969-4aa5-853d-b73388570c60 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:52.303864 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde27ad3-3969-4aa5-853d-b73388570c60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:07:52.312060 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-fde27ad3-3969-4aa5-853d-b73388570c60 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 20:07:52.312060 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:07:52.312060 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:07:52.312060 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:07:52.312060 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:07:52.312060 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:07:52.312060 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:07:52.312060 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:07:52.312060 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:07:52.312060 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:07:52.312060 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:07:52.312060 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:07:52.312060 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:07:52.312060 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:07:52.312060 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:07:52.312060 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:07:52.313082 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:07:52.313082 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:07:52.313082 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:07:52.313082 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:07:52.313082 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:07:52.313082 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:07:52.313082 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:07:52.313082 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:07:52.313082 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:07:52.313082 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:07:52.313082 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:07:52.313082 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:07:52.313082 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:07:52.313082 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:07:52.313082 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:07:52.313082 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:07:52.313855 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:07:52.313855 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:07:52.313855 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:07:52.313855 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:07:52.313855 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:07:52.313855 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:07:52.313855 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:07:52.313855 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:07:52.313855 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:07:52.313855 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:07:52.313855 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 20:07:52.313855 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:07:52.313855 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 41/82] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:07:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:07:52.314484 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde27ad3-3969-4aa5-853d-b73388570c60 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:52.345219 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:52.348453 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a89bc-3103-44d2-acad-14525d585a43 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:52.362919 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:52.381694 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed942d-dae6-4e31-8f33-52ce18fc44a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:52.382596 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed942d-dae6-4e31-8f33-52ce18fc44a1 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:52.382885 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed942d-dae6-4e31-8f33-52ce18fc44a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:52.383165 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed942d-dae6-4e31-8f33-52ce18fc44a1 None admin] PATH_INFO: `/v3/users/4cd92ad55d0048e4947a9eb9038bc935` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:52.384376 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fed942d-dae6-4e31-8f33-52ce18fc44a1 None admin] RBAC: Authorizing `identity:get_user(user_id=4cd92ad55d0048e4947a9eb9038bc935)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:52.385799 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fed942d-dae6-4e31-8f33-52ce18fc44a1 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:52.387409 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 42/83] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jun 21 20:07:52 2022] GET /identity/v3/users/4cd92ad55d0048e4947a9eb9038bc935 => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:07:52.388192 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed942d-dae6-4e31-8f33-52ce18fc44a1 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:52.417145 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde27ad3-3969-4aa5-853d-b73388570c60 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:52.450074 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2975461c-c785-46d8-8cd1-b3601aca2dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:52.450743 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975461c-c785-46d8-8cd1-b3601aca2dcc None admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:52.451060 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975461c-c785-46d8-8cd1-b3601aca2dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:52.451342 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975461c-c785-46d8-8cd1-b3601aca2dcc None admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:52.452088 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2975461c-c785-46d8-8cd1-b3601aca2dcc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:52.453525 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2975461c-c785-46d8-8cd1-b3601aca2dcc None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:52.472873 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 42/84] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Jun 21 20:07:52 2022] POST /identity/v3/users => generated 289 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:07:52.473621 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2975461c-c785-46d8-8cd1-b3601aca2dcc None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:52.489098 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed942d-dae6-4e31-8f33-52ce18fc44a1 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:52.530242 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4f264-f78a-4e03-ae02-009aaf55b1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:52.531138 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4f264-f78a-4e03-ae02-009aaf55b1d6 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:52.531493 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4f264-f78a-4e03-ae02-009aaf55b1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:52.531789 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4f264-f78a-4e03-ae02-009aaf55b1d6 None admin] PATH_INFO: `/v3/projects/54e781b3ce904441a3692659b01df849` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:52.533342 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff4f264-f78a-4e03-ae02-009aaf55b1d6 None admin] RBAC: Authorizing `identity:get_project(project_id=54e781b3ce904441a3692659b01df849)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:52.534838 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff4f264-f78a-4e03-ae02-009aaf55b1d6 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:52.542190 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 43/85] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jun 21 20:07:52 2022] GET /identity/v3/projects/54e781b3ce904441a3692659b01df849 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:07:52.542190 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4f264-f78a-4e03-ae02-009aaf55b1d6 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:52.579612 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:52.595502 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2975461c-c785-46d8-8cd1-b3601aca2dcc None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:52.598514 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:52.639575 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e386df4e-b70e-4df6-9dd2-c112115ba1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:52.639893 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386df4e-b70e-4df6-9dd2-c112115ba1dc None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:52.640968 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386df4e-b70e-4df6-9dd2-c112115ba1dc None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:52.641254 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386df4e-b70e-4df6-9dd2-c112115ba1dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:52.659600 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4f264-f78a-4e03-ae02-009aaf55b1d6 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:52.704302 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c55375-cbb9-45ce-8bed-511cc7e13d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:52.705237 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c55375-cbb9-45ce-8bed-511cc7e13d71 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:52.705675 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c55375-cbb9-45ce-8bed-511cc7e13d71 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:52.706097 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c55375-cbb9-45ce-8bed-511cc7e13d71 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:52.706995 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c55375-cbb9-45ce-8bed-511cc7e13d71 None admin] RBAC: Adding query filter params (name=member) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:07:52.707449 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c55375-cbb9-45ce-8bed-511cc7e13d71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:52.709008 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c55375-cbb9-45ce-8bed-511cc7e13d71 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:52.719060 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 44/86] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Jun 21 20:07:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:07:52.720121 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c55375-cbb9-45ce-8bed-511cc7e13d71 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:52.725656 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e386df4e-b70e-4df6-9dd2-c112115ba1dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:52.726600 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e386df4e-b70e-4df6-9dd2-c112115ba1dc None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:52.838552 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:52.844721 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c55375-cbb9-45ce-8bed-511cc7e13d71 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:52.863966 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 43/87] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:07:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 20:07:52.865285 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e386df4e-b70e-4df6-9dd2-c112115ba1dc None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:52.869000 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:52.889536 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf1b2c-7750-427c-81b4-97fde6291bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:52.890212 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf1b2c-7750-427c-81b4-97fde6291bb5 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:52.890507 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf1b2c-7750-427c-81b4-97fde6291bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:52.890794 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf1b2c-7750-427c-81b4-97fde6291bb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:52.972833 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e386df4e-b70e-4df6-9dd2-c112115ba1dc None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:52.982400 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cf1b2c-7750-427c-81b4-97fde6291bb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:52.984191 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cf1b2c-7750-427c-81b4-97fde6291bb5 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:53.006874 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0815770-8707-43e9-95a4-8bd51c4ee85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:53.008225 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0815770-8707-43e9-95a4-8bd51c4ee85b None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:53.008614 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0815770-8707-43e9-95a4-8bd51c4ee85b None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:53.008994 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0815770-8707-43e9-95a4-8bd51c4ee85b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:53.009933 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0815770-8707-43e9-95a4-8bd51c4ee85b None admin] RBAC: Adding query filter params (role.id=0e9566d3696545f9b49bdc8a9574577c, scope.project.id=54e781b3ce904441a3692659b01df849, user.id=4cd92ad55d0048e4947a9eb9038bc935) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:07:53.010350 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0815770-8707-43e9-95a4-8bd51c4ee85b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:53.011890 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0815770-8707-43e9-95a4-8bd51c4ee85b None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:53.024243 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 44/88] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jun 21 20:07:52 2022] GET /identity/v3/role_assignments?user.id=4cd92ad55d0048e4947a9eb9038bc935&scope.project.id=54e781b3ce904441a3692659b01df849&role.id=0e9566d3696545f9b49bdc8a9574577c => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:07:53.025368 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0815770-8707-43e9-95a4-8bd51c4ee85b None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:53.106569 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:53.115776 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 45/89] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:07:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 20:07:53.119904 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf1b2c-7750-427c-81b4-97fde6291bb5 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:53.166650 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:53.230309 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0815770-8707-43e9-95a4-8bd51c4ee85b None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:53.274922 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e18aa-d1ef-41b4-a04a-7ed1f760e9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:53.275717 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e18aa-d1ef-41b4-a04a-7ed1f760e9c3 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:53.276883 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e18aa-d1ef-41b4-a04a-7ed1f760e9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:53.277272 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e18aa-d1ef-41b4-a04a-7ed1f760e9c3 None admin] PATH_INFO: `/v3/users/4cd92ad55d0048e4947a9eb9038bc935` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:53.278777 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8e18aa-d1ef-41b4-a04a-7ed1f760e9c3 None admin] RBAC: Authorizing `identity:get_user(user_id=4cd92ad55d0048e4947a9eb9038bc935)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:53.280769 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8e18aa-d1ef-41b4-a04a-7ed1f760e9c3 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:53.283015 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 45/90] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jun 21 20:07:53 2022] GET /identity/v3/users/4cd92ad55d0048e4947a9eb9038bc935 => generated 275 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:07:53.284302 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e18aa-d1ef-41b4-a04a-7ed1f760e9c3 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:53.299131 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf1b2c-7750-427c-81b4-97fde6291bb5 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:53.377039 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe52680-4f30-4033-a88c-e4b904b6163f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:53.378161 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe52680-4f30-4033-a88c-e4b904b6163f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:53.378637 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe52680-4f30-4033-a88c-e4b904b6163f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:53.379054 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe52680-4f30-4033-a88c-e4b904b6163f None admin] PATH_INFO: `/v3/projects/54e781b3ce904441a3692659b01df849` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:53.384745 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe52680-4f30-4033-a88c-e4b904b6163f None admin] RBAC: Authorizing `identity:get_project(project_id=54e781b3ce904441a3692659b01df849)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:53.386474 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe52680-4f30-4033-a88c-e4b904b6163f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:53.388380 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 46/91] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jun 21 20:07:53 2022] GET /identity/v3/projects/54e781b3ce904441a3692659b01df849 => generated 298 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:07:53.389441 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe52680-4f30-4033-a88c-e4b904b6163f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:53.399532 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e18aa-d1ef-41b4-a04a-7ed1f760e9c3 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:53.440355 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240027f-fe21-41ae-9051-4e241db392f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:53.441841 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240027f-fe21-41ae-9051-4e241db392f8 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:53.442231 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240027f-fe21-41ae-9051-4e241db392f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:53.442611 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240027f-fe21-41ae-9051-4e241db392f8 None admin] PATH_INFO: `/v3/projects/54e781b3ce904441a3692659b01df849` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:53.444194 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b240027f-fe21-41ae-9051-4e241db392f8 None admin] RBAC: Authorizing `identity:get_project(project_id=54e781b3ce904441a3692659b01df849)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:53.446888 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b240027f-fe21-41ae-9051-4e241db392f8 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:53.449277 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 46/92] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jun 21 20:07:53 2022] GET /identity/v3/projects/54e781b3ce904441a3692659b01df849 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:07:53.450728 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240027f-fe21-41ae-9051-4e241db392f8 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:53.454587 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:53.528120 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:53.572556 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240027f-fe21-41ae-9051-4e241db392f8 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:53.598160 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe52680-4f30-4033-a88c-e4b904b6163f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:53.625612 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f628b-b7d8-4756-9df8-2f703175de6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:53.626333 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f628b-b7d8-4756-9df8-2f703175de6e None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:53.626622 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f628b-b7d8-4756-9df8-2f703175de6e None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:53.626911 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f628b-b7d8-4756-9df8-2f703175de6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:53.627746 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541f628b-b7d8-4756-9df8-2f703175de6e None admin] RBAC: Adding query filter params (role.id=1f5332f48d9e4c2aac866d0d546c94d5, scope.project.id=54e781b3ce904441a3692659b01df849, user.id=6983efac1f89435f94ebc2dacd0b3544) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:07:53.628108 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541f628b-b7d8-4756-9df8-2f703175de6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:53.629553 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541f628b-b7d8-4756-9df8-2f703175de6e None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:53.635760 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 47/93] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jun 21 20:07:53 2022] GET /identity/v3/role_assignments?user.id=6983efac1f89435f94ebc2dacd0b3544&scope.project.id=54e781b3ce904441a3692659b01df849&role.id=1f5332f48d9e4c2aac866d0d546c94d5 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:07:53.636671 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f628b-b7d8-4756-9df8-2f703175de6e None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:53.701235 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce8e129-559b-454b-bf15-aa1ec956595e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:53.702288 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce8e129-559b-454b-bf15-aa1ec956595e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:53.702775 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce8e129-559b-454b-bf15-aa1ec956595e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:53.703254 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce8e129-559b-454b-bf15-aa1ec956595e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:53.708828 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:53.750938 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f628b-b7d8-4756-9df8-2f703175de6e None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:53.821280 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce8e129-559b-454b-bf15-aa1ec956595e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:53.823037 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce8e129-559b-454b-bf15-aa1ec956595e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:53.864644 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbbffc9-ad90-412d-8720-e294e25a6ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:53.865331 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbffc9-ad90-412d-8720-e294e25a6ce9 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:53.865623 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbffc9-ad90-412d-8720-e294e25a6ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:53.865909 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbffc9-ad90-412d-8720-e294e25a6ce9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:53.866815 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbbffc9-ad90-412d-8720-e294e25a6ce9 None admin] RBAC: Adding query filter params (role.id=141a45d0143342f2ac0eafc233c9b6c3, scope.project.id=54e781b3ce904441a3692659b01df849, user.id=4cd92ad55d0048e4947a9eb9038bc935) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:07:53.867139 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbbffc9-ad90-412d-8720-e294e25a6ce9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:53.868653 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbbffc9-ad90-412d-8720-e294e25a6ce9 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:53.882993 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 48/94] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jun 21 20:07:53 2022] GET /identity/v3/role_assignments?user.id=4cd92ad55d0048e4947a9eb9038bc935&scope.project.id=54e781b3ce904441a3692659b01df849&role.id=141a45d0143342f2ac0eafc233c9b6c3 => generated 259 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:07:53.944129 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:53.988984 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 47/95] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:07:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 20:07:53.994486 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbbffc9-ad90-412d-8720-e294e25a6ce9 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:54.142255 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbbffc9-ad90-412d-8720-e294e25a6ce9 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:54.182577 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:54.191625 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b36884e-9f29-451c-8290-1b9aab8da620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:54.192535 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b36884e-9f29-451c-8290-1b9aab8da620 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:54.192822 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b36884e-9f29-451c-8290-1b9aab8da620 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:54.193104 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b36884e-9f29-451c-8290-1b9aab8da620 None admin] PATH_INFO: `/v3/projects/3b34221c960b484287511819863e6537` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:54.194336 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b36884e-9f29-451c-8290-1b9aab8da620 None admin] RBAC: Authorizing `identity:get_project(project_id=3b34221c960b484287511819863e6537)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:54.196432 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b36884e-9f29-451c-8290-1b9aab8da620 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:54.198172 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 49/96] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jun 21 20:07:53 2022] GET /identity/v3/projects/3b34221c960b484287511819863e6537 => generated 312 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:07:54.203881 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce8e129-559b-454b-bf15-aa1ec956595e None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:54.338439 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce8e129-559b-454b-bf15-aa1ec956595e None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:54.386605 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cc5663-4b3c-472e-ae94-f2044c51b048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:54.387628 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc5663-4b3c-472e-ae94-f2044c51b048 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:54.388159 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc5663-4b3c-472e-ae94-f2044c51b048 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:54.388652 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc5663-4b3c-472e-ae94-f2044c51b048 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:54.389692 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cc5663-4b3c-472e-ae94-f2044c51b048 None admin] RBAC: Adding query filter params (role.id=0e9566d3696545f9b49bdc8a9574577c, scope.project.id=3b34221c960b484287511819863e6537, user.id=4cd92ad55d0048e4947a9eb9038bc935) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:07:54.390255 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cc5663-4b3c-472e-ae94-f2044c51b048 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:54.391899 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cc5663-4b3c-472e-ae94-f2044c51b048 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:54.399015 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 48/97] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jun 21 20:07:54 2022] GET /identity/v3/role_assignments?user.id=4cd92ad55d0048e4947a9eb9038bc935&scope.project.id=3b34221c960b484287511819863e6537&role.id=0e9566d3696545f9b49bdc8a9574577c => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:07:54.961761 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c608f-56d9-4970-a437-2456d60cc7e4 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:54.962109 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c608f-56d9-4970-a437-2456d60cc7e4 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:54.962355 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c608f-56d9-4970-a437-2456d60cc7e4 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:54.963732 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 50/98] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:07:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:07:54.969254 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0918bab-eb78-455b-ad49-1fd4a65d1fe0 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:54.969816 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0918bab-eb78-455b-ad49-1fd4a65d1fe0 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:54.970293 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0918bab-eb78-455b-ad49-1fd4a65d1fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:54.996915 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c0918bab-eb78-455b-ad49-1fd4a65d1fe0 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:07:54.998893 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c0918bab-eb78-455b-ad49-1fd4a65d1fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:07:55.026815 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:55.084195 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 49/99] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:07:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:07:55.119765 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c608f-56d9-4970-a437-2456d60cc7e4 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:55.124838 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ff373-11a9-421a-b0da-8809ffa18d75 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:55.127044 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ff373-11a9-421a-b0da-8809ffa18d75 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:55.127044 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ff373-11a9-421a-b0da-8809ffa18d75 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:55.127044 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 50/100] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:07:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:07:55.135562 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132135f2-3af6-480e-b115-369cb0b6404e None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:55.135860 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132135f2-3af6-480e-b115-369cb0b6404e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:55.136174 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132135f2-3af6-480e-b115-369cb0b6404e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:55.163441 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-132135f2-3af6-480e-b115-369cb0b6404e None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:07:55.164665 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-132135f2-3af6-480e-b115-369cb0b6404e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:07:55.244728 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c608f-56d9-4970-a437-2456d60cc7e4 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:55.284355 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15961468-e27a-4b80-937c-2781d93932a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:55.285581 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15961468-e27a-4b80-937c-2781d93932a7 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:55.286122 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15961468-e27a-4b80-937c-2781d93932a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:55.286605 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15961468-e27a-4b80-937c-2781d93932a7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:55.299826 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15961468-e27a-4b80-937c-2781d93932a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:07:55.309294 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-15961468-e27a-4b80-937c-2781d93932a7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 20:07:55.309294 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:07:55.309294 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:07:55.309294 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:07:55.309294 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:07:55.309294 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:07:55.309294 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:07:55.309294 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:07:55.309294 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:07:55.309294 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:07:55.309294 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:07:55.309294 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:07:55.309294 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:07:55.309294 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:07:55.309294 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:07:55.309294 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:07:55.310133 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:07:55.310133 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:07:55.310133 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:07:55.310133 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:07:55.310133 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:07:55.310133 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:07:55.310133 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:07:55.310133 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:07:55.310133 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:07:55.310133 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:07:55.310133 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:07:55.310133 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:07:55.310133 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:07:55.310133 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:07:55.310133 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:07:55.310133 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:07:55.310909 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:07:55.310909 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:07:55.310909 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:07:55.310909 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:07:55.310909 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:07:55.310909 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:07:55.310909 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:07:55.310909 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:07:55.310909 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:07:55.310909 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:07:55.310909 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 20:07:55.310909 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:07:55.314049 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 51/101] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:07:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:07:55.320201 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15961468-e27a-4b80-937c-2781d93932a7 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:55.325524 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 51/102] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:07:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 20:07:55.399180 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132135f2-3af6-480e-b115-369cb0b6404e None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:55.408268 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:55.464292 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15961468-e27a-4b80-937c-2781d93932a7 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:55.524658 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524b802-b470-40aa-a298-024de83129bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:55.525424 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524b802-b470-40aa-a298-024de83129bd None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:55.525720 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524b802-b470-40aa-a298-024de83129bd None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:55.526009 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524b802-b470-40aa-a298-024de83129bd None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:55.526842 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4524b802-b470-40aa-a298-024de83129bd None admin] RBAC: Adding query filter params (name=reader) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:07:55.527164 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4524b802-b470-40aa-a298-024de83129bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:55.530485 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4524b802-b470-40aa-a298-024de83129bd None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:55.551468 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 52/103] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Jun 21 20:07:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:07:55.561829 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524b802-b470-40aa-a298-024de83129bd None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:55.565265 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:55.575855 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132135f2-3af6-480e-b115-369cb0b6404e None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:55.645590 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5c516b-ed8c-4a06-9ada-1f81b8ce416c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:55.646421 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c516b-ed8c-4a06-9ada-1f81b8ce416c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:55.646710 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c516b-ed8c-4a06-9ada-1f81b8ce416c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:55.646994 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c516b-ed8c-4a06-9ada-1f81b8ce416c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:55.648742 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5c516b-ed8c-4a06-9ada-1f81b8ce416c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:55.650247 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5c516b-ed8c-4a06-9ada-1f81b8ce416c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:55.651998 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 52/104] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:07:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:07:55.657694 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5c516b-ed8c-4a06-9ada-1f81b8ce416c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:55.743694 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524b802-b470-40aa-a298-024de83129bd None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:55.783656 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:55.816684 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9f750-4c40-4fbf-a4e0-f888a95fc3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:55.817940 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9f750-4c40-4fbf-a4e0-f888a95fc3c4 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:55.818615 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9f750-4c40-4fbf-a4e0-f888a95fc3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:55.820348 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9f750-4c40-4fbf-a4e0-f888a95fc3c4 None admin] PATH_INFO: `/v3/users/b3a76158099944689e2b4293957c55a0` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:55.857200 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f9f750-4c40-4fbf-a4e0-f888a95fc3c4 None admin] RBAC: Authorizing `identity:get_user(user_id=b3a76158099944689e2b4293957c55a0)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:55.861865 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f9f750-4c40-4fbf-a4e0-f888a95fc3c4 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:55.861865 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 53/105] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jun 21 20:07:55 2022] GET /identity/v3/users/b3a76158099944689e2b4293957c55a0 => generated 289 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:07:55.866554 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5c516b-ed8c-4a06-9ada-1f81b8ce416c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:55.868970 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9f750-4c40-4fbf-a4e0-f888a95fc3c4 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:55.943156 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb6b23-147e-4169-adee-c5c9e85da1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:55.943766 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb6b23-147e-4169-adee-c5c9e85da1f1 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:55.944086 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb6b23-147e-4169-adee-c5c9e85da1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:55.944374 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb6b23-147e-4169-adee-c5c9e85da1f1 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:55.945638 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcb6b23-147e-4169-adee-c5c9e85da1f1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:55.947098 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcb6b23-147e-4169-adee-c5c9e85da1f1 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:56.006503 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 53/106] 10.222.0.15 () {60 vars in 1141 bytes} [Tue Jun 21 20:07:55 2022] POST /identity/v3/projects => generated 302 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:07:56.065824 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9f750-4c40-4fbf-a4e0-f888a95fc3c4 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:56.114743 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c1ba50-38e2-4549-81fb-e3c2120519a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:56.115413 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1ba50-38e2-4549-81fb-e3c2120519a0 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:56.115700 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1ba50-38e2-4549-81fb-e3c2120519a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:56.116005 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1ba50-38e2-4549-81fb-e3c2120519a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:56.186311 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:56.216112 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c1ba50-38e2-4549-81fb-e3c2120519a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:56.217522 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c1ba50-38e2-4549-81fb-e3c2120519a0 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:56.361572 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 54/107] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:07:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 20:07:56.368351 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb6b23-147e-4169-adee-c5c9e85da1f1 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:56.392154 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:56.425256 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffaae9-e4be-4413-9d46-a2cccc19b4b4 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:56.425557 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffaae9-e4be-4413-9d46-a2cccc19b4b4 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:56.425849 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffaae9-e4be-4413-9d46-a2cccc19b4b4 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:56.427230 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 55/108] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:07:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 20:07:56.450454 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4591f80-19db-44c2-aa3a-0b6bee2459c6 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:56.450750 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4591f80-19db-44c2-aa3a-0b6bee2459c6 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:56.451041 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4591f80-19db-44c2-aa3a-0b6bee2459c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:56.486179 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-e4591f80-19db-44c2-aa3a-0b6bee2459c6 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:07:56.487298 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-e4591f80-19db-44c2-aa3a-0b6bee2459c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:07:56.523096 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb6b23-147e-4169-adee-c5c9e85da1f1 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:56.566472 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e96e6a-db98-4a51-bd5f-14679adf8ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:56.568697 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e96e6a-db98-4a51-bd5f-14679adf8ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:56.570923 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e96e6a-db98-4a51-bd5f-14679adf8ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:56.571425 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e96e6a-db98-4a51-bd5f-14679adf8ea7 None admin] PATH_INFO: `/v3/projects/54e781b3ce904441a3692659b01df849` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:56.574356 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e96e6a-db98-4a51-bd5f-14679adf8ea7 None admin] RBAC: Authorizing `identity:get_project(project_id=54e781b3ce904441a3692659b01df849)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:56.576871 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e96e6a-db98-4a51-bd5f-14679adf8ea7 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:56.578821 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 54/109] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jun 21 20:07:56 2022] GET /identity/v3/projects/54e781b3ce904441a3692659b01df849 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:07:56.584606 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e96e6a-db98-4a51-bd5f-14679adf8ea7 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:56.607778 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 56/110] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:07:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 20:07:56.696288 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:56.717601 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e96e6a-db98-4a51-bd5f-14679adf8ea7 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:56.728958 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4591f80-19db-44c2-aa3a-0b6bee2459c6 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:56.745792 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:56.823406 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a618dc-ce6d-4288-87ad-4964927d556a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:56.824132 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a618dc-ce6d-4288-87ad-4964927d556a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:56.824428 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a618dc-ce6d-4288-87ad-4964927d556a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:56.824717 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a618dc-ce6d-4288-87ad-4964927d556a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:56.825581 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a618dc-ce6d-4288-87ad-4964927d556a None admin] RBAC: Adding query filter params (role.id=38547a2f0ca04335b9d13bf66f4f412f, scope.project.id=54e781b3ce904441a3692659b01df849, user.id=b3a76158099944689e2b4293957c55a0) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:07:56.825904 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a618dc-ce6d-4288-87ad-4964927d556a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:56.827359 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a618dc-ce6d-4288-87ad-4964927d556a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:56.840210 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 55/111] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jun 21 20:07:56 2022] GET /identity/v3/role_assignments?user.id=b3a76158099944689e2b4293957c55a0&scope.project.id=54e781b3ce904441a3692659b01df849&role.id=38547a2f0ca04335b9d13bf66f4f412f => generated 259 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:07:56.889752 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a428b-893d-4638-aa84-40811edcc660 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:56.890102 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a428b-893d-4638-aa84-40811edcc660 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:56.890413 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a428b-893d-4638-aa84-40811edcc660 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:56.892045 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 56/112] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:07:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:07:56.902034 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ba8b1-6704-478b-9826-20e1bdd271e1 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:56.902339 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ba8b1-6704-478b-9826-20e1bdd271e1 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:56.902621 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ba8b1-6704-478b-9826-20e1bdd271e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:56.929659 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ca6ba8b1-6704-478b-9826-20e1bdd271e1 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:07:56.930903 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ca6ba8b1-6704-478b-9826-20e1bdd271e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:07:56.936489 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4591f80-19db-44c2-aa3a-0b6bee2459c6 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:56.977757 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c53898b-96ab-4314-b9f0-8c00b4a8711c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:56.978603 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53898b-96ab-4314-b9f0-8c00b4a8711c None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:56.978904 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53898b-96ab-4314-b9f0-8c00b4a8711c None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:56.979192 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53898b-96ab-4314-b9f0-8c00b4a8711c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:57.004023 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c53898b-96ab-4314-b9f0-8c00b4a8711c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:07:57.011961 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-2c53898b-96ab-4314-b9f0-8c00b4a8711c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 20:07:57.011961 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:07:57.011961 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:07:57.011961 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:07:57.011961 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:07:57.011961 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:07:57.011961 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:07:57.011961 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:07:57.011961 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:07:57.011961 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:07:57.011961 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:07:57.011961 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:07:57.011961 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:07:57.011961 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:07:57.011961 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:07:57.011961 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:07:57.012881 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:07:57.012881 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:07:57.012881 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:07:57.012881 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:07:57.012881 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:07:57.012881 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:07:57.012881 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:07:57.012881 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:07:57.012881 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:07:57.012881 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:07:57.012881 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:07:57.012881 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:07:57.012881 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:07:57.012881 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:07:57.012881 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:07:57.012881 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:07:57.013624 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:07:57.013624 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:07:57.013624 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:07:57.013624 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:07:57.013624 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:07:57.013624 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:07:57.013624 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:07:57.013624 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:07:57.013624 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:07:57.013624 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:07:57.013624 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 20:07:57.013624 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:07:57.025794 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 57/113] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:07:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:07:57.027224 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff09dc-c6bd-4722-a73d-40837ed37ef8 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:57.027518 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff09dc-c6bd-4722-a73d-40837ed37ef8 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:57.027911 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff09dc-c6bd-4722-a73d-40837ed37ef8 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:57.029459 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 58/114] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:07:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:07:57.033259 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff09dc-c6bd-4722-a73d-40837ed37ef8 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:57.073665 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 57/115] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:07:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:07:57.075134 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09266c6-9be5-4a34-940d-613f2e418c63 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:57.075440 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09266c6-9be5-4a34-940d-613f2e418c63 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:57.075729 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09266c6-9be5-4a34-940d-613f2e418c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:57.093933 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f09266c6-9be5-4a34-940d-613f2e418c63 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:07:57.095254 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f09266c6-9be5-4a34-940d-613f2e418c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:07:57.121252 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:57.169096 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff09dc-c6bd-4722-a73d-40837ed37ef8 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:57.206050 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 58/116] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:07:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:07:57.207412 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09266c6-9be5-4a34-940d-613f2e418c63 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:57.211828 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:57.215469 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee5356-550f-4092-8faf-59e67c0007df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:57.220078 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee5356-550f-4092-8faf-59e67c0007df None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:57.220078 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee5356-550f-4092-8faf-59e67c0007df None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:57.220078 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee5356-550f-4092-8faf-59e67c0007df None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:57.220078 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ee5356-550f-4092-8faf-59e67c0007df None admin] RBAC: Adding query filter params (name=member) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:07:57.220078 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ee5356-550f-4092-8faf-59e67c0007df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:57.220078 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ee5356-550f-4092-8faf-59e67c0007df None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:57.231953 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 59/117] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Jun 21 20:07:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:07:57.238219 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee5356-550f-4092-8faf-59e67c0007df None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:57.346480 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09266c6-9be5-4a34-940d-613f2e418c63 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:57.349371 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee5356-550f-4092-8faf-59e67c0007df None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:57.381241 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:57.384772 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a7dedb-91a8-492f-9793-2ea255b09858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:57.386644 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7dedb-91a8-492f-9793-2ea255b09858 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:57.387027 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7dedb-91a8-492f-9793-2ea255b09858 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:57.387411 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7dedb-91a8-492f-9793-2ea255b09858 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:57.388449 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c484bf2-2389-4f0e-a71d-c9d8f288810a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:57.389588 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c484bf2-2389-4f0e-a71d-c9d8f288810a None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:57.390024 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c484bf2-2389-4f0e-a71d-c9d8f288810a None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:57.390577 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c484bf2-2389-4f0e-a71d-c9d8f288810a None admin] PATH_INFO: `/v3/users/4cd92ad55d0048e4947a9eb9038bc935` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:57.392046 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c484bf2-2389-4f0e-a71d-c9d8f288810a None admin] RBAC: Authorizing `identity:get_user(user_id=4cd92ad55d0048e4947a9eb9038bc935)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:57.393797 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c484bf2-2389-4f0e-a71d-c9d8f288810a None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:57.400825 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a7dedb-91a8-492f-9793-2ea255b09858 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:07:57.401086 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 60/118] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jun 21 20:07:57 2022] GET /identity/v3/users/4cd92ad55d0048e4947a9eb9038bc935 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:07:57.402093 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c484bf2-2389-4f0e-a71d-c9d8f288810a None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:57.408354 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-03a7dedb-91a8-492f-9793-2ea255b09858 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 20:07:57.408354 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:07:57.408354 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:07:57.408354 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:07:57.408354 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:07:57.408354 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:07:57.408354 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:07:57.408354 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:07:57.408354 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:07:57.408354 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:07:57.408354 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:07:57.408354 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:07:57.408354 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:07:57.408354 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:07:57.408354 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:07:57.408354 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:07:57.409263 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:07:57.409263 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:07:57.409263 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:07:57.409263 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:07:57.409263 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:07:57.409263 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:07:57.409263 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:07:57.409263 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:07:57.409263 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:07:57.409263 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:07:57.409263 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:07:57.409263 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:07:57.409263 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:07:57.409263 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:07:57.409263 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:07:57.409263 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:07:57.410036 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:07:57.410036 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:07:57.410036 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:07:57.410036 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:07:57.410036 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:07:57.410036 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:07:57.410036 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:07:57.410036 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:07:57.410036 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:07:57.410036 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:07:57.410036 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 20:07:57.410036 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:07:57.410613 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 59/119] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Jun 21 20:07:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:07:57.416492 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d599ca-8da0-4e9c-aa6d-01bd1e22651c None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:57.416849 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d599ca-8da0-4e9c-aa6d-01bd1e22651c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:57.417200 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d599ca-8da0-4e9c-aa6d-01bd1e22651c None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:57.418707 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 60/120] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:07:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:07:57.419626 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d599ca-8da0-4e9c-aa6d-01bd1e22651c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:57.487895 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:57.517376 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c484bf2-2389-4f0e-a71d-c9d8f288810a None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:57.532049 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d599ca-8da0-4e9c-aa6d-01bd1e22651c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:57.564367 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d88da-c9ac-4048-8282-4d6c38c07253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:57.566203 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d88da-c9ac-4048-8282-4d6c38c07253 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:57.566915 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d88da-c9ac-4048-8282-4d6c38c07253 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:57.567373 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d88da-c9ac-4048-8282-4d6c38c07253 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:57.571426 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9abbc7c-b89d-4cf9-b5d2-4d7b7d07f151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:57.572414 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9abbc7c-b89d-4cf9-b5d2-4d7b7d07f151 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:57.572769 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9abbc7c-b89d-4cf9-b5d2-4d7b7d07f151 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:57.573137 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9abbc7c-b89d-4cf9-b5d2-4d7b7d07f151 None admin] PATH_INFO: `/v3/projects/54e781b3ce904441a3692659b01df849` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:57.574397 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9abbc7c-b89d-4cf9-b5d2-4d7b7d07f151 None admin] RBAC: Authorizing `identity:get_project(project_id=54e781b3ce904441a3692659b01df849)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:57.576160 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9abbc7c-b89d-4cf9-b5d2-4d7b7d07f151 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:57.578136 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 61/121] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jun 21 20:07:57 2022] GET /identity/v3/projects/54e781b3ce904441a3692659b01df849 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:07:57.578969 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9abbc7c-b89d-4cf9-b5d2-4d7b7d07f151 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:57.580860 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6d88da-c9ac-4048-8282-4d6c38c07253 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:07:57.591080 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-fb6d88da-c9ac-4048-8282-4d6c38c07253 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 20:07:57.591080 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:07:57.591080 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:07:57.591080 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:07:57.591080 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:07:57.591080 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:07:57.591080 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:07:57.591080 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:07:57.591080 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:07:57.591080 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:07:57.591080 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:07:57.591080 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:07:57.591080 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:07:57.591080 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:07:57.591080 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:07:57.591080 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:07:57.592025 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:07:57.592025 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:07:57.592025 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:07:57.592025 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:07:57.592025 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:07:57.592025 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:07:57.592025 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:07:57.592025 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:07:57.592025 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:07:57.592025 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:07:57.592025 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:07:57.592025 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:07:57.592025 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:07:57.592025 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:07:57.592025 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:07:57.592025 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:07:57.592802 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:07:57.592802 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:07:57.592802 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:07:57.592802 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:07:57.592802 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:07:57.592802 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:07:57.592802 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:07:57.592802 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:07:57.592802 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:07:57.592802 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:07:57.592802 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 20:07:57.592802 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:07:57.595979 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 61/122] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jun 21 20:07:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:07:57.597880 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5cb39-6e27-4dc3-ba86-39111166229c None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:57.598916 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5cb39-6e27-4dc3-ba86-39111166229c None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:57.599353 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5cb39-6e27-4dc3-ba86-39111166229c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:57.623429 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-1ae5cb39-6e27-4dc3-ba86-39111166229c None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:07:57.624879 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-1ae5cb39-6e27-4dc3-ba86-39111166229c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:07:57.697083 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9abbc7c-b89d-4cf9-b5d2-4d7b7d07f151 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:57.706581 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:57.723079 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 62/123] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:07:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:07:57.724635 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae5cb39-6e27-4dc3-ba86-39111166229c None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:57.730140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:57.737859 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c2f19-f71d-4732-bc0f-1f57e009fa6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:57.738656 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c2f19-f71d-4732-bc0f-1f57e009fa6d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:57.739058 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c2f19-f71d-4732-bc0f-1f57e009fa6d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:57.739639 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c2f19-f71d-4732-bc0f-1f57e009fa6d None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:57.740417 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686c2f19-f71d-4732-bc0f-1f57e009fa6d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:07:57.740864 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686c2f19-f71d-4732-bc0f-1f57e009fa6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:57.743003 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686c2f19-f71d-4732-bc0f-1f57e009fa6d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:57.752850 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 62/124] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jun 21 20:07:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:07:57.753640 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c2f19-f71d-4732-bc0f-1f57e009fa6d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:57.862192 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae5cb39-6e27-4dc3-ba86-39111166229c None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:57.873083 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c2f19-f71d-4732-bc0f-1f57e009fa6d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:57.910621 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c752f4d5-9913-4c2e-b24e-2d053b6a6cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:57.911881 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752f4d5-9913-4c2e-b24e-2d053b6a6cd5 None admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:57.912405 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752f4d5-9913-4c2e-b24e-2d053b6a6cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:57.912908 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752f4d5-9913-4c2e-b24e-2d053b6a6cd5 None admin] PATH_INFO: `/v3/projects/54e781b3ce904441a3692659b01df849/users/4cd92ad55d0048e4947a9eb9038bc935/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:57.915177 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c752f4d5-9913-4c2e-b24e-2d053b6a6cd5 None admin] RBAC: Authorizing `identity:create_grant(project_id=54e781b3ce904441a3692659b01df849, user_id=4cd92ad55d0048e4947a9eb9038bc935, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:57.916849 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c752f4d5-9913-4c2e-b24e-2d053b6a6cd5 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:57.916957 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd64f8-dec3-4149-9c9d-4f1ec7aab375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:57.917687 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd64f8-dec3-4149-9c9d-4f1ec7aab375 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:57.918050 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd64f8-dec3-4149-9c9d-4f1ec7aab375 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:57.918409 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd64f8-dec3-4149-9c9d-4f1ec7aab375 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:57.919244 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fd64f8-dec3-4149-9c9d-4f1ec7aab375 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:07:57.919627 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fd64f8-dec3-4149-9c9d-4f1ec7aab375 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:57.921438 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fd64f8-dec3-4149-9c9d-4f1ec7aab375 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:57.934825 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 63/125] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:07:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:07:57.935865 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd64f8-dec3-4149-9c9d-4f1ec7aab375 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:57.936364 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 63/126] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Jun 21 20:07:57 2022] PUT /identity/v3/projects/54e781b3ce904441a3692659b01df849/users/4cd92ad55d0048e4947a9eb9038bc935/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:07:57.937532 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c752f4d5-9913-4c2e-b24e-2d053b6a6cd5 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:57.996745 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:58.003326 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:58.057779 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd64f8-dec3-4149-9c9d-4f1ec7aab375 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:58.059716 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c752f4d5-9913-4c2e-b24e-2d053b6a6cd5 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:58.095237 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c8b816-d02c-4c79-8864-7c6b5426d68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:58.096103 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8b816-d02c-4c79-8864-7c6b5426d68a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:58.096412 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8b816-d02c-4c79-8864-7c6b5426d68a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:58.096676 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8b816-d02c-4c79-8864-7c6b5426d68a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:58.098979 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e65b3-3290-4356-a377-26365ee26fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:58.100253 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e65b3-3290-4356-a377-26365ee26fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:58.101279 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e65b3-3290-4356-a377-26365ee26fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:58.101761 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e65b3-3290-4356-a377-26365ee26fb7 None admin] PATH_INFO: `/v3/users/4cd92ad55d0048e4947a9eb9038bc935` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:58.103200 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8e65b3-3290-4356-a377-26365ee26fb7 None admin] RBAC: Authorizing `identity:get_user(user_id=4cd92ad55d0048e4947a9eb9038bc935)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:58.104991 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8e65b3-3290-4356-a377-26365ee26fb7 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:58.107104 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 64/127] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jun 21 20:07:57 2022] GET /identity/v3/users/4cd92ad55d0048e4947a9eb9038bc935 => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:07:58.108265 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e65b3-3290-4356-a377-26365ee26fb7 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:58.108893 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c8b816-d02c-4c79-8864-7c6b5426d68a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:07:58.119664 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-d9c8b816-d02c-4c79-8864-7c6b5426d68a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 20:07:58.119664 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:07:58.119664 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:07:58.119664 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:07:58.119664 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:07:58.119664 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:07:58.119664 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:07:58.119664 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:07:58.119664 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:07:58.119664 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:07:58.119664 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:07:58.119664 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:07:58.119664 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:07:58.119664 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:07:58.119664 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:07:58.119664 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:07:58.120582 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:07:58.120582 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:07:58.120582 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:07:58.120582 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:07:58.120582 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:07:58.120582 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:07:58.120582 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:07:58.120582 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:07:58.120582 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:07:58.120582 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:07:58.120582 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:07:58.120582 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:07:58.120582 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:07:58.120582 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:07:58.120582 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:07:58.120582 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:07:58.121348 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:07:58.121348 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:07:58.121348 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:07:58.121348 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:07:58.121348 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:07:58.121348 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:07:58.121348 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:07:58.121348 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:07:58.121348 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:07:58.121348 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:07:58.121348 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 20:07:58.121348 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:07:58.121348 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 64/128] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:07:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:07:58.121980 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c8b816-d02c-4c79-8864-7c6b5426d68a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:58.245785 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e65b3-3290-4356-a377-26365ee26fb7 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:58.276444 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c8b816-d02c-4c79-8864-7c6b5426d68a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:58.280316 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:58.295221 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:58.320098 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cea2e5-4b7f-4252-a40e-62ea6c5a5aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:58.322385 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cea2e5-4b7f-4252-a40e-62ea6c5a5aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:58.323882 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cea2e5-4b7f-4252-a40e-62ea6c5a5aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:58.324512 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cea2e5-4b7f-4252-a40e-62ea6c5a5aa4 None admin] PATH_INFO: `/v3/users/6983efac1f89435f94ebc2dacd0b3544` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:58.326676 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cea2e5-4b7f-4252-a40e-62ea6c5a5aa4 None admin] RBAC: Authorizing `identity:get_user(user_id=6983efac1f89435f94ebc2dacd0b3544)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:58.328907 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cea2e5-4b7f-4252-a40e-62ea6c5a5aa4 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:58.330914 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 65/129] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jun 21 20:07:58 2022] GET /identity/v3/users/6983efac1f89435f94ebc2dacd0b3544 => generated 247 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:07:58.333253 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cea2e5-4b7f-4252-a40e-62ea6c5a5aa4 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:58.338711 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0023d-f3ab-4932-9a9f-06c23e6a92b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:58.339841 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0023d-f3ab-4932-9a9f-06c23e6a92b2 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:58.340344 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0023d-f3ab-4932-9a9f-06c23e6a92b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:58.340814 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0023d-f3ab-4932-9a9f-06c23e6a92b2 None admin] PATH_INFO: `/v3/projects/54e781b3ce904441a3692659b01df849` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:58.342235 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b0023d-f3ab-4932-9a9f-06c23e6a92b2 None admin] RBAC: Authorizing `identity:get_project(project_id=54e781b3ce904441a3692659b01df849)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:58.345054 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b0023d-f3ab-4932-9a9f-06c23e6a92b2 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:58.353707 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 65/130] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jun 21 20:07:58 2022] GET /identity/v3/projects/54e781b3ce904441a3692659b01df849 => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:07:58.354770 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0023d-f3ab-4932-9a9f-06c23e6a92b2 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:58.537428 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cea2e5-4b7f-4252-a40e-62ea6c5a5aa4 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:58.544350 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0023d-f3ab-4932-9a9f-06c23e6a92b2 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:58.596566 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eac8cc-08fd-49ef-a050-ba9c8e824d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:58.597441 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eac8cc-08fd-49ef-a050-ba9c8e824d72 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:58.597734 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eac8cc-08fd-49ef-a050-ba9c8e824d72 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:58.598034 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eac8cc-08fd-49ef-a050-ba9c8e824d72 None admin] PATH_INFO: `/v3/projects/54e781b3ce904441a3692659b01df849` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:58.599531 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eac8cc-08fd-49ef-a050-ba9c8e824d72 None admin] RBAC: Authorizing `identity:get_project(project_id=54e781b3ce904441a3692659b01df849)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:58.601558 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eac8cc-08fd-49ef-a050-ba9c8e824d72 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:58.603287 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 66/131] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jun 21 20:07:58 2022] GET /identity/v3/projects/54e781b3ce904441a3692659b01df849 => generated 298 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:07:58.611342 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b86be-3e0f-47a1-94a9-dc1a0b91bed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:58.612057 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b86be-3e0f-47a1-94a9-dc1a0b91bed2 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:58.612351 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b86be-3e0f-47a1-94a9-dc1a0b91bed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:58.612642 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b86be-3e0f-47a1-94a9-dc1a0b91bed2 None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:58.613416 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6b86be-3e0f-47a1-94a9-dc1a0b91bed2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:07:58.613732 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6b86be-3e0f-47a1-94a9-dc1a0b91bed2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:58.615141 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6b86be-3e0f-47a1-94a9-dc1a0b91bed2 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:58.617317 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eac8cc-08fd-49ef-a050-ba9c8e824d72 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:58.635677 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 66/132] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Jun 21 20:07:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:07:58.636726 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b86be-3e0f-47a1-94a9-dc1a0b91bed2 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:58.720150 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:58.728176 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:58.799703 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b86be-3e0f-47a1-94a9-dc1a0b91bed2 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:58.820612 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eac8cc-08fd-49ef-a050-ba9c8e824d72 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:58.865332 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b0c9f7-8887-4436-a162-355235a373f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:58.866237 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0c9f7-8887-4436-a162-355235a373f5 None admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:58.866570 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0c9f7-8887-4436-a162-355235a373f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:58.866853 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0c9f7-8887-4436-a162-355235a373f5 None admin] PATH_INFO: `/v3/projects/54e781b3ce904441a3692659b01df849/users/6983efac1f89435f94ebc2dacd0b3544/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:58.869584 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b0c9f7-8887-4436-a162-355235a373f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=54e781b3ce904441a3692659b01df849, user_id=6983efac1f89435f94ebc2dacd0b3544, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:58.871044 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b0c9f7-8887-4436-a162-355235a373f5 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:58.885045 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf3ac51-d4e7-41d9-9f87-80a5eec5cf65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:58.886004 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3ac51-d4e7-41d9-9f87-80a5eec5cf65 None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:58.886283 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3ac51-d4e7-41d9-9f87-80a5eec5cf65 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:58.886767 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3ac51-d4e7-41d9-9f87-80a5eec5cf65 None admin] PATH_INFO: `/v3/projects/54e781b3ce904441a3692659b01df849/users/4cd92ad55d0048e4947a9eb9038bc935/roles/141a45d0143342f2ac0eafc233c9b6c3` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:58.895382 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 67/133] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Jun 21 20:07:58 2022] PUT /identity/v3/projects/54e781b3ce904441a3692659b01df849/users/6983efac1f89435f94ebc2dacd0b3544/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:07:58.896139 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b0c9f7-8887-4436-a162-355235a373f5 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:58.898372 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf3ac51-d4e7-41d9-9f87-80a5eec5cf65 None admin] RBAC: Authorizing `identity:create_grant(project_id=54e781b3ce904441a3692659b01df849, user_id=4cd92ad55d0048e4947a9eb9038bc935, role_id=141a45d0143342f2ac0eafc233c9b6c3)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:58.899881 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf3ac51-d4e7-41d9-9f87-80a5eec5cf65 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:58.947191 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 67/134] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Jun 21 20:07:58 2022] PUT /identity/v3/projects/54e781b3ce904441a3692659b01df849/users/4cd92ad55d0048e4947a9eb9038bc935/roles/141a45d0143342f2ac0eafc233c9b6c3 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:07:58.992673 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b4531-414b-456a-97cd-b3d01b338177 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:58.993011 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b4531-414b-456a-97cd-b3d01b338177 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:58.993255 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b4531-414b-456a-97cd-b3d01b338177 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:58.994665 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 68/135] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:07:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 20:07:59.001441 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b51ff-d8dd-4678-b0bb-86061d8e8b85 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:59.001745 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b51ff-d8dd-4678-b0bb-86061d8e8b85 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:59.002022 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b51ff-d8dd-4678-b0bb-86061d8e8b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:59.017573 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b0c9f7-8887-4436-a162-355235a373f5 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:59.039204 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:59.044044 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ea7b51ff-d8dd-4678-b0bb-86061d8e8b85 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:07:59.045310 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ea7b51ff-d8dd-4678-b0bb-86061d8e8b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:07:59.055533 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0d44c-2728-48bd-96e5-66a2dd4e8d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:59.056380 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0d44c-2728-48bd-96e5-66a2dd4e8d02 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:59.056678 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0d44c-2728-48bd-96e5-66a2dd4e8d02 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:59.056967 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0d44c-2728-48bd-96e5-66a2dd4e8d02 None admin] PATH_INFO: `/v3/users/4cd92ad55d0048e4947a9eb9038bc935` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:59.058658 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf0d44c-2728-48bd-96e5-66a2dd4e8d02 None admin] RBAC: Authorizing `identity:get_user(user_id=4cd92ad55d0048e4947a9eb9038bc935)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:59.059760 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf0d44c-2728-48bd-96e5-66a2dd4e8d02 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:59.061561 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 68/136] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jun 21 20:07:58 2022] GET /identity/v3/users/4cd92ad55d0048e4947a9eb9038bc935 => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:07:59.067403 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0d44c-2728-48bd-96e5-66a2dd4e8d02 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:59.190820 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0d44c-2728-48bd-96e5-66a2dd4e8d02 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:59.218259 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 69/137] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:07:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:07:59.236917 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0475a5f3-cbfa-409c-9244-b3c8c63c0864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:59.237852 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475a5f3-cbfa-409c-9244-b3c8c63c0864 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:59.238197 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475a5f3-cbfa-409c-9244-b3c8c63c0864 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:59.238486 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475a5f3-cbfa-409c-9244-b3c8c63c0864 None admin] PATH_INFO: `/v3/projects/3b34221c960b484287511819863e6537` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:59.239710 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0475a5f3-cbfa-409c-9244-b3c8c63c0864 None admin] RBAC: Authorizing `identity:get_project(project_id=3b34221c960b484287511819863e6537)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:59.241822 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0475a5f3-cbfa-409c-9244-b3c8c63c0864 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:59.243832 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 69/138] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jun 21 20:07:59 2022] GET /identity/v3/projects/3b34221c960b484287511819863e6537 => generated 312 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:07:59.248093 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7b51ff-d8dd-4678-b0bb-86061d8e8b85 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:59.249492 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0475a5f3-cbfa-409c-9244-b3c8c63c0864 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:59.301898 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:59.302913 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:59.368693 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0475a5f3-cbfa-409c-9244-b3c8c63c0864 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:59.400161 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7b51ff-d8dd-4678-b0bb-86061d8e8b85 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:59.414451 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eebb547-18c1-4af2-be0e-6c0737e4103e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:59.415698 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eebb547-18c1-4af2-be0e-6c0737e4103e None admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:59.416240 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eebb547-18c1-4af2-be0e-6c0737e4103e None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:59.416758 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eebb547-18c1-4af2-be0e-6c0737e4103e None admin] PATH_INFO: `/v3/projects/3b34221c960b484287511819863e6537/users/4cd92ad55d0048e4947a9eb9038bc935/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:59.420756 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eebb547-18c1-4af2-be0e-6c0737e4103e None admin] RBAC: Authorizing `identity:create_grant(project_id=3b34221c960b484287511819863e6537, user_id=4cd92ad55d0048e4947a9eb9038bc935, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:59.422437 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eebb547-18c1-4af2-be0e-6c0737e4103e None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:59.456109 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 70/139] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Jun 21 20:07:59 2022] PUT /identity/v3/projects/3b34221c960b484287511819863e6537/users/4cd92ad55d0048e4947a9eb9038bc935/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:07:59.457938 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ca882-1944-41f0-a11f-0fac4bf93700 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:59.458518 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ca882-1944-41f0-a11f-0fac4bf93700 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:59.459077 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ca882-1944-41f0-a11f-0fac4bf93700 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:59.462049 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 71/140] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:07:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:07:59.474798 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5cd33-d873-4703-bfc7-5ec5bd7f9598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:59.477857 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc759739-12c4-4280-8de9-60cfb65c12e4 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:59.478426 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc759739-12c4-4280-8de9-60cfb65c12e4 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:59.478910 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc759739-12c4-4280-8de9-60cfb65c12e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:59.486954 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5cd33-d873-4703-bfc7-5ec5bd7f9598 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:59.490912 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5cd33-d873-4703-bfc7-5ec5bd7f9598 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:59.492118 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5cd33-d873-4703-bfc7-5ec5bd7f9598 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:59.493779 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a5cd33-d873-4703-bfc7-5ec5bd7f9598 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:59.497521 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a5cd33-d873-4703-bfc7-5ec5bd7f9598 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:59.502501 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 70/141] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:07:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:07:59.506848 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-bc759739-12c4-4280-8de9-60cfb65c12e4 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:07:59.508425 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-bc759739-12c4-4280-8de9-60cfb65c12e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:07:59.514505 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5cd33-d873-4703-bfc7-5ec5bd7f9598 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:59.705458 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 72/142] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:07:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 20:07:59.719007 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5cd33-d873-4703-bfc7-5ec5bd7f9598 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:07:59.735106 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:07:59.780309 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc759739-12c4-4280-8de9-60cfb65c12e4 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:07:59.785855 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ad8ba-e000-4377-9085-1c7883ca080a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:07:59.787554 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ad8ba-e000-4377-9085-1c7883ca080a None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:07:59.789016 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ad8ba-e000-4377-9085-1c7883ca080a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:07:59.790638 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ad8ba-e000-4377-9085-1c7883ca080a None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:07:59.791712 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3ad8ba-e000-4377-9085-1c7883ca080a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:07:59.794664 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3ad8ba-e000-4377-9085-1c7883ca080a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:07:59.836446 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 71/143] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Jun 21 20:07:59 2022] POST /identity/v3/users => generated 283 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:07:59.899100 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:00.058134 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc759739-12c4-4280-8de9-60cfb65c12e4 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:00.096562 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bb395b-d51d-4506-afce-52902281f7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:00.097759 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb395b-d51d-4506-afce-52902281f7b3 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:00.098329 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb395b-d51d-4506-afce-52902281f7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:00.098819 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb395b-d51d-4506-afce-52902281f7b3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:00.111943 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bb395b-d51d-4506-afce-52902281f7b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:08:00.121157 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-25bb395b-d51d-4506-afce-52902281f7b3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 20:08:00.121157 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:00.121157 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:00.121157 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:00.121157 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:00.121157 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:00.121157 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:00.121157 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:00.121157 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:00.121157 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:00.121157 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:00.121157 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:00.121157 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:08:00.121157 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:08:00.121157 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:08:00.121157 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:08:00.122091 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:08:00.122091 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:08:00.122091 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:08:00.122091 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:08:00.122091 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:00.122091 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:00.122091 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:00.122091 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:00.122091 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:00.122091 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:00.122091 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:00.122091 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:00.122091 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:00.122091 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:00.122091 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:00.122091 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:00.122891 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:00.122891 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:00.122891 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:00.122891 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:00.122891 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:08:00.122891 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:08:00.122891 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:08:00.122891 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:08:00.122891 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:08:00.122891 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:08:00.122891 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 20:08:00.122891 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:08:00.125340 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 73/144] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:07:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:00.131708 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ad8ba-e000-4377-9085-1c7883ca080a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:00.242663 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ad8ba-e000-4377-9085-1c7883ca080a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:00.280648 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a0d71-09ab-456c-9800-5c01390b84de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:00.281685 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a0d71-09ab-456c-9800-5c01390b84de None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:00.282202 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a0d71-09ab-456c-9800-5c01390b84de None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:00.282682 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a0d71-09ab-456c-9800-5c01390b84de None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:00.283720 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a0d71-09ab-456c-9800-5c01390b84de None admin] RBAC: Adding query filter params (name=reader) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:00.284257 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a0d71-09ab-456c-9800-5c01390b84de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:00.285850 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a0d71-09ab-456c-9800-5c01390b84de None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:00.295088 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 72/145] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Jun 21 20:08:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:00.300923 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bb395b-d51d-4506-afce-52902281f7b3 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:00.404817 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:00.413975 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bb395b-d51d-4506-afce-52902281f7b3 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:00.452564 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53e680-89c9-4822-a15d-11416eddfc6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:00.453819 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53e680-89c9-4822-a15d-11416eddfc6a None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:00.454311 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53e680-89c9-4822-a15d-11416eddfc6a None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:00.454808 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53e680-89c9-4822-a15d-11416eddfc6a None admin] PATH_INFO: `/v3/users/b3a76158099944689e2b4293957c55a0` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:00.456282 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c53e680-89c9-4822-a15d-11416eddfc6a None admin] RBAC: Authorizing `identity:get_user(user_id=b3a76158099944689e2b4293957c55a0)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:00.457954 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c53e680-89c9-4822-a15d-11416eddfc6a None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:00.459816 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 74/146] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jun 21 20:08:00 2022] GET /identity/v3/users/b3a76158099944689e2b4293957c55a0 => generated 289 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:00.466283 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a0d71-09ab-456c-9800-5c01390b84de None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:00.497367 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:00.578353 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a0d71-09ab-456c-9800-5c01390b84de None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:00.615221 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ef6db-28d0-49e4-ac5f-2a820d605c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:00.616687 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ef6db-28d0-49e4-ac5f-2a820d605c66 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:00.617273 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ef6db-28d0-49e4-ac5f-2a820d605c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:00.617870 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ef6db-28d0-49e4-ac5f-2a820d605c66 None admin] PATH_INFO: `/v3/projects/54e781b3ce904441a3692659b01df849` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:00.619383 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ef6db-28d0-49e4-ac5f-2a820d605c66 None admin] RBAC: Authorizing `identity:get_project(project_id=54e781b3ce904441a3692659b01df849)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:00.621161 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ef6db-28d0-49e4-ac5f-2a820d605c66 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:00.623258 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 73/147] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jun 21 20:08:00 2022] GET /identity/v3/projects/54e781b3ce904441a3692659b01df849 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:00.629827 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53e680-89c9-4822-a15d-11416eddfc6a None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:00.742876 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53e680-89c9-4822-a15d-11416eddfc6a None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:00.780519 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfafadd-84f3-4b01-a23d-0088a0e5a433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:00.781804 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfafadd-84f3-4b01-a23d-0088a0e5a433 None admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:00.782293 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfafadd-84f3-4b01-a23d-0088a0e5a433 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:00.782770 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfafadd-84f3-4b01-a23d-0088a0e5a433 None admin] PATH_INFO: `/v3/projects/54e781b3ce904441a3692659b01df849/users/b3a76158099944689e2b4293957c55a0/roles/38547a2f0ca04335b9d13bf66f4f412f` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:00.785078 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfafadd-84f3-4b01-a23d-0088a0e5a433 None admin] RBAC: Authorizing `identity:create_grant(project_id=54e781b3ce904441a3692659b01df849, user_id=b3a76158099944689e2b4293957c55a0, role_id=38547a2f0ca04335b9d13bf66f4f412f)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:00.786761 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfafadd-84f3-4b01-a23d-0088a0e5a433 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:00.802972 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 75/148] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Jun 21 20:08:00 2022] PUT /identity/v3/projects/54e781b3ce904441a3692659b01df849/users/b3a76158099944689e2b4293957c55a0/roles/38547a2f0ca04335b9d13bf66f4f412f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:08:00.848379 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7cb75-89d1-4f93-9487-b667e951ef2e None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:00.849014 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7cb75-89d1-4f93-9487-b667e951ef2e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:00.849515 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7cb75-89d1-4f93-9487-b667e951ef2e None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:00.852156 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 74/149] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:08:00.863473 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeda751-23df-4f1b-a293-a0da3a0bd780 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:00.864064 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeda751-23df-4f1b-a293-a0da3a0bd780 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:00.864576 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeda751-23df-4f1b-a293-a0da3a0bd780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:00.883989 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-cbeda751-23df-4f1b-a293-a0da3a0bd780 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:00.885492 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-cbeda751-23df-4f1b-a293-a0da3a0bd780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:00.905433 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:00.966821 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 76/150] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:08:01.005503 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c7cb75-89d1-4f93-9487-b667e951ef2e None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:01.136424 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c7cb75-89d1-4f93-9487-b667e951ef2e None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:01.138276 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:01.174537 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3299add-06b0-498f-9d0e-ca5b617f8685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:01.175357 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3299add-06b0-498f-9d0e-ca5b617f8685 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:01.175648 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3299add-06b0-498f-9d0e-ca5b617f8685 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:01.175946 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3299add-06b0-498f-9d0e-ca5b617f8685 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:01.186755 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3299add-06b0-498f-9d0e-ca5b617f8685 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:08:01.195146 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-c3299add-06b0-498f-9d0e-ca5b617f8685 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 20:08:01.195146 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:01.195146 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:01.195146 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:01.195146 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:01.195146 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:01.195146 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:01.195146 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:01.195146 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:01.195146 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:01.195146 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:01.195146 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:01.195146 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:08:01.195146 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:08:01.195146 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:08:01.195146 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:08:01.196028 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:08:01.196028 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:08:01.196028 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:08:01.196028 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:08:01.196028 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:01.196028 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:01.196028 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:01.196028 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:01.196028 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:01.196028 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:01.196028 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:01.196028 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:01.196028 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:01.196028 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:01.196028 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:01.196028 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:01.197253 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:01.197253 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:01.197253 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:01.197253 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:01.197253 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:08:01.197253 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:08:01.197253 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:08:01.197253 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:08:01.197253 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:08:01.197253 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:08:01.197253 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 20:08:01.197253 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:08:01.197253 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 75/151] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:08:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:01.202401 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeda751-23df-4f1b-a293-a0da3a0bd780 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:01.351542 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeda751-23df-4f1b-a293-a0da3a0bd780 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:01.389334 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1319ef7-c763-4a0e-be89-17c26f7c9790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:01.390007 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1319ef7-c763-4a0e-be89-17c26f7c9790 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:01.390291 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1319ef7-c763-4a0e-be89-17c26f7c9790 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:01.390569 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1319ef7-c763-4a0e-be89-17c26f7c9790 None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:01.391327 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1319ef7-c763-4a0e-be89-17c26f7c9790 None admin] RBAC: Adding query filter params (name=member) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:01.391631 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1319ef7-c763-4a0e-be89-17c26f7c9790 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:01.393047 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1319ef7-c763-4a0e-be89-17c26f7c9790 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:01.401950 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 77/152] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Jun 21 20:08:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:01.407392 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3299add-06b0-498f-9d0e-ca5b617f8685 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:01.520139 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3299add-06b0-498f-9d0e-ca5b617f8685 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:01.561766 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f62f0a3-cc6d-4a18-87ca-7ae67cdd194f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:01.562713 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62f0a3-cc6d-4a18-87ca-7ae67cdd194f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:01.562996 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62f0a3-cc6d-4a18-87ca-7ae67cdd194f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:01.563321 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62f0a3-cc6d-4a18-87ca-7ae67cdd194f None admin] PATH_INFO: `/v3/users/4cd92ad55d0048e4947a9eb9038bc935` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:01.564570 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f62f0a3-cc6d-4a18-87ca-7ae67cdd194f None admin] RBAC: Authorizing `identity:get_user(user_id=4cd92ad55d0048e4947a9eb9038bc935)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:01.566032 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f62f0a3-cc6d-4a18-87ca-7ae67cdd194f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:01.567978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 76/153] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jun 21 20:08:01 2022] GET /identity/v3/users/4cd92ad55d0048e4947a9eb9038bc935 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:01.573988 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1319ef7-c763-4a0e-be89-17c26f7c9790 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:01.591398 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:01.686844 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1319ef7-c763-4a0e-be89-17c26f7c9790 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:01.722100 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04803633-321b-4ecd-bd91-197ea2154d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:01.722814 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04803633-321b-4ecd-bd91-197ea2154d21 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:01.723103 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04803633-321b-4ecd-bd91-197ea2154d21 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:01.723380 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04803633-321b-4ecd-bd91-197ea2154d21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:01.806253 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04803633-321b-4ecd-bd91-197ea2154d21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:01.807722 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04803633-321b-4ecd-bd91-197ea2154d21 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:01.824278 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:01.912175 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 78/154] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:08:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 20:08:01.920406 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f62f0a3-cc6d-4a18-87ca-7ae67cdd194f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:01.947280 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:02.042555 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f62f0a3-cc6d-4a18-87ca-7ae67cdd194f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:02.091413 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0d8564-dabd-44dc-b9fa-300828221a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:02.092316 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d8564-dabd-44dc-b9fa-300828221a24 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:02.092600 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d8564-dabd-44dc-b9fa-300828221a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:02.092881 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d8564-dabd-44dc-b9fa-300828221a24 None admin] PATH_INFO: `/v3/projects/54e781b3ce904441a3692659b01df849` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:02.094093 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0d8564-dabd-44dc-b9fa-300828221a24 None admin] RBAC: Authorizing `identity:get_project(project_id=54e781b3ce904441a3692659b01df849)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:02.095598 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0d8564-dabd-44dc-b9fa-300828221a24 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:02.097381 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 77/155] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jun 21 20:08:01 2022] GET /identity/v3/projects/54e781b3ce904441a3692659b01df849 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:02.103837 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04803633-321b-4ecd-bd91-197ea2154d21 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:02.206256 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04803633-321b-4ecd-bd91-197ea2154d21 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:02.221786 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:02.247031 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e5bd4-2a61-456e-a31e-cfce5aa2ed63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:02.247704 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e5bd4-2a61-456e-a31e-cfce5aa2ed63 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:02.248012 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e5bd4-2a61-456e-a31e-cfce5aa2ed63 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:02.248297 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e5bd4-2a61-456e-a31e-cfce5aa2ed63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:02.249147 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26e5bd4-2a61-456e-a31e-cfce5aa2ed63 None admin] RBAC: Adding query filter params (role.id=0e9566d3696545f9b49bdc8a9574577c, scope.project.id=54e781b3ce904441a3692659b01df849, user.id=4cd92ad55d0048e4947a9eb9038bc935) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:02.249461 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26e5bd4-2a61-456e-a31e-cfce5aa2ed63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:02.250912 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26e5bd4-2a61-456e-a31e-cfce5aa2ed63 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:02.257780 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 79/156] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jun 21 20:08:02 2022] GET /identity/v3/role_assignments?user.id=4cd92ad55d0048e4947a9eb9038bc935&scope.project.id=54e781b3ce904441a3692659b01df849&role.id=0e9566d3696545f9b49bdc8a9574577c => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:02.516040 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d25e19-c33e-46d9-94bf-e7608526c88d None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:02.516541 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d25e19-c33e-46d9-94bf-e7608526c88d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:02.516623 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d25e19-c33e-46d9-94bf-e7608526c88d None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:02.517959 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 78/157] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:08:02.533853 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995bd18-4622-4b21-9480-1a80bfc05983 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:02.534525 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995bd18-4622-4b21-9480-1a80bfc05983 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:02.534525 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995bd18-4622-4b21-9480-1a80bfc05983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:02.556967 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-1995bd18-4622-4b21-9480-1a80bfc05983 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:02.558180 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-1995bd18-4622-4b21-9480-1a80bfc05983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:02.642408 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 80/158] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:08:02.668127 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d25e19-c33e-46d9-94bf-e7608526c88d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:02.771457 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:02.782334 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d25e19-c33e-46d9-94bf-e7608526c88d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:02.820657 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b10a7-eea2-472a-bb56-d9097bb507bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:02.821473 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b10a7-eea2-472a-bb56-d9097bb507bc None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:02.821757 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b10a7-eea2-472a-bb56-d9097bb507bc None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:02.822033 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b10a7-eea2-472a-bb56-d9097bb507bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:02.827480 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167ae41-2908-4132-a72e-aa2a29ea9b33 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:02.827774 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167ae41-2908-4132-a72e-aa2a29ea9b33 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:02.828081 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167ae41-2908-4132-a72e-aa2a29ea9b33 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:02.829457 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 81/159] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:08:02.835849 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b10a7-eea2-472a-bb56-d9097bb507bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:08:02.853773 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c726ec-3bbd-46e3-91cb-b64ec36ebfbb None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:02.854105 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c726ec-3bbd-46e3-91cb-b64ec36ebfbb None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:02.854395 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c726ec-3bbd-46e3-91cb-b64ec36ebfbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:02.857516 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-a77b10a7-eea2-472a-bb56-d9097bb507bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 20:08:02.857516 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:02.857516 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:02.857516 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:02.857516 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:02.857516 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:02.857516 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:02.857516 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:02.857516 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:02.857516 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:02.857516 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:02.857516 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:02.857516 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:08:02.857516 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:08:02.857516 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:08:02.857516 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:08:02.858334 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:08:02.858334 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:08:02.858334 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:08:02.858334 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:08:02.858334 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:02.858334 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:02.858334 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:02.858334 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:02.858334 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:02.858334 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:02.858334 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:02.858334 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:02.858334 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:02.858334 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:02.858334 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:02.858334 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:02.859294 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:02.859294 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:02.859294 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:02.859294 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:02.859294 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:08:02.859294 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:08:02.859294 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:08:02.859294 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:08:02.859294 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:08:02.859294 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:08:02.859294 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 20:08:02.859294 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:08:02.859294 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 79/160] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jun 21 20:08:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:02.865386 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b10a7-eea2-472a-bb56-d9097bb507bc None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:02.896974 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-d0c726ec-3bbd-46e3-91cb-b64ec36ebfbb None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:02.898202 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-d0c726ec-3bbd-46e3-91cb-b64ec36ebfbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:02.975897 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b10a7-eea2-472a-bb56-d9097bb507bc None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:03.009314 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 82/161] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:08:03.019393 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e3e41-7def-4337-845f-b213470aee76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:03.020122 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e3e41-7def-4337-845f-b213470aee76 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:03.020414 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e3e41-7def-4337-845f-b213470aee76 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:03.020701 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e3e41-7def-4337-845f-b213470aee76 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:03.021526 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e3e41-7def-4337-845f-b213470aee76 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:03.021789 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e3e41-7def-4337-845f-b213470aee76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:03.023230 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e3e41-7def-4337-845f-b213470aee76 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:03.036867 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 80/162] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:08:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:03.042240 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c726ec-3bbd-46e3-91cb-b64ec36ebfbb None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:03.050871 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e3e41-7def-4337-845f-b213470aee76 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:03.068457 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:03.149284 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:03.170645 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e3e41-7def-4337-845f-b213470aee76 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:03.214478 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8cb358-01ac-4dc8-a0f3-d31e63b6b237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:03.215685 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8cb358-01ac-4dc8-a0f3-d31e63b6b237 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:03.216191 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8cb358-01ac-4dc8-a0f3-d31e63b6b237 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:03.216689 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8cb358-01ac-4dc8-a0f3-d31e63b6b237 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:03.250324 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8cb358-01ac-4dc8-a0f3-d31e63b6b237 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:08:03.258789 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-cc8cb358-01ac-4dc8-a0f3-d31e63b6b237 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 20:08:03.258789 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:03.258789 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:03.258789 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:03.258789 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:03.258789 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:03.258789 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:03.258789 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:03.258789 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:03.258789 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:03.258789 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:03.258789 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:03.258789 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:08:03.258789 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:08:03.258789 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:08:03.258789 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:08:03.259684 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:08:03.259684 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:08:03.259684 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:08:03.259684 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:08:03.259684 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:03.259684 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:03.259684 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:03.259684 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:03.259684 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:03.259684 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:03.259684 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:03.259684 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:03.259684 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:03.259684 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:03.259684 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:03.259684 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:03.260495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:03.260495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:03.260495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:03.260495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:03.260495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:08:03.260495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:08:03.260495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:08:03.260495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:08:03.260495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:08:03.260495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:08:03.260495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 20:08:03.260495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:08:03.268023 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 81/163] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Jun 21 20:08:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:08:03.273959 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8cb358-01ac-4dc8-a0f3-d31e63b6b237 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:03.287475 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c726ec-3bbd-46e3-91cb-b64ec36ebfbb None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:03.380623 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00d334-d5bb-4cc1-8952-6e8f50a29884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:03.381522 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00d334-d5bb-4cc1-8952-6e8f50a29884 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:03.381843 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00d334-d5bb-4cc1-8952-6e8f50a29884 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:03.382131 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00d334-d5bb-4cc1-8952-6e8f50a29884 None admin] PATH_INFO: `/v3/users/6983efac1f89435f94ebc2dacd0b3544` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:03.388645 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c00d334-d5bb-4cc1-8952-6e8f50a29884 None admin] RBAC: Authorizing `identity:get_user(user_id=6983efac1f89435f94ebc2dacd0b3544)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:03.390126 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c00d334-d5bb-4cc1-8952-6e8f50a29884 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:03.391785 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 83/164] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jun 21 20:08:03 2022] GET /identity/v3/users/6983efac1f89435f94ebc2dacd0b3544 => generated 247 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:03.397994 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00d334-d5bb-4cc1-8952-6e8f50a29884 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:03.422833 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:03.476076 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8cb358-01ac-4dc8-a0f3-d31e63b6b237 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:03.535378 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4069f012-249a-4ac0-a8e7-fcd3de2236cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:03.536833 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069f012-249a-4ac0-a8e7-fcd3de2236cd None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:03.537339 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069f012-249a-4ac0-a8e7-fcd3de2236cd None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:03.537817 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069f012-249a-4ac0-a8e7-fcd3de2236cd None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:03.539309 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4069f012-249a-4ac0-a8e7-fcd3de2236cd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:03.539816 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4069f012-249a-4ac0-a8e7-fcd3de2236cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:03.542309 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4069f012-249a-4ac0-a8e7-fcd3de2236cd None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:03.551718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 82/165] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jun 21 20:08:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:08:03.553320 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6d303-1a8f-4fe0-a2b4-53cf7d00f135 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:03.554897 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6d303-1a8f-4fe0-a2b4-53cf7d00f135 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:03.555393 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6d303-1a8f-4fe0-a2b4-53cf7d00f135 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:03.557458 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 83/166] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:08:03.558391 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf6d303-1a8f-4fe0-a2b4-53cf7d00f135 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:03.619024 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00d334-d5bb-4cc1-8952-6e8f50a29884 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:03.633206 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:03.684200 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf6d303-1a8f-4fe0-a2b4-53cf7d00f135 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:03.721475 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281f1c2-b0ee-45d6-91bc-80684a62d227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:03.722735 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281f1c2-b0ee-45d6-91bc-80684a62d227 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:03.723221 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281f1c2-b0ee-45d6-91bc-80684a62d227 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:03.723714 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281f1c2-b0ee-45d6-91bc-80684a62d227 None admin] PATH_INFO: `/v3/users/4cd92ad55d0048e4947a9eb9038bc935` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:03.725283 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6281f1c2-b0ee-45d6-91bc-80684a62d227 None admin] RBAC: Authorizing `identity:get_user(user_id=4cd92ad55d0048e4947a9eb9038bc935)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:03.727735 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6281f1c2-b0ee-45d6-91bc-80684a62d227 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:03.729669 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 84/167] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jun 21 20:08:03 2022] GET /identity/v3/users/4cd92ad55d0048e4947a9eb9038bc935 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:03.731123 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902db35b-a027-4bad-af09-9d912ad65729 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:03.731635 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902db35b-a027-4bad-af09-9d912ad65729 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:03.732134 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902db35b-a027-4bad-af09-9d912ad65729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:03.734848 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daac0bc-95fa-4b28-ac1d-eda8264bf319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:03.735776 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daac0bc-95fa-4b28-ac1d-eda8264bf319 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:03.736093 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daac0bc-95fa-4b28-ac1d-eda8264bf319 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:03.736368 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daac0bc-95fa-4b28-ac1d-eda8264bf319 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:03.740267 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:03.752609 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-902db35b-a027-4bad-af09-9d912ad65729 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:03.754086 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-902db35b-a027-4bad-af09-9d912ad65729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:03.815933 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daac0bc-95fa-4b28-ac1d-eda8264bf319 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:03.817674 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daac0bc-95fa-4b28-ac1d-eda8264bf319 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:03.843562 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 85/168] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:08:03.844445 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902db35b-a027-4bad-af09-9d912ad65729 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:03.922849 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 84/169] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:08:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 21 20:08:03.924008 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daac0bc-95fa-4b28-ac1d-eda8264bf319 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:03.932424 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:04.017744 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902db35b-a027-4bad-af09-9d912ad65729 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:04.025919 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daac0bc-95fa-4b28-ac1d-eda8264bf319 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:04.062419 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359bdee0-48a2-47ba-9487-a0993e8f9f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:04.063513 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359bdee0-48a2-47ba-9487-a0993e8f9f00 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:04.064050 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359bdee0-48a2-47ba-9487-a0993e8f9f00 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:04.064617 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359bdee0-48a2-47ba-9487-a0993e8f9f00 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:04.075978 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359bdee0-48a2-47ba-9487-a0993e8f9f00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:08:04.084215 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-359bdee0-48a2-47ba-9487-a0993e8f9f00 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 20:08:04.084215 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:04.084215 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:04.084215 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:04.084215 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:04.084215 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:04.084215 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:04.084215 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:04.084215 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:04.084215 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:04.084215 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:04.084215 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:04.084215 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:08:04.084215 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:08:04.084215 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:08:04.084215 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:08:04.085640 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:08:04.085640 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:08:04.085640 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:08:04.085640 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:08:04.085640 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:04.085640 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:04.085640 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:04.085640 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:04.085640 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:04.085640 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:04.085640 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:04.085640 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:04.085640 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:04.085640 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:04.085640 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:04.085640 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:04.086418 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:04.086418 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:04.086418 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:04.086418 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:04.086418 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:08:04.086418 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:08:04.086418 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:08:04.086418 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:08:04.086418 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:08:04.086418 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:08:04.086418 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 20:08:04.086418 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:08:04.088702 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 85/170] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:08:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:04.089611 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359bdee0-48a2-47ba-9487-a0993e8f9f00 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:04.125910 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:04.152649 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7fa73-84ab-482f-9e32-532fdb82d1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:04.153330 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7fa73-84ab-482f-9e32-532fdb82d1c7 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:04.153620 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7fa73-84ab-482f-9e32-532fdb82d1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:04.153898 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7fa73-84ab-482f-9e32-532fdb82d1c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:04.159074 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:04.196631 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359bdee0-48a2-47ba-9487-a0993e8f9f00 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:04.232537 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5caa98-46bc-4a91-816c-46048dc1b296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:04.233638 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5caa98-46bc-4a91-816c-46048dc1b296 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:04.234162 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5caa98-46bc-4a91-816c-46048dc1b296 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:04.234583 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5caa98-46bc-4a91-816c-46048dc1b296 None admin] PATH_INFO: `/v3/projects/54e781b3ce904441a3692659b01df849` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:04.236183 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5caa98-46bc-4a91-816c-46048dc1b296 None admin] RBAC: Authorizing `identity:get_project(project_id=54e781b3ce904441a3692659b01df849)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:04.237783 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5caa98-46bc-4a91-816c-46048dc1b296 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:04.239638 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 86/171] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jun 21 20:08:04 2022] GET /identity/v3/projects/54e781b3ce904441a3692659b01df849 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:04.240667 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5caa98-46bc-4a91-816c-46048dc1b296 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:04.282020 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f7fa73-84ab-482f-9e32-532fdb82d1c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:04.283732 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f7fa73-84ab-482f-9e32-532fdb82d1c7 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:04.383320 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5caa98-46bc-4a91-816c-46048dc1b296 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:04.388044 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 86/172] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:08:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 20:08:04.389057 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7fa73-84ab-482f-9e32-532fdb82d1c7 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:04.424348 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:04.461530 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c653a7a4-c4ee-4d0b-9d1d-d02385d23ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:04.462360 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653a7a4-c4ee-4d0b-9d1d-d02385d23ac9 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:04.462883 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653a7a4-c4ee-4d0b-9d1d-d02385d23ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:04.463369 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653a7a4-c4ee-4d0b-9d1d-d02385d23ac9 None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:04.464371 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c653a7a4-c4ee-4d0b-9d1d-d02385d23ac9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:04.464876 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c653a7a4-c4ee-4d0b-9d1d-d02385d23ac9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:04.466441 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c653a7a4-c4ee-4d0b-9d1d-d02385d23ac9 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:04.468183 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:04.487743 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 87/173] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Jun 21 20:08:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:04.489230 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f091ad-7532-4cf3-a757-c53cc33ea178 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:04.489734 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f091ad-7532-4cf3-a757-c53cc33ea178 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:04.490208 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f091ad-7532-4cf3-a757-c53cc33ea178 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:04.492198 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 88/174] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:08:04.493080 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f091ad-7532-4cf3-a757-c53cc33ea178 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:04.498795 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7fa73-84ab-482f-9e32-532fdb82d1c7 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:04.536495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a42b7-ce07-4b35-99e5-2b2ff931f160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:04.537962 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a42b7-ce07-4b35-99e5-2b2ff931f160 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:04.538434 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a42b7-ce07-4b35-99e5-2b2ff931f160 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:04.538859 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a42b7-ce07-4b35-99e5-2b2ff931f160 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:04.539984 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717a42b7-ce07-4b35-99e5-2b2ff931f160 None admin] RBAC: Adding query filter params (role.id=1f5332f48d9e4c2aac866d0d546c94d5, scope.project.id=54e781b3ce904441a3692659b01df849, user.id=6983efac1f89435f94ebc2dacd0b3544) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:04.540518 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717a42b7-ce07-4b35-99e5-2b2ff931f160 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:04.542171 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717a42b7-ce07-4b35-99e5-2b2ff931f160 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:04.549036 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 87/175] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jun 21 20:08:04 2022] GET /identity/v3/role_assignments?user.id=6983efac1f89435f94ebc2dacd0b3544&scope.project.id=54e781b3ce904441a3692659b01df849&role.id=1f5332f48d9e4c2aac866d0d546c94d5 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:04.550277 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a42b7-ce07-4b35-99e5-2b2ff931f160 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:04.689880 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f091ad-7532-4cf3-a757-c53cc33ea178 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:04.747220 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:04.755640 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065501ef-ffb3-413d-8777-afda2405732e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:04.756546 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065501ef-ffb3-413d-8777-afda2405732e None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:04.756874 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065501ef-ffb3-413d-8777-afda2405732e None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:04.759529 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a42b7-ce07-4b35-99e5-2b2ff931f160 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:04.761114 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065501ef-ffb3-413d-8777-afda2405732e None admin] PATH_INFO: `/v3/projects/54e781b3ce904441a3692659b01df849` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:04.762391 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065501ef-ffb3-413d-8777-afda2405732e None admin] RBAC: Authorizing `identity:get_project(project_id=54e781b3ce904441a3692659b01df849)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:04.763854 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065501ef-ffb3-413d-8777-afda2405732e None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:04.765623 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 89/176] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jun 21 20:08:04 2022] GET /identity/v3/projects/54e781b3ce904441a3692659b01df849 => generated 298 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:04.766812 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f6ac1-c04a-486c-bca1-734a8e006ba4 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:04.767102 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f6ac1-c04a-486c-bca1-734a8e006ba4 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:04.767386 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f6ac1-c04a-486c-bca1-734a8e006ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:04.805320 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-ae6f6ac1-c04a-486c-bca1-734a8e006ba4 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:04.806527 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-ae6f6ac1-c04a-486c-bca1-734a8e006ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:04.819497 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc56d77-4614-4a34-b2ad-b7cf4637f176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:04.821095 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc56d77-4614-4a34-b2ad-b7cf4637f176 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:04.821393 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc56d77-4614-4a34-b2ad-b7cf4637f176 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:04.821678 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc56d77-4614-4a34-b2ad-b7cf4637f176 None admin] PATH_INFO: `/v3/users/4cd92ad55d0048e4947a9eb9038bc935` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:04.826568 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc56d77-4614-4a34-b2ad-b7cf4637f176 None admin] RBAC: Authorizing `identity:get_user(user_id=4cd92ad55d0048e4947a9eb9038bc935)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:04.828581 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc56d77-4614-4a34-b2ad-b7cf4637f176 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:04.830634 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 88/177] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jun 21 20:08:04 2022] GET /identity/v3/users/4cd92ad55d0048e4947a9eb9038bc935 => generated 275 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:04.831247 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc56d77-4614-4a34-b2ad-b7cf4637f176 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:04.920883 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:04.932524 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 90/178] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:08:04.933582 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f6ac1-c04a-486c-bca1-734a8e006ba4 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:04.956314 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc56d77-4614-4a34-b2ad-b7cf4637f176 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:04.994834 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8db33b-125e-427d-997c-2cba1caa845c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:04.995765 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8db33b-125e-427d-997c-2cba1caa845c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:04.996237 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8db33b-125e-427d-997c-2cba1caa845c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:04.996684 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8db33b-125e-427d-997c-2cba1caa845c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:04.997714 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8db33b-125e-427d-997c-2cba1caa845c None admin] RBAC: Adding query filter params (role.id=141a45d0143342f2ac0eafc233c9b6c3, scope.project.id=54e781b3ce904441a3692659b01df849, user.id=4cd92ad55d0048e4947a9eb9038bc935) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:04.998211 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8db33b-125e-427d-997c-2cba1caa845c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:04.999832 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8db33b-125e-427d-997c-2cba1caa845c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:05.006649 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 89/179] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jun 21 20:08:04 2022] GET /identity/v3/role_assignments?user.id=4cd92ad55d0048e4947a9eb9038bc935&scope.project.id=54e781b3ce904441a3692659b01df849&role.id=141a45d0143342f2ac0eafc233c9b6c3 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:05.008261 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06f61a-48e8-4bb8-a209-eb1e002015e4 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:05.008735 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06f61a-48e8-4bb8-a209-eb1e002015e4 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:05.009210 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06f61a-48e8-4bb8-a209-eb1e002015e4 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:05.010710 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 90/180] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:08:05.011692 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f06f61a-48e8-4bb8-a209-eb1e002015e4 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:05.045828 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:05.054862 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f6ac1-c04a-486c-bca1-734a8e006ba4 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:05.096667 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39813a2-1f10-4201-84cf-f6c2981ccff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:05.097685 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39813a2-1f10-4201-84cf-f6c2981ccff5 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:05.098137 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39813a2-1f10-4201-84cf-f6c2981ccff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:05.098655 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39813a2-1f10-4201-84cf-f6c2981ccff5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:05.133507 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f06f61a-48e8-4bb8-a209-eb1e002015e4 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:05.172241 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c801b8d9-4533-4597-b005-97678399d62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:05.173396 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801b8d9-4533-4597-b005-97678399d62c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:05.173887 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801b8d9-4533-4597-b005-97678399d62c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:05.174243 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:05.174401 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801b8d9-4533-4597-b005-97678399d62c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:05.184573 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39813a2-1f10-4201-84cf-f6c2981ccff5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:05.186422 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39813a2-1f10-4201-84cf-f6c2981ccff5 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:05.188595 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c801b8d9-4533-4597-b005-97678399d62c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:08:05.196708 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-c801b8d9-4533-4597-b005-97678399d62c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 20:08:05.196708 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:05.196708 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:05.196708 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:05.196708 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:05.196708 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:05.196708 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:05.196708 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:05.196708 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:05.196708 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:05.196708 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:05.196708 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:05.196708 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:08:05.196708 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:08:05.196708 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:08:05.196708 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:08:05.197605 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:08:05.197605 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:08:05.197605 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:08:05.197605 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:08:05.197605 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:05.197605 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:05.197605 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:05.197605 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:05.197605 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:05.197605 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:05.197605 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:05.197605 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:05.197605 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:05.197605 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:05.197605 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:05.197605 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:05.198396 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:05.198396 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:05.198396 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:05.198396 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:05.198396 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:08:05.198396 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:08:05.198396 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:08:05.198396 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:08:05.198396 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:08:05.198396 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:08:05.198396 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 20:08:05.198396 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:08:05.203443 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 91/181] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jun 21 20:08:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:05.203443 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da8c2b-7f51-4d63-9ac2-4592a4998dec None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:05.203443 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da8c2b-7f51-4d63-9ac2-4592a4998dec None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:05.203443 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da8c2b-7f51-4d63-9ac2-4592a4998dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:05.226110 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-23da8c2b-7f51-4d63-9ac2-4592a4998dec None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:05.228036 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-23da8c2b-7f51-4d63-9ac2-4592a4998dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:05.311058 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 91/182] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:08:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 20:08:05.312428 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a0ae3-9efd-443f-bfa7-00523473a25f None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:05.312722 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a0ae3-9efd-443f-bfa7-00523473a25f None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:05.319617 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a0ae3-9efd-443f-bfa7-00523473a25f None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:05.319746 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 92/183] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:08:05.319746 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da8c2b-7f51-4d63-9ac2-4592a4998dec None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:05.319897 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 92/184] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:08:05.319897 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4c9f8-15c7-4f12-b8b5-d9c9102aa06f None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:05.319897 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4c9f8-15c7-4f12-b8b5-d9c9102aa06f None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:05.319897 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4c9f8-15c7-4f12-b8b5-d9c9102aa06f None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:05.319897 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 93/185] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:08:05.322053 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6a8cb-a651-42b8-bea0-b80d4e5f53c3 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:05.322348 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6a8cb-a651-42b8-bea0-b80d4e5f53c3 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:05.322631 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6a8cb-a651-42b8-bea0-b80d4e5f53c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:05.339065 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:05.341182 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-3bf6a8cb-a651-42b8-bea0-b80d4e5f53c3 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:05.342500 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-3bf6a8cb-a651-42b8-bea0-b80d4e5f53c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:05.409008 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 94/186] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:08:05.415785 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf6a8cb-a651-42b8-bea0-b80d4e5f53c3 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:05.418679 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da8c2b-7f51-4d63-9ac2-4592a4998dec None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:05.440270 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:05.452652 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37cc8db-e9c3-4662-90eb-4d2d8c13eaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:05.453324 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37cc8db-e9c3-4662-90eb-4d2d8c13eaeb None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:05.453610 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37cc8db-e9c3-4662-90eb-4d2d8c13eaeb None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:05.453886 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37cc8db-e9c3-4662-90eb-4d2d8c13eaeb None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:05.454636 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37cc8db-e9c3-4662-90eb-4d2d8c13eaeb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:05.454945 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37cc8db-e9c3-4662-90eb-4d2d8c13eaeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:05.456363 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37cc8db-e9c3-4662-90eb-4d2d8c13eaeb None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:05.464908 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 93/187] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:08:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:05.466078 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e49b8-ffb9-4a64-9337-90aad4788d9d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:05.466370 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e49b8-ffb9-4a64-9337-90aad4788d9d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:05.466651 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e49b8-ffb9-4a64-9337-90aad4788d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:05.482156 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-0b0e49b8-ffb9-4a64-9337-90aad4788d9d None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:05.483293 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0b0e49b8-ffb9-4a64-9337-90aad4788d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:05.518076 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf6a8cb-a651-42b8-bea0-b80d4e5f53c3 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:05.548411 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 94/188] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:08:05.552497 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e9b93-daa9-471e-af1f-b805bc44b9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:05.552947 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e49b8-ffb9-4a64-9337-90aad4788d9d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:05.553367 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e9b93-daa9-471e-af1f-b805bc44b9a9 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:05.553685 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e9b93-daa9-471e-af1f-b805bc44b9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:05.553970 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e9b93-daa9-471e-af1f-b805bc44b9a9 None admin] PATH_INFO: `/v3/projects/3b34221c960b484287511819863e6537` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:05.555155 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6e9b93-daa9-471e-af1f-b805bc44b9a9 None admin] RBAC: Authorizing `identity:get_project(project_id=3b34221c960b484287511819863e6537)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:05.556630 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6e9b93-daa9-471e-af1f-b805bc44b9a9 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:05.563231 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 95/189] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jun 21 20:08:05 2022] GET /identity/v3/projects/3b34221c960b484287511819863e6537 => generated 312 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:05.563231 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e9b93-daa9-471e-af1f-b805bc44b9a9 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:05.564258 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:05.651587 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e49b8-ffb9-4a64-9337-90aad4788d9d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:05.655316 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:05.664198 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e9b93-daa9-471e-af1f-b805bc44b9a9 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:05.684166 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e85d58-bf84-4a9d-b947-299f224398ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:05.685113 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e85d58-bf84-4a9d-b947-299f224398ea None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:05.685398 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e85d58-bf84-4a9d-b947-299f224398ea None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:05.685680 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e85d58-bf84-4a9d-b947-299f224398ea None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:05.695873 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e85d58-bf84-4a9d-b947-299f224398ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:08:05.697487 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321aa180-a8d4-476b-88ce-a8f60dadce80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:05.698295 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321aa180-a8d4-476b-88ce-a8f60dadce80 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:05.698579 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321aa180-a8d4-476b-88ce-a8f60dadce80 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:05.698858 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321aa180-a8d4-476b-88ce-a8f60dadce80 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:05.703429 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-79e85d58-bf84-4a9d-b947-299f224398ea None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 20:08:05.703429 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:05.703429 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:05.703429 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:05.703429 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:05.703429 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:05.703429 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:05.703429 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:05.703429 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:05.703429 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:05.703429 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:05.703429 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:05.703429 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:08:05.703429 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:08:05.703429 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:08:05.703429 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:08:05.704323 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:08:05.704323 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:08:05.704323 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:08:05.704323 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:08:05.704323 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:05.704323 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:05.704323 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:05.704323 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:05.704323 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:05.704323 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:05.704323 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:05.704323 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:05.704323 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:05.704323 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:05.704323 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:05.704323 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:05.705152 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:05.705152 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:05.705152 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:05.705152 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:05.705152 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:08:05.705152 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:08:05.705152 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:08:05.705152 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:08:05.705152 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:08:05.705152 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:08:05.705152 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 20:08:05.705152 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:08:05.705152 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 95/190] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:08:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:05.705833 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e85d58-bf84-4a9d-b947-299f224398ea None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:05.713597 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321aa180-a8d4-476b-88ce-a8f60dadce80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:08:05.721633 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-321aa180-a8d4-476b-88ce-a8f60dadce80 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 20:08:05.721633 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:05.721633 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:05.721633 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:05.721633 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:05.721633 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:05.721633 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:05.721633 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:05.721633 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:05.721633 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:05.721633 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:05.721633 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:05.721633 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:08:05.721633 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:08:05.721633 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:08:05.721633 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:08:05.722544 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:08:05.722544 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:08:05.722544 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:08:05.722544 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:08:05.722544 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:05.722544 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:05.722544 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:05.722544 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:05.722544 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:05.722544 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:05.722544 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:05.722544 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:05.722544 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:05.722544 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:05.722544 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:05.722544 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:05.723346 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:05.723346 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:05.723346 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:05.723346 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:05.723346 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:08:05.723346 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:08:05.723346 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:08:05.723346 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:08:05.723346 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:08:05.723346 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:08:05.723346 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 20:08:05.723346 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:08:05.723346 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 96/191] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Jun 21 20:08:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:05.728349 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321aa180-a8d4-476b-88ce-a8f60dadce80 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:05.774695 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:05.804760 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e85d58-bf84-4a9d-b947-299f224398ea None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:05.826223 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321aa180-a8d4-476b-88ce-a8f60dadce80 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:05.837872 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6953b6a-1604-4338-8996-241b484df2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:05.838748 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6953b6a-1604-4338-8996-241b484df2d4 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:05.839034 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6953b6a-1604-4338-8996-241b484df2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:05.839310 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6953b6a-1604-4338-8996-241b484df2d4 None admin] PATH_INFO: `/v3/users/634721ecd4f74416a0110cd84300e0ad` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:05.852554 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6953b6a-1604-4338-8996-241b484df2d4 None admin] RBAC: Authorizing `identity:get_user(user_id=634721ecd4f74416a0110cd84300e0ad)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:05.854025 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6953b6a-1604-4338-8996-241b484df2d4 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:05.855702 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 96/192] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jun 21 20:08:05 2022] GET /identity/v3/users/634721ecd4f74416a0110cd84300e0ad => generated 283 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:05.856494 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6953b6a-1604-4338-8996-241b484df2d4 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:05.869359 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a6ccc8-62d5-4292-b466-c86a1ff4e767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:05.870016 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6ccc8-62d5-4292-b466-c86a1ff4e767 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:05.870301 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6ccc8-62d5-4292-b466-c86a1ff4e767 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:05.870578 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6ccc8-62d5-4292-b466-c86a1ff4e767 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:05.871413 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a6ccc8-62d5-4292-b466-c86a1ff4e767 None admin] RBAC: Adding query filter params (role.id=0e9566d3696545f9b49bdc8a9574577c, scope.project.id=3b34221c960b484287511819863e6537, user.id=4cd92ad55d0048e4947a9eb9038bc935) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:05.871727 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a6ccc8-62d5-4292-b466-c86a1ff4e767 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:05.873178 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a6ccc8-62d5-4292-b466-c86a1ff4e767 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:05.878841 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 97/193] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jun 21 20:08:05 2022] GET /identity/v3/role_assignments?user.id=4cd92ad55d0048e4947a9eb9038bc935&scope.project.id=3b34221c960b484287511819863e6537&role.id=0e9566d3696545f9b49bdc8a9574577c => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:05.879601 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a6ccc8-62d5-4292-b466-c86a1ff4e767 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:05.915520 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:05.964299 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6953b6a-1604-4338-8996-241b484df2d4 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:05.995736 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:06.006029 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6cd99-a124-4a65-b785-aa8cbb713dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:06.007619 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6cd99-a124-4a65-b785-aa8cbb713dbb None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:06.008292 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6cd99-a124-4a65-b785-aa8cbb713dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:06.008829 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6cd99-a124-4a65-b785-aa8cbb713dbb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:06.010108 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b6cd99-a124-4a65-b785-aa8cbb713dbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:06.010622 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a6ccc8-62d5-4292-b466-c86a1ff4e767 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:06.011582 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b6cd99-a124-4a65-b785-aa8cbb713dbb None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:06.019352 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 97/194] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:08:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:06.019352 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6cd99-a124-4a65-b785-aa8cbb713dbb None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:06.051677 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa148039-3255-4769-8114-5a49bf401e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:06.052319 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa148039-3255-4769-8114-5a49bf401e36 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:06.052608 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa148039-3255-4769-8114-5a49bf401e36 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:06.052887 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa148039-3255-4769-8114-5a49bf401e36 None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:06.054169 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa148039-3255-4769-8114-5a49bf401e36 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:06.054484 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa148039-3255-4769-8114-5a49bf401e36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:06.055871 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa148039-3255-4769-8114-5a49bf401e36 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:06.066771 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 98/195] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Jun 21 20:08:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:06.066771 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa148039-3255-4769-8114-5a49bf401e36 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:06.131608 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6cd99-a124-4a65-b785-aa8cbb713dbb None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:06.151273 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:06.165044 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1147ce5a-3ede-466d-862a-3edb701f0e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:06.165705 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147ce5a-3ede-466d-862a-3edb701f0e9a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:06.165987 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147ce5a-3ede-466d-862a-3edb701f0e9a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:06.166260 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147ce5a-3ede-466d-862a-3edb701f0e9a None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:06.167000 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1147ce5a-3ede-466d-862a-3edb701f0e9a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:06.167305 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1147ce5a-3ede-466d-862a-3edb701f0e9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:06.168704 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1147ce5a-3ede-466d-862a-3edb701f0e9a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:06.173229 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa148039-3255-4769-8114-5a49bf401e36 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:06.176448 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 98/196] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jun 21 20:08:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:06.177199 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1147ce5a-3ede-466d-862a-3edb701f0e9a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:06.208100 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b2edad-36b1-421f-9bd1-fcf6dee85805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:06.208764 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2edad-36b1-421f-9bd1-fcf6dee85805 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:06.209052 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2edad-36b1-421f-9bd1-fcf6dee85805 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:06.209336 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2edad-36b1-421f-9bd1-fcf6dee85805 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:06.236756 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:06.276367 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b2edad-36b1-421f-9bd1-fcf6dee85805 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:06.277835 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b2edad-36b1-421f-9bd1-fcf6dee85805 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:06.277953 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1147ce5a-3ede-466d-862a-3edb701f0e9a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:06.315666 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feccc45-bd78-4af3-9e6f-25a2a493b77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:06.320160 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feccc45-bd78-4af3-9e6f-25a2a493b77a None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:06.320447 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feccc45-bd78-4af3-9e6f-25a2a493b77a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:06.320723 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feccc45-bd78-4af3-9e6f-25a2a493b77a None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:06.321429 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feccc45-bd78-4af3-9e6f-25a2a493b77a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:06.322863 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feccc45-bd78-4af3-9e6f-25a2a493b77a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:06.351149 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 99/197] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Jun 21 20:08:06 2022] POST /identity/v3/users => generated 297 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:08:06.351834 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feccc45-bd78-4af3-9e6f-25a2a493b77a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:06.360767 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:06.393412 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 99/198] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:08:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 20:08:06.393412 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b2edad-36b1-421f-9bd1-fcf6dee85805 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:06.471707 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feccc45-bd78-4af3-9e6f-25a2a493b77a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:06.486669 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:06.511275 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b2edad-36b1-421f-9bd1-fcf6dee85805 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:06.511824 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720892c5-1735-4b87-be5a-213776cdc3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:06.512752 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720892c5-1735-4b87-be5a-213776cdc3e1 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:06.513043 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720892c5-1735-4b87-be5a-213776cdc3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:06.513312 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720892c5-1735-4b87-be5a-213776cdc3e1 None admin] PATH_INFO: `/v3/users/b3a76158099944689e2b4293957c55a0` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:06.514546 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720892c5-1735-4b87-be5a-213776cdc3e1 None admin] RBAC: Authorizing `identity:get_user(user_id=b3a76158099944689e2b4293957c55a0)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:06.516049 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720892c5-1735-4b87-be5a-213776cdc3e1 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:06.518104 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 100/199] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jun 21 20:08:06 2022] GET /identity/v3/users/b3a76158099944689e2b4293957c55a0 => generated 289 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:06.518465 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720892c5-1735-4b87-be5a-213776cdc3e1 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:06.550732 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156cd80c-61a0-45ef-a46e-f7cd44a323dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:06.551661 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156cd80c-61a0-45ef-a46e-f7cd44a323dc None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:06.552864 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156cd80c-61a0-45ef-a46e-f7cd44a323dc None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:06.552864 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156cd80c-61a0-45ef-a46e-f7cd44a323dc None admin] PATH_INFO: `/v3/users/634721ecd4f74416a0110cd84300e0ad` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:06.554325 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156cd80c-61a0-45ef-a46e-f7cd44a323dc None admin] RBAC: Authorizing `identity:get_user(user_id=634721ecd4f74416a0110cd84300e0ad)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:06.556536 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156cd80c-61a0-45ef-a46e-f7cd44a323dc None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:06.558395 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 100/200] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jun 21 20:08:06 2022] GET /identity/v3/users/634721ecd4f74416a0110cd84300e0ad => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:06.559036 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156cd80c-61a0-45ef-a46e-f7cd44a323dc None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:06.625194 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:06.650703 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720892c5-1735-4b87-be5a-213776cdc3e1 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:06.692494 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c76c3-ac96-4513-8876-549c6f2ebff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:06.693735 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c76c3-ac96-4513-8876-549c6f2ebff6 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:06.693927 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156cd80c-61a0-45ef-a46e-f7cd44a323dc None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:06.694970 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c76c3-ac96-4513-8876-549c6f2ebff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:06.695453 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c76c3-ac96-4513-8876-549c6f2ebff6 None admin] PATH_INFO: `/v3/projects/54407b3e711b40fd9b6c485b32db95cd` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:06.696983 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c76c3-ac96-4513-8876-549c6f2ebff6 None admin] RBAC: Authorizing `identity:get_project(project_id=54407b3e711b40fd9b6c485b32db95cd)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:06.698669 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c76c3-ac96-4513-8876-549c6f2ebff6 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:06.705599 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 101/201] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jun 21 20:08:06 2022] GET /identity/v3/projects/54407b3e711b40fd9b6c485b32db95cd => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:06.706752 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c76c3-ac96-4513-8876-549c6f2ebff6 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:06.742647 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8648dd48-e02d-44e3-8301-ba2646fb6fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:06.744712 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648dd48-e02d-44e3-8301-ba2646fb6fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:06.745003 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648dd48-e02d-44e3-8301-ba2646fb6fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:06.745283 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648dd48-e02d-44e3-8301-ba2646fb6fc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:06.792293 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:06.823770 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c76c3-ac96-4513-8876-549c6f2ebff6 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:06.829823 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8648dd48-e02d-44e3-8301-ba2646fb6fc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:06.831426 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8648dd48-e02d-44e3-8301-ba2646fb6fc9 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:06.871054 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e4a22-0aff-4450-8524-5e114876bd5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:06.872202 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e4a22-0aff-4450-8524-5e114876bd5f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:06.872704 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e4a22-0aff-4450-8524-5e114876bd5f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:06.873168 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e4a22-0aff-4450-8524-5e114876bd5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:06.895704 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:06.953386 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292e4a22-0aff-4450-8524-5e114876bd5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:06.955248 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292e4a22-0aff-4450-8524-5e114876bd5f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:06.972838 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 101/202] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:08:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 20:08:06.974434 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8648dd48-e02d-44e3-8301-ba2646fb6fc9 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:07.018519 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:07.085677 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 102/203] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:08:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 20:08:07.086825 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e4a22-0aff-4450-8524-5e114876bd5f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:07.092842 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8648dd48-e02d-44e3-8301-ba2646fb6fc9 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:07.131204 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec241b0-9ee7-4dad-a838-79864c90aa4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:07.132314 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec241b0-9ee7-4dad-a838-79864c90aa4f None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:07.132750 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec241b0-9ee7-4dad-a838-79864c90aa4f None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:07.133177 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec241b0-9ee7-4dad-a838-79864c90aa4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:07.134270 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec241b0-9ee7-4dad-a838-79864c90aa4f None admin] RBAC: Adding query filter params (role.id=1f5332f48d9e4c2aac866d0d546c94d5, scope.project.id=54407b3e711b40fd9b6c485b32db95cd, user.id=634721ecd4f74416a0110cd84300e0ad) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:07.134751 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec241b0-9ee7-4dad-a838-79864c90aa4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:07.136546 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec241b0-9ee7-4dad-a838-79864c90aa4f None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:07.142832 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 102/204] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jun 21 20:08:06 2022] GET /identity/v3/role_assignments?user.id=634721ecd4f74416a0110cd84300e0ad&scope.project.id=54407b3e711b40fd9b6c485b32db95cd&role.id=1f5332f48d9e4c2aac866d0d546c94d5 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:07.143770 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec241b0-9ee7-4dad-a838-79864c90aa4f None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:07.164445 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:07.258359 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e4a22-0aff-4450-8524-5e114876bd5f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:07.317103 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec241b0-9ee7-4dad-a838-79864c90aa4f None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:07.335588 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27874cb7-5ab8-429c-8a38-9b7b3bb518a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:07.336815 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27874cb7-5ab8-429c-8a38-9b7b3bb518a5 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:07.337286 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27874cb7-5ab8-429c-8a38-9b7b3bb518a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:07.337802 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27874cb7-5ab8-429c-8a38-9b7b3bb518a5 None admin] PATH_INFO: `/v3/projects/54e781b3ce904441a3692659b01df849` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:07.339233 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27874cb7-5ab8-429c-8a38-9b7b3bb518a5 None admin] RBAC: Authorizing `identity:get_project(project_id=54e781b3ce904441a3692659b01df849)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:07.342629 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27874cb7-5ab8-429c-8a38-9b7b3bb518a5 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:07.344590 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 103/205] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jun 21 20:08:07 2022] GET /identity/v3/projects/54e781b3ce904441a3692659b01df849 => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:07.350122 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27874cb7-5ab8-429c-8a38-9b7b3bb518a5 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:07.374504 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac0b664-3116-4fac-a0dd-6c7c20077e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:07.375375 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0b664-3116-4fac-a0dd-6c7c20077e06 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:07.375661 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0b664-3116-4fac-a0dd-6c7c20077e06 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:07.375762 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:07.375951 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0b664-3116-4fac-a0dd-6c7c20077e06 None admin] PATH_INFO: `/v3/projects/54407b3e711b40fd9b6c485b32db95cd` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:07.377634 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac0b664-3116-4fac-a0dd-6c7c20077e06 None admin] RBAC: Authorizing `identity:get_project(project_id=54407b3e711b40fd9b6c485b32db95cd)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:07.379159 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac0b664-3116-4fac-a0dd-6c7c20077e06 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:07.381020 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 103/206] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jun 21 20:08:07 2022] GET /identity/v3/projects/54407b3e711b40fd9b6c485b32db95cd => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:07.387535 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac0b664-3116-4fac-a0dd-6c7c20077e06 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:07.479214 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:07.503847 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac0b664-3116-4fac-a0dd-6c7c20077e06 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:07.537380 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27874cb7-5ab8-429c-8a38-9b7b3bb518a5 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:07.552212 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b5348-45cd-4e71-939f-cab31751788d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:07.552212 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b5348-45cd-4e71-939f-cab31751788d None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:07.552212 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b5348-45cd-4e71-939f-cab31751788d None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:07.552566 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b5348-45cd-4e71-939f-cab31751788d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:07.553435 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3b5348-45cd-4e71-939f-cab31751788d None admin] RBAC: Adding query filter params (role.id=141a45d0143342f2ac0eafc233c9b6c3, scope.project.id=54407b3e711b40fd9b6c485b32db95cd, user.id=634721ecd4f74416a0110cd84300e0ad) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:07.553833 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3b5348-45cd-4e71-939f-cab31751788d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:07.557721 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3b5348-45cd-4e71-939f-cab31751788d None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:07.568404 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 104/207] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jun 21 20:08:07 2022] GET /identity/v3/role_assignments?user.id=634721ecd4f74416a0110cd84300e0ad&scope.project.id=54407b3e711b40fd9b6c485b32db95cd&role.id=141a45d0143342f2ac0eafc233c9b6c3 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:07.592722 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b4bb4-075d-46ec-ae2e-b8f88bc73227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:07.593395 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b4bb4-075d-46ec-ae2e-b8f88bc73227 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:07.593685 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b4bb4-075d-46ec-ae2e-b8f88bc73227 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:07.593967 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b4bb4-075d-46ec-ae2e-b8f88bc73227 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:07.594813 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377b4bb4-075d-46ec-ae2e-b8f88bc73227 None admin] RBAC: Adding query filter params (role.id=38547a2f0ca04335b9d13bf66f4f412f, scope.project.id=54e781b3ce904441a3692659b01df849, user.id=b3a76158099944689e2b4293957c55a0) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:07.595128 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377b4bb4-075d-46ec-ae2e-b8f88bc73227 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:07.596637 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377b4bb4-075d-46ec-ae2e-b8f88bc73227 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:07.604403 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 104/208] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jun 21 20:08:07 2022] GET /identity/v3/role_assignments?user.id=b3a76158099944689e2b4293957c55a0&scope.project.id=54e781b3ce904441a3692659b01df849&role.id=38547a2f0ca04335b9d13bf66f4f412f => generated 608 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:08:08.615306 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fcac21-15d0-4182-86e7-6381c33d0308 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:08.615837 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fcac21-15d0-4182-86e7-6381c33d0308 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:08.615837 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fcac21-15d0-4182-86e7-6381c33d0308 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:08.618040 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 105/209] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:08:08.623436 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91edfb-25ae-45ca-8a66-755ea33ca145 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:08.623858 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91edfb-25ae-45ca-8a66-755ea33ca145 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:08.624100 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91edfb-25ae-45ca-8a66-755ea33ca145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:08.645485 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-eb91edfb-25ae-45ca-8a66-755ea33ca145 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:08.646676 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-eb91edfb-25ae-45ca-8a66-755ea33ca145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:08.659433 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1e3b1-00eb-4261-baed-88672c41d2ee None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:08.659728 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1e3b1-00eb-4261-baed-88672c41d2ee None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:08.660034 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1e3b1-00eb-4261-baed-88672c41d2ee None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:08.661657 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 106/210] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 20:08:08.667011 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eecb7b1-6c10-4b53-a2d6-487a587c8f21 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:08.667302 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eecb7b1-6c10-4b53-a2d6-487a587c8f21 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:08.667584 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eecb7b1-6c10-4b53-a2d6-487a587c8f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:08.687012 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-2eecb7b1-6c10-4b53-a2d6-487a587c8f21 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:08.688223 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-2eecb7b1-6c10-4b53-a2d6-487a587c8f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:08.720734 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 105/211] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:08:08.745405 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb91edfb-25ae-45ca-8a66-755ea33ca145 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:08.767179 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 107/212] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 20:08:08.772396 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:08.791953 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eecb7b1-6c10-4b53-a2d6-487a587c8f21 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:08.867946 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb91edfb-25ae-45ca-8a66-755ea33ca145 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:08.884348 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:08.896499 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eecb7b1-6c10-4b53-a2d6-487a587c8f21 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:08.903986 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f6768-db04-46a7-9efd-6de8db34e7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:08.905091 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f6768-db04-46a7-9efd-6de8db34e7da None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:08.905595 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f6768-db04-46a7-9efd-6de8db34e7da None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:08.906072 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f6768-db04-46a7-9efd-6de8db34e7da None admin] PATH_INFO: `/v3/roles/member` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:08.917718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2f6768-db04-46a7-9efd-6de8db34e7da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:08:08.925818 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-cb2f6768-db04-46a7-9efd-6de8db34e7da None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 20:08:08.925818 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:08.925818 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:08.925818 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:08.925818 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:08.925818 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:08.925818 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:08.925818 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:08.925818 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:08.925818 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:08.925818 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:08.925818 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:08.925818 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:08:08.925818 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:08:08.925818 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:08:08.925818 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:08:08.926707 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:08:08.926707 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:08:08.926707 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:08:08.926707 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:08:08.926707 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:08.926707 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:08.926707 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:08.926707 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:08.926707 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:08.926707 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:08.926707 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:08.926707 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:08.926707 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:08.926707 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:08.926707 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:08.926707 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:08.927503 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:08.927503 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:08.927503 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:08.927503 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:08.927503 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:08:08.927503 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:08:08.927503 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:08:08.927503 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:08:08.927503 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:08:08.927503 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:08:08.927503 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 20:08:08.927503 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:08:08.930073 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 106/213] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:08:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:08:08.934717 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658caa36-1d35-4e51-9d83-6aeee6c5c9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:08.934717 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658caa36-1d35-4e51-9d83-6aeee6c5c9ac None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:08.934717 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658caa36-1d35-4e51-9d83-6aeee6c5c9ac None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:08.934717 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658caa36-1d35-4e51-9d83-6aeee6c5c9ac None admin] PATH_INFO: `/v3/domains/default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:08.935352 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658caa36-1d35-4e51-9d83-6aeee6c5c9ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:08.936435 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f6768-db04-46a7-9efd-6de8db34e7da None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:08.936837 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658caa36-1d35-4e51-9d83-6aeee6c5c9ac None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:08.942862 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 108/214] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:08:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:08:08.943685 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658caa36-1d35-4e51-9d83-6aeee6c5c9ac None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:09.028804 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:09.048360 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f6768-db04-46a7-9efd-6de8db34e7da None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:09.050285 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658caa36-1d35-4e51-9d83-6aeee6c5c9ac None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:09.086712 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad121b66-b2dd-40fc-ac88-78fdeae0c1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:09.087493 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad121b66-b2dd-40fc-ac88-78fdeae0c1bd None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:09.087875 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad121b66-b2dd-40fc-ac88-78fdeae0c1bd None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:09.088270 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad121b66-b2dd-40fc-ac88-78fdeae0c1bd None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:09.089125 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad121b66-b2dd-40fc-ac88-78fdeae0c1bd None admin] RBAC: Adding query filter params (name=member) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:09.089622 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad121b66-b2dd-40fc-ac88-78fdeae0c1bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:09.091096 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad121b66-b2dd-40fc-ac88-78fdeae0c1bd None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:09.095325 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f34434c-2035-4687-8d24-5411a38a8ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:09.096205 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34434c-2035-4687-8d24-5411a38a8ca9 None admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:09.096653 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34434c-2035-4687-8d24-5411a38a8ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:09.097602 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34434c-2035-4687-8d24-5411a38a8ca9 None admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:09.098760 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f34434c-2035-4687-8d24-5411a38a8ca9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:09.100464 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f34434c-2035-4687-8d24-5411a38a8ca9 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:09.101285 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 107/215] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Jun 21 20:08:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:09.108873 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad121b66-b2dd-40fc-ac88-78fdeae0c1bd None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:09.113681 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:09.131372 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 109/216] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Jun 21 20:08:08 2022] POST /identity/v3/users => generated 297 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:08:09.238876 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad121b66-b2dd-40fc-ac88-78fdeae0c1bd None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:09.279059 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdbb054-b2c8-40e9-962f-44cd5692a473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:09.280270 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbb054-b2c8-40e9-962f-44cd5692a473 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:09.280705 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbb054-b2c8-40e9-962f-44cd5692a473 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:09.281133 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbb054-b2c8-40e9-962f-44cd5692a473 None admin] PATH_INFO: `/v3/users/9a1b74e72b284ac2940cca82561e9bd4` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:09.283481 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:09.298515 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdbb054-b2c8-40e9-962f-44cd5692a473 None admin] RBAC: Authorizing `identity:get_user(user_id=9a1b74e72b284ac2940cca82561e9bd4)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:09.300230 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdbb054-b2c8-40e9-962f-44cd5692a473 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:09.306603 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 108/217] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jun 21 20:08:09 2022] GET /identity/v3/users/9a1b74e72b284ac2940cca82561e9bd4 => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:09.308297 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f34434c-2035-4687-8d24-5411a38a8ca9 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:09.409469 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf5369-0c85-4b38-9147-de4f2e33f63b None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:09.409660 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf5369-0c85-4b38-9147-de4f2e33f63b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:09.409937 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf5369-0c85-4b38-9147-de4f2e33f63b None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:09.411451 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 109/218] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 20:08:09.417815 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf58956-191e-40e3-98fe-4489b967afb8 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:09.418208 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf58956-191e-40e3-98fe-4489b967afb8 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:09.418393 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf58956-191e-40e3-98fe-4489b967afb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:09.426929 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f34434c-2035-4687-8d24-5411a38a8ca9 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:09.437560 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-2cf58956-191e-40e3-98fe-4489b967afb8 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:09.439037 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2cf58956-191e-40e3-98fe-4489b967afb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:09.470401 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c8ade7-9a3f-46a8-9d78-722ce22b24a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:09.471061 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8ade7-9a3f-46a8-9d78-722ce22b24a1 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:09.471350 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8ade7-9a3f-46a8-9d78-722ce22b24a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:09.471629 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8ade7-9a3f-46a8-9d78-722ce22b24a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:09.530519 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 110/219] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 20:08:09.549533 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:09.555494 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf58956-191e-40e3-98fe-4489b967afb8 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:09.558725 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c8ade7-9a3f-46a8-9d78-722ce22b24a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:09.560803 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c8ade7-9a3f-46a8-9d78-722ce22b24a1 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:09.666817 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf58956-191e-40e3-98fe-4489b967afb8 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:09.691707 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:09.704501 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0bb89a-c3b7-4f08-a755-5971ddc3d2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:09.705441 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0bb89a-c3b7-4f08-a755-5971ddc3d2b7 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:09.705737 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0bb89a-c3b7-4f08-a755-5971ddc3d2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:09.706026 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0bb89a-c3b7-4f08-a755-5971ddc3d2b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:09.717943 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0bb89a-c3b7-4f08-a755-5971ddc3d2b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:08:09.728870 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-bb0bb89a-c3b7-4f08-a755-5971ddc3d2b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 20:08:09.728870 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:09.728870 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:09.728870 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:09.728870 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:09.728870 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:09.728870 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:09.728870 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:09.728870 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:09.728870 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:09.728870 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:09.728870 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:09.728870 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:08:09.728870 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:08:09.728870 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:08:09.728870 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:08:09.729781 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:08:09.729781 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:08:09.729781 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:08:09.729781 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:08:09.729781 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:09.729781 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:09.729781 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:09.729781 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:09.729781 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:09.729781 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:09.729781 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:09.729781 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:09.729781 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:09.729781 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:09.729781 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:09.729781 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:09.730569 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:09.730569 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:09.730569 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:09.730569 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:09.730569 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:08:09.730569 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:08:09.730569 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:08:09.730569 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:08:09.730569 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:08:09.730569 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:08:09.730569 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 20:08:09.730569 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:08:09.731635 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 111/220] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jun 21 20:08:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:08:09.740739 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0bb89a-c3b7-4f08-a755-5971ddc3d2b7 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:09.748213 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 110/221] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:08:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 20:08:09.757365 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c8ade7-9a3f-46a8-9d78-722ce22b24a1 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:09.900512 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0bb89a-c3b7-4f08-a755-5971ddc3d2b7 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:09.922006 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:09.928819 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c8ade7-9a3f-46a8-9d78-722ce22b24a1 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:09.947195 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701acee5-054e-4fc7-97a9-f68d0f1d9746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:09.948439 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701acee5-054e-4fc7-97a9-f68d0f1d9746 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:09.948898 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701acee5-054e-4fc7-97a9-f68d0f1d9746 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:09.949721 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701acee5-054e-4fc7-97a9-f68d0f1d9746 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:09.950640 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701acee5-054e-4fc7-97a9-f68d0f1d9746 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:09.951104 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701acee5-054e-4fc7-97a9-f68d0f1d9746 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:09.953239 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701acee5-054e-4fc7-97a9-f68d0f1d9746 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:09.970073 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 112/222] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:08:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:09.970073 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0cbc46-fcd8-48c6-854b-80b07866229c None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:09.970073 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0cbc46-fcd8-48c6-854b-80b07866229c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:09.970073 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0cbc46-fcd8-48c6-854b-80b07866229c None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:09.970073 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 113/223] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:08:09.972676 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0cbc46-fcd8-48c6-854b-80b07866229c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:09.976210 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642bad6-720d-4e1c-a8e3-3634ffe9a498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:09.977429 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642bad6-720d-4e1c-a8e3-3634ffe9a498 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:09.977429 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642bad6-720d-4e1c-a8e3-3634ffe9a498 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:09.977886 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642bad6-720d-4e1c-a8e3-3634ffe9a498 None admin] PATH_INFO: `/v3/projects/54407b3e711b40fd9b6c485b32db95cd` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:09.979211 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642bad6-720d-4e1c-a8e3-3634ffe9a498 None admin] RBAC: Authorizing `identity:get_project(project_id=54407b3e711b40fd9b6c485b32db95cd)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:09.980788 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642bad6-720d-4e1c-a8e3-3634ffe9a498 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:09.987964 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 111/224] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jun 21 20:08:09 2022] GET /identity/v3/projects/54407b3e711b40fd9b6c485b32db95cd => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:08:09.987964 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973f5d6-812e-4219-b822-a9565f2d8f18 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:09.987964 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973f5d6-812e-4219-b822-a9565f2d8f18 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:09.987964 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973f5d6-812e-4219-b822-a9565f2d8f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:10.003862 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-f973f5d6-812e-4219-b822-a9565f2d8f18 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:10.005058 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-f973f5d6-812e-4219-b822-a9565f2d8f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:10.040234 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:10.077412 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 112/225] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:08:10.078523 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973f5d6-812e-4219-b822-a9565f2d8f18 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:10.112602 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0cbc46-fcd8-48c6-854b-80b07866229c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:10.161181 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cbcb77-f609-44dd-8aa9-bacdb0123989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:10.162935 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cbcb77-f609-44dd-8aa9-bacdb0123989 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:10.163388 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cbcb77-f609-44dd-8aa9-bacdb0123989 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:10.163834 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cbcb77-f609-44dd-8aa9-bacdb0123989 None admin] PATH_INFO: `/v3/users/634721ecd4f74416a0110cd84300e0ad` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:10.165734 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cbcb77-f609-44dd-8aa9-bacdb0123989 None admin] RBAC: Authorizing `identity:get_user(user_id=634721ecd4f74416a0110cd84300e0ad)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:10.168067 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cbcb77-f609-44dd-8aa9-bacdb0123989 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:10.170600 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 114/226] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jun 21 20:08:09 2022] GET /identity/v3/users/634721ecd4f74416a0110cd84300e0ad => generated 283 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:08:10.175197 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cbcb77-f609-44dd-8aa9-bacdb0123989 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:10.196815 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:10.206549 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973f5d6-812e-4219-b822-a9565f2d8f18 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:10.253966 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4465b4-cdd5-4689-8f29-2c97dfdd3109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:10.255014 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4465b4-cdd5-4689-8f29-2c97dfdd3109 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:10.255507 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4465b4-cdd5-4689-8f29-2c97dfdd3109 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:10.256029 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4465b4-cdd5-4689-8f29-2c97dfdd3109 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:10.257629 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4465b4-cdd5-4689-8f29-2c97dfdd3109 None admin] RBAC: Adding query filter params (role.id=0e9566d3696545f9b49bdc8a9574577c, scope.project.id=54407b3e711b40fd9b6c485b32db95cd, user.id=9a1b74e72b284ac2940cca82561e9bd4) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:10.258670 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4465b4-cdd5-4689-8f29-2c97dfdd3109 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:10.260827 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4465b4-cdd5-4689-8f29-2c97dfdd3109 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:10.269342 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 113/227] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jun 21 20:08:10 2022] GET /identity/v3/role_assignments?user.id=9a1b74e72b284ac2940cca82561e9bd4&scope.project.id=54407b3e711b40fd9b6c485b32db95cd&role.id=0e9566d3696545f9b49bdc8a9574577c => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:10.270446 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4465b4-cdd5-4689-8f29-2c97dfdd3109 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:10.304122 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cbcb77-f609-44dd-8aa9-bacdb0123989 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:10.331495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:10.385498 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139963fa-c6a3-44bc-9539-3f731a036fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:10.386332 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139963fa-c6a3-44bc-9539-3f731a036fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:10.386626 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139963fa-c6a3-44bc-9539-3f731a036fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:10.386964 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139963fa-c6a3-44bc-9539-3f731a036fe0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:10.396027 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4465b4-cdd5-4689-8f29-2c97dfdd3109 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:10.413392 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139963fa-c6a3-44bc-9539-3f731a036fe0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:08:10.429057 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-139963fa-c6a3-44bc-9539-3f731a036fe0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 20:08:10.429057 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:10.429057 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:10.429057 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:10.429057 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:10.429057 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:10.429057 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:10.429057 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:10.429057 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:10.429057 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:10.429057 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:10.429057 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:10.429057 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:08:10.429057 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:08:10.429057 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:08:10.429057 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:08:10.430017 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:08:10.430017 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:08:10.430017 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:08:10.430017 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:08:10.430017 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:10.430017 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:10.430017 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:10.430017 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:10.430017 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:10.430017 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:10.430017 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:10.430017 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:10.430017 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:10.430017 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:10.430017 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:10.430017 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:10.431440 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:10.431440 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:10.431440 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:10.431440 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:10.431440 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:08:10.431440 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:08:10.431440 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:08:10.431440 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:08:10.431440 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:08:10.431440 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:08:10.431440 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 20:08:10.431440 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:08:10.431440 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 115/228] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Jun 21 20:08:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:10.436360 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139963fa-c6a3-44bc-9539-3f731a036fe0 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:10.447945 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af5420e-c338-47d6-8870-80632b61c69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:10.447945 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5420e-c338-47d6-8870-80632b61c69b None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:10.447945 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5420e-c338-47d6-8870-80632b61c69b None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:10.450868 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5420e-c338-47d6-8870-80632b61c69b None admin] PATH_INFO: `/v3/projects/54407b3e711b40fd9b6c485b32db95cd` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:10.453107 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af5420e-c338-47d6-8870-80632b61c69b None admin] RBAC: Authorizing `identity:get_project(project_id=54407b3e711b40fd9b6c485b32db95cd)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:10.454670 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af5420e-c338-47d6-8870-80632b61c69b None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:10.458997 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 114/229] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jun 21 20:08:10 2022] GET /identity/v3/projects/54407b3e711b40fd9b6c485b32db95cd => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:10.463776 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af5420e-c338-47d6-8870-80632b61c69b None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:10.520120 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:10.612453 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af5420e-c338-47d6-8870-80632b61c69b None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:10.652194 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b490e6-adfb-41b1-ad69-9e217caeb42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:10.653678 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b490e6-adfb-41b1-ad69-9e217caeb42e None admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:10.654169 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b490e6-adfb-41b1-ad69-9e217caeb42e None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:10.654676 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b490e6-adfb-41b1-ad69-9e217caeb42e None admin] PATH_INFO: `/v3/projects/54407b3e711b40fd9b6c485b32db95cd/users/634721ecd4f74416a0110cd84300e0ad/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:10.656968 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b490e6-adfb-41b1-ad69-9e217caeb42e None admin] RBAC: Authorizing `identity:create_grant(project_id=54407b3e711b40fd9b6c485b32db95cd, user_id=634721ecd4f74416a0110cd84300e0ad, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:10.658636 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b490e6-adfb-41b1-ad69-9e217caeb42e None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:10.680233 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 115/230] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Jun 21 20:08:10 2022] PUT /identity/v3/projects/54407b3e711b40fd9b6c485b32db95cd/users/634721ecd4f74416a0110cd84300e0ad/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:08:10.686014 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139963fa-c6a3-44bc-9539-3f731a036fe0 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:10.727695 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956fec9-76f6-41a8-90a6-cde77bc9983c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:10.728792 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956fec9-76f6-41a8-90a6-cde77bc9983c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:10.729303 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956fec9-76f6-41a8-90a6-cde77bc9983c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:10.729825 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956fec9-76f6-41a8-90a6-cde77bc9983c None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:10.730930 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e956fec9-76f6-41a8-90a6-cde77bc9983c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:10.731583 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e956fec9-76f6-41a8-90a6-cde77bc9983c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:10.733245 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e956fec9-76f6-41a8-90a6-cde77bc9983c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:10.748216 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 116/231] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jun 21 20:08:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:08:10.754188 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b490e6-adfb-41b1-ad69-9e217caeb42e None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:10.901737 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:10.918513 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b490e6-adfb-41b1-ad69-9e217caeb42e None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:10.963126 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1520c6ea-7650-4cb1-b71f-47528abf0a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:10.964047 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520c6ea-7650-4cb1-b71f-47528abf0a3c None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:10.964335 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520c6ea-7650-4cb1-b71f-47528abf0a3c None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:10.964658 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520c6ea-7650-4cb1-b71f-47528abf0a3c None admin] PATH_INFO: `/v3/users/634721ecd4f74416a0110cd84300e0ad` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:10.965889 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1520c6ea-7650-4cb1-b71f-47528abf0a3c None admin] RBAC: Authorizing `identity:get_user(user_id=634721ecd4f74416a0110cd84300e0ad)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:10.967340 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1520c6ea-7650-4cb1-b71f-47528abf0a3c None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:10.969305 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 116/232] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jun 21 20:08:10 2022] GET /identity/v3/users/634721ecd4f74416a0110cd84300e0ad => generated 283 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:10.974736 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956fec9-76f6-41a8-90a6-cde77bc9983c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:11.011992 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:11.103320 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956fec9-76f6-41a8-90a6-cde77bc9983c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:11.147012 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a0364-3c79-4b78-8670-a7c57f7ad0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:11.148441 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a0364-3c79-4b78-8670-a7c57f7ad0d4 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:11.148722 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a0364-3c79-4b78-8670-a7c57f7ad0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:11.148998 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a0364-3c79-4b78-8670-a7c57f7ad0d4 None admin] PATH_INFO: `/v3/projects/54407b3e711b40fd9b6c485b32db95cd` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:11.150219 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81a0364-3c79-4b78-8670-a7c57f7ad0d4 None admin] RBAC: Authorizing `identity:get_project(project_id=54407b3e711b40fd9b6c485b32db95cd)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:11.151683 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81a0364-3c79-4b78-8670-a7c57f7ad0d4 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:11.153591 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 117/233] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jun 21 20:08:10 2022] GET /identity/v3/projects/54407b3e711b40fd9b6c485b32db95cd => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:11.158991 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1520c6ea-7650-4cb1-b71f-47528abf0a3c None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:11.283266 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1520c6ea-7650-4cb1-b71f-47528abf0a3c None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:11.318825 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f448165d-57f7-4000-be1d-0dc58bbf6ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:11.319764 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448165d-57f7-4000-be1d-0dc58bbf6ae0 None admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:11.320079 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448165d-57f7-4000-be1d-0dc58bbf6ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:11.320359 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448165d-57f7-4000-be1d-0dc58bbf6ae0 None admin] PATH_INFO: `/v3/projects/54407b3e711b40fd9b6c485b32db95cd/users/634721ecd4f74416a0110cd84300e0ad/roles/141a45d0143342f2ac0eafc233c9b6c3` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:11.322613 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f448165d-57f7-4000-be1d-0dc58bbf6ae0 None admin] RBAC: Authorizing `identity:create_grant(project_id=54407b3e711b40fd9b6c485b32db95cd, user_id=634721ecd4f74416a0110cd84300e0ad, role_id=141a45d0143342f2ac0eafc233c9b6c3)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:11.324093 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f448165d-57f7-4000-be1d-0dc58bbf6ae0 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:11.340979 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 117/234] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Jun 21 20:08:11 2022] PUT /identity/v3/projects/54407b3e711b40fd9b6c485b32db95cd/users/634721ecd4f74416a0110cd84300e0ad/roles/141a45d0143342f2ac0eafc233c9b6c3 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:08:11.766624 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4252d0-cb9b-4eff-a725-ca727f4fb588 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:11.767135 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4252d0-cb9b-4eff-a725-ca727f4fb588 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:11.767243 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4252d0-cb9b-4eff-a725-ca727f4fb588 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:11.768731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 118/235] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:08:11.774572 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d058f2-7451-47e9-80b3-cec3d680534c None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:11.775058 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d290e88-e158-4a67-9cbe-0b2f50b03d0c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:11.775135 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d058f2-7451-47e9-80b3-cec3d680534c None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:11.775233 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d290e88-e158-4a67-9cbe-0b2f50b03d0c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:11.775233 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d290e88-e158-4a67-9cbe-0b2f50b03d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:11.775359 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d058f2-7451-47e9-80b3-cec3d680534c None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:11.776893 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 118/236] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:08:11.782400 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6b4db-4029-463c-b4f0-ba79b410e474 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:11.782703 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6b4db-4029-463c-b4f0-ba79b410e474 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:11.782995 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6b4db-4029-463c-b4f0-ba79b410e474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:11.795473 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-3d290e88-e158-4a67-9cbe-0b2f50b03d0c None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:11.796684 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3d290e88-e158-4a67-9cbe-0b2f50b03d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:11.816541 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-27f6b4db-4029-463c-b4f0-ba79b410e474 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:11.817751 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-27f6b4db-4029-463c-b4f0-ba79b410e474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:11.836803 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:11.926730 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 119/237] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:08:11.946499 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 119/238] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:08:11.952004 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f6b4db-4029-463c-b4f0-ba79b410e474 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:11.970129 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d290e88-e158-4a67-9cbe-0b2f50b03d0c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:12.019458 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:12.100885 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d290e88-e158-4a67-9cbe-0b2f50b03d0c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:12.111018 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f6b4db-4029-463c-b4f0-ba79b410e474 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:12.164115 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ab452-a123-4b79-b6da-8706833a9870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:12.164923 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ab452-a123-4b79-b6da-8706833a9870 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:12.165206 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ab452-a123-4b79-b6da-8706833a9870 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:12.165483 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ab452-a123-4b79-b6da-8706833a9870 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:12.166666 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968ab452-a123-4b79-b6da-8706833a9870 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:12.168172 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968ab452-a123-4b79-b6da-8706833a9870 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:12.170076 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 120/239] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:08:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:12.170696 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd2a2d7-ca2f-4a02-835b-215c0883f0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:12.171570 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2a2d7-ca2f-4a02-835b-215c0883f0a3 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:12.171864 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2a2d7-ca2f-4a02-835b-215c0883f0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:12.172169 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2a2d7-ca2f-4a02-835b-215c0883f0a3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:12.175032 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ab452-a123-4b79-b6da-8706833a9870 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:12.191021 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:12.198492 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd2a2d7-ca2f-4a02-835b-215c0883f0a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:08:12.206410 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-1bd2a2d7-ca2f-4a02-835b-215c0883f0a3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 20:08:12.206410 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:12.206410 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:12.206410 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:12.206410 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:12.206410 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:12.206410 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:12.206410 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:12.206410 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:12.206410 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:12.206410 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:12.206410 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:12.206410 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:08:12.206410 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:08:12.206410 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:08:12.206410 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:08:12.207307 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:08:12.207307 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:08:12.207307 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:08:12.207307 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:08:12.207307 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:12.207307 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:12.207307 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:12.207307 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:12.207307 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:12.207307 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:12.207307 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:12.207307 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:12.207307 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:12.207307 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:12.207307 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:12.207307 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:12.208140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:12.208140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:12.208140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:12.208140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:12.208140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:08:12.208140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:08:12.208140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:08:12.208140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:08:12.208140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:08:12.208140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:08:12.208140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 20:08:12.208140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:08:12.208140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 120/240] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:08:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:08:12.221338 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd2a2d7-ca2f-4a02-835b-215c0883f0a3 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:12.287179 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ab452-a123-4b79-b6da-8706833a9870 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:12.324018 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae53b54-0677-48c3-b319-b78761b3451a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:12.325052 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae53b54-0677-48c3-b319-b78761b3451a None admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:12.325538 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae53b54-0677-48c3-b319-b78761b3451a None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:12.326103 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae53b54-0677-48c3-b319-b78761b3451a None admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:12.327016 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae53b54-0677-48c3-b319-b78761b3451a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:12.328697 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae53b54-0677-48c3-b319-b78761b3451a None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:12.363911 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 121/241] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Jun 21 20:08:12 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:08:12.369082 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:12.378906 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd2a2d7-ca2f-4a02-835b-215c0883f0a3 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:12.416912 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b9ee2c-60ab-412d-a732-d5d27bc99cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:12.417606 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b9ee2c-60ab-412d-a732-d5d27bc99cdb None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:12.417898 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b9ee2c-60ab-412d-a732-d5d27bc99cdb None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:12.418186 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b9ee2c-60ab-412d-a732-d5d27bc99cdb None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:12.418971 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b9ee2c-60ab-412d-a732-d5d27bc99cdb None admin] RBAC: Adding query filter params (name=reader) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:12.419287 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b9ee2c-60ab-412d-a732-d5d27bc99cdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:12.420751 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b9ee2c-60ab-412d-a732-d5d27bc99cdb None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:12.431250 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 121/242] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Jun 21 20:08:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:12.436819 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae53b54-0677-48c3-b319-b78761b3451a None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:12.541516 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:12.583243 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae53b54-0677-48c3-b319-b78761b3451a None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:12.623076 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac87f9f-3821-4dbc-aa23-558a363bf9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:12.624336 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac87f9f-3821-4dbc-aa23-558a363bf9d8 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:12.624829 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac87f9f-3821-4dbc-aa23-558a363bf9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:12.625308 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac87f9f-3821-4dbc-aa23-558a363bf9d8 None admin] PATH_INFO: `/v3/users/6a685df3bb8d4730b19d955a3790edeb` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:12.640824 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac87f9f-3821-4dbc-aa23-558a363bf9d8 None admin] RBAC: Authorizing `identity:get_user(user_id=6a685df3bb8d4730b19d955a3790edeb)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:12.642577 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac87f9f-3821-4dbc-aa23-558a363bf9d8 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:12.644840 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 122/243] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jun 21 20:08:12 2022] GET /identity/v3/users/6a685df3bb8d4730b19d955a3790edeb => generated 297 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:12.652873 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b9ee2c-60ab-412d-a732-d5d27bc99cdb None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:12.765839 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b9ee2c-60ab-412d-a732-d5d27bc99cdb None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:12.803217 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb9f17-b890-43cb-93bf-48630fcddb57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:12.803848 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb9f17-b890-43cb-93bf-48630fcddb57 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:12.804152 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb9f17-b890-43cb-93bf-48630fcddb57 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:12.804440 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb9f17-b890-43cb-93bf-48630fcddb57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:12.831864 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:12.895117 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cb9f17-b890-43cb-93bf-48630fcddb57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:12.896665 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cb9f17-b890-43cb-93bf-48630fcddb57 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:12.952905 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee2949-6281-4015-96b0-53ab78397dd2 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:12.953416 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee2949-6281-4015-96b0-53ab78397dd2 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:12.953521 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee2949-6281-4015-96b0-53ab78397dd2 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:12.954987 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 123/244] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:08:12.961605 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace804cb-aa7b-4390-b741-79c22f53e8fd None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:12.961903 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace804cb-aa7b-4390-b741-79c22f53e8fd None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:12.962188 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace804cb-aa7b-4390-b741-79c22f53e8fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:13.005692 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-ace804cb-aa7b-4390-b741-79c22f53e8fd None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:13.008219 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 122/245] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:08:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 20:08:13.008489 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-ace804cb-aa7b-4390-b741-79c22f53e8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:13.013818 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb9f17-b890-43cb-93bf-48630fcddb57 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:13.107065 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 124/246] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:08:13.111523 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:13.138853 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace804cb-aa7b-4390-b741-79c22f53e8fd None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:13.141293 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb9f17-b890-43cb-93bf-48630fcddb57 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:13.184695 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e26269-aced-4c72-8ac2-b90571823ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:13.185575 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e26269-aced-4c72-8ac2-b90571823ba9 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:13.185863 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e26269-aced-4c72-8ac2-b90571823ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:13.186144 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e26269-aced-4c72-8ac2-b90571823ba9 None admin] PATH_INFO: `/v3/projects/54407b3e711b40fd9b6c485b32db95cd` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:13.187367 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e26269-aced-4c72-8ac2-b90571823ba9 None admin] RBAC: Authorizing `identity:get_project(project_id=54407b3e711b40fd9b6c485b32db95cd)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:13.188868 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e26269-aced-4c72-8ac2-b90571823ba9 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:13.190775 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 123/247] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jun 21 20:08:13 2022] GET /identity/v3/projects/54407b3e711b40fd9b6c485b32db95cd => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:08:13.197458 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e597e63-6109-4ee6-be2e-6b53af514b3f None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:13.197856 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e597e63-6109-4ee6-be2e-6b53af514b3f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:13.198148 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e597e63-6109-4ee6-be2e-6b53af514b3f None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:13.199761 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 124/248] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:08:13.200836 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e597e63-6109-4ee6-be2e-6b53af514b3f None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:13.215570 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:13.269444 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace804cb-aa7b-4390-b741-79c22f53e8fd None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:13.315736 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d34c23-53c8-4649-a506-989b5b1e4df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:13.316604 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d34c23-53c8-4649-a506-989b5b1e4df7 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:13.316897 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d34c23-53c8-4649-a506-989b5b1e4df7 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:13.317180 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d34c23-53c8-4649-a506-989b5b1e4df7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:13.332130 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d34c23-53c8-4649-a506-989b5b1e4df7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:08:13.332841 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e597e63-6109-4ee6-be2e-6b53af514b3f None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:13.341603 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-c9d34c23-53c8-4649-a506-989b5b1e4df7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 20:08:13.341603 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:13.341603 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:13.341603 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:13.341603 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:13.341603 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:13.341603 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:13.341603 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:13.341603 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:13.341603 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:13.341603 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:13.341603 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:13.341603 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:08:13.341603 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:08:13.341603 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:08:13.341603 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:08:13.342502 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:08:13.342502 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:08:13.342502 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:08:13.342502 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:08:13.342502 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:13.342502 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:13.342502 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:13.342502 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:13.342502 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:13.342502 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:13.342502 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:13.342502 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:13.342502 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:13.342502 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:13.342502 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:13.342502 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:13.343317 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:13.343317 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:13.343317 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:13.343317 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:13.343317 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:08:13.343317 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:08:13.343317 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:08:13.343317 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:08:13.343317 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:08:13.343317 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:08:13.343317 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 20:08:13.343317 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:08:13.344415 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 125/249] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:08:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:08:13.347976 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6e333-1272-4dd8-8196-ee1cd2df47e5 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:13.347976 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6e333-1272-4dd8-8196-ee1cd2df47e5 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:13.347976 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6e333-1272-4dd8-8196-ee1cd2df47e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:13.371480 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:13.380517 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-28e6e333-1272-4dd8-8196-ee1cd2df47e5 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:13.384223 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-28e6e333-1272-4dd8-8196-ee1cd2df47e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:13.395406 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771664e6-76f0-4eb2-bd3a-da9cefd5a283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:13.396099 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771664e6-76f0-4eb2-bd3a-da9cefd5a283 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:13.396436 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771664e6-76f0-4eb2-bd3a-da9cefd5a283 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:13.396719 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771664e6-76f0-4eb2-bd3a-da9cefd5a283 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:13.397660 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771664e6-76f0-4eb2-bd3a-da9cefd5a283 None admin] RBAC: Adding query filter params (role.id=38547a2f0ca04335b9d13bf66f4f412f, scope.project.id=54407b3e711b40fd9b6c485b32db95cd, user.id=6a685df3bb8d4730b19d955a3790edeb) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:13.397981 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771664e6-76f0-4eb2-bd3a-da9cefd5a283 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:13.399463 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771664e6-76f0-4eb2-bd3a-da9cefd5a283 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:13.411996 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 125/250] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jun 21 20:08:13 2022] GET /identity/v3/role_assignments?user.id=6a685df3bb8d4730b19d955a3790edeb&scope.project.id=54407b3e711b40fd9b6c485b32db95cd&role.id=38547a2f0ca04335b9d13bf66f4f412f => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:08:13.412918 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771664e6-76f0-4eb2-bd3a-da9cefd5a283 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:13.502668 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 126/251] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:08:13.527298 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e6e333-1272-4dd8-8196-ee1cd2df47e5 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:13.579081 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:13.644206 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771664e6-76f0-4eb2-bd3a-da9cefd5a283 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:13.662456 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e6e333-1272-4dd8-8196-ee1cd2df47e5 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:13.726521 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc35de9-18b7-4a93-a97a-a3d75e92a806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:13.727205 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc35de9-18b7-4a93-a97a-a3d75e92a806 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:13.727491 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc35de9-18b7-4a93-a97a-a3d75e92a806 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:13.727773 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc35de9-18b7-4a93-a97a-a3d75e92a806 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:13.729604 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc35de9-18b7-4a93-a97a-a3d75e92a806 None admin] RBAC: Adding query filter params (name=member) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:13.729922 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc35de9-18b7-4a93-a97a-a3d75e92a806 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:13.731304 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc35de9-18b7-4a93-a97a-a3d75e92a806 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:13.733494 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19b684-82c8-4a51-a87a-8ba35f6afb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:13.734367 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19b684-82c8-4a51-a87a-8ba35f6afb7c None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:13.734655 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19b684-82c8-4a51-a87a-8ba35f6afb7c None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:13.734932 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19b684-82c8-4a51-a87a-8ba35f6afb7c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:13.746047 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 126/252] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Jun 21 20:08:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:13.752973 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc35de9-18b7-4a93-a97a-a3d75e92a806 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:13.759215 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d19b684-82c8-4a51-a87a-8ba35f6afb7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:08:13.771040 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-0d19b684-82c8-4a51-a87a-8ba35f6afb7c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 20:08:13.771040 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:13.771040 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:13.771040 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:13.771040 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:13.771040 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:13.771040 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:13.771040 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:13.771040 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:13.771040 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:13.771040 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:13.771040 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:13.771040 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:08:13.771040 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:08:13.771040 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:08:13.771040 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:08:13.772042 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:08:13.772042 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:08:13.772042 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:08:13.772042 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:08:13.772042 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:13.772042 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:13.772042 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:13.772042 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:13.772042 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:13.772042 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:13.772042 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:13.772042 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:13.772042 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:13.772042 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:13.772042 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:13.772042 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:13.772904 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:13.772904 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:13.772904 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:13.772904 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:13.772904 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:08:13.772904 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:08:13.772904 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:08:13.772904 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:08:13.772904 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:08:13.772904 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:08:13.772904 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 20:08:13.772904 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:08:13.775819 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 127/253] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jun 21 20:08:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:13.781432 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19b684-82c8-4a51-a87a-8ba35f6afb7c None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:13.841812 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:13.907664 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc35de9-18b7-4a93-a97a-a3d75e92a806 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:13.948475 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b1a68-8a78-41f7-b604-e2b03bd69a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:13.949742 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b1a68-8a78-41f7-b604-e2b03bd69a21 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:13.950489 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b1a68-8a78-41f7-b604-e2b03bd69a21 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:13.950976 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b1a68-8a78-41f7-b604-e2b03bd69a21 None admin] PATH_INFO: `/v3/users/9a1b74e72b284ac2940cca82561e9bd4` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:13.952437 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b1a68-8a78-41f7-b604-e2b03bd69a21 None admin] RBAC: Authorizing `identity:get_user(user_id=9a1b74e72b284ac2940cca82561e9bd4)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:13.954709 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b1a68-8a78-41f7-b604-e2b03bd69a21 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:13.956945 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 127/254] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jun 21 20:08:13 2022] GET /identity/v3/users/9a1b74e72b284ac2940cca82561e9bd4 => generated 297 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:13.962775 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b1a68-8a78-41f7-b604-e2b03bd69a21 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:14.000443 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19b684-82c8-4a51-a87a-8ba35f6afb7c None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:14.007714 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:14.035466 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a9e1e0-978d-4d5d-9200-15e26d569a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:14.036184 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9e1e0-978d-4d5d-9200-15e26d569a81 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:14.036642 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9e1e0-978d-4d5d-9200-15e26d569a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:14.037114 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9e1e0-978d-4d5d-9200-15e26d569a81 None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:14.038584 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a9e1e0-978d-4d5d-9200-15e26d569a81 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:14.039081 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a9e1e0-978d-4d5d-9200-15e26d569a81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:14.040690 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a9e1e0-978d-4d5d-9200-15e26d569a81 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:14.049843 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 128/255] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:08:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:08:14.060936 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a9e1e0-978d-4d5d-9200-15e26d569a81 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:14.078231 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b1a68-8a78-41f7-b604-e2b03bd69a21 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:14.096699 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:14.129070 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d38e9-2820-43c7-8de1-f02a18523f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:14.130321 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d38e9-2820-43c7-8de1-f02a18523f31 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:14.130829 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d38e9-2820-43c7-8de1-f02a18523f31 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:14.131559 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d38e9-2820-43c7-8de1-f02a18523f31 None admin] PATH_INFO: `/v3/projects/54407b3e711b40fd9b6c485b32db95cd` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:14.133797 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d38e9-2820-43c7-8de1-f02a18523f31 None admin] RBAC: Authorizing `identity:get_project(project_id=54407b3e711b40fd9b6c485b32db95cd)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:14.136744 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d38e9-2820-43c7-8de1-f02a18523f31 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:14.138877 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 128/256] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jun 21 20:08:13 2022] GET /identity/v3/projects/54407b3e711b40fd9b6c485b32db95cd => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:08:14.151489 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d38e9-2820-43c7-8de1-f02a18523f31 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:14.232511 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a9e1e0-978d-4d5d-9200-15e26d569a81 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:14.296171 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d326d11c-a5e1-4851-9e3e-dd024ea5ed1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:14.297068 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326d11c-a5e1-4851-9e3e-dd024ea5ed1b None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:14.297353 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326d11c-a5e1-4851-9e3e-dd024ea5ed1b None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:14.297634 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326d11c-a5e1-4851-9e3e-dd024ea5ed1b None admin] PATH_INFO: `/v3/users/634721ecd4f74416a0110cd84300e0ad` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:14.298995 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d326d11c-a5e1-4851-9e3e-dd024ea5ed1b None admin] RBAC: Authorizing `identity:get_user(user_id=634721ecd4f74416a0110cd84300e0ad)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:14.301930 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d326d11c-a5e1-4851-9e3e-dd024ea5ed1b None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:14.303798 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 129/257] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jun 21 20:08:14 2022] GET /identity/v3/users/634721ecd4f74416a0110cd84300e0ad => generated 283 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:14.309010 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8ede5-24b6-436e-839a-c32295786447 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:14.309311 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8ede5-24b6-436e-839a-c32295786447 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:14.309598 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8ede5-24b6-436e-839a-c32295786447 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:14.310970 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 130/258] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:08:14.316034 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8ede5-24b6-436e-839a-c32295786447 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:14.342704 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d38e9-2820-43c7-8de1-f02a18523f31 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:14.380271 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:14.410493 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188e2f3-2327-4f39-bb00-c074ce7ac17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:14.411399 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188e2f3-2327-4f39-bb00-c074ce7ac17a None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:14.411685 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188e2f3-2327-4f39-bb00-c074ce7ac17a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:14.411986 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188e2f3-2327-4f39-bb00-c074ce7ac17a None admin] PATH_INFO: `/v3/projects/54407b3e711b40fd9b6c485b32db95cd/users/9a1b74e72b284ac2940cca82561e9bd4/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:14.415708 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e188e2f3-2327-4f39-bb00-c074ce7ac17a None admin] RBAC: Authorizing `identity:create_grant(project_id=54407b3e711b40fd9b6c485b32db95cd, user_id=9a1b74e72b284ac2940cca82561e9bd4, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:14.417207 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e188e2f3-2327-4f39-bb00-c074ce7ac17a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:14.438833 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 129/259] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Jun 21 20:08:14 2022] PUT /identity/v3/projects/54407b3e711b40fd9b6c485b32db95cd/users/9a1b74e72b284ac2940cca82561e9bd4/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:08:14.440934 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031486e1-295d-4bdb-b36e-fb725bfd2fa8 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:14.441236 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031486e1-295d-4bdb-b36e-fb725bfd2fa8 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:14.441527 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031486e1-295d-4bdb-b36e-fb725bfd2fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:14.469524 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-031486e1-295d-4bdb-b36e-fb725bfd2fa8 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:14.471477 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-031486e1-295d-4bdb-b36e-fb725bfd2fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:14.517184 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8ede5-24b6-436e-839a-c32295786447 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:14.584344 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:14.609512 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565cb1c-33be-4847-9901-4f2522d7e9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:14.610500 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565cb1c-33be-4847-9901-4f2522d7e9ce None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:14.610791 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565cb1c-33be-4847-9901-4f2522d7e9ce None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:14.611070 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565cb1c-33be-4847-9901-4f2522d7e9ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:14.654891 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 130/260] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:08:14.691070 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031486e1-295d-4bdb-b36e-fb725bfd2fa8 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:14.711114 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3565cb1c-33be-4847-9901-4f2522d7e9ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:14.712681 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3565cb1c-33be-4847-9901-4f2522d7e9ce None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:14.764465 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:14.895725 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 131/261] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:08:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 583 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 20:08:14.898772 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031486e1-295d-4bdb-b36e-fb725bfd2fa8 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:14.901820 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565cb1c-33be-4847-9901-4f2522d7e9ce None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:14.961642 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab3d8c-e9fa-456b-afce-3f9838179e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:14.962481 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab3d8c-e9fa-456b-afce-3f9838179e68 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:14.962761 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab3d8c-e9fa-456b-afce-3f9838179e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:14.963363 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab3d8c-e9fa-456b-afce-3f9838179e68 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:14.988503 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ab3d8c-e9fa-456b-afce-3f9838179e68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:08:14.998340 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-40ab3d8c-e9fa-456b-afce-3f9838179e68 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 20:08:14.998340 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:14.998340 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:14.998340 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:14.998340 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:14.998340 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:14.998340 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:14.998340 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:14.998340 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:14.998340 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:14.998340 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:14.998340 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:14.998340 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:08:14.998340 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:08:14.998340 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:08:14.998340 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:08:14.999252 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:08:14.999252 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:08:14.999252 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:08:14.999252 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:08:14.999252 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:14.999252 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:14.999252 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:14.999252 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:14.999252 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:14.999252 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:14.999252 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:14.999252 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:14.999252 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:14.999252 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:14.999252 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:14.999252 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:15.000090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:15.000090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:15.000090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:15.000090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:15.000090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:08:15.000090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:08:15.000090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:08:15.000090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:08:15.000090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:08:15.000090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:08:15.000090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 20:08:15.000090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:08:15.003196 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 131/262] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Jun 21 20:08:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:08:15.009451 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab3d8c-e9fa-456b-afce-3f9838179e68 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:15.077672 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:15.091810 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565cb1c-33be-4847-9901-4f2522d7e9ce None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:15.140844 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e7eaf-3518-4e49-847b-1641270b57da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:15.141876 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e7eaf-3518-4e49-847b-1641270b57da None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:15.142171 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e7eaf-3518-4e49-847b-1641270b57da None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:15.142455 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e7eaf-3518-4e49-847b-1641270b57da None admin] PATH_INFO: `/v3/projects/54407b3e711b40fd9b6c485b32db95cd` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:15.143669 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9e7eaf-3518-4e49-847b-1641270b57da None admin] RBAC: Authorizing `identity:get_project(project_id=54407b3e711b40fd9b6c485b32db95cd)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:15.145677 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9e7eaf-3518-4e49-847b-1641270b57da None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:15.148284 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 132/263] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jun 21 20:08:14 2022] GET /identity/v3/projects/54407b3e711b40fd9b6c485b32db95cd => generated 302 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:08:15.156871 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e7eaf-3518-4e49-847b-1641270b57da None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:15.164305 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:15.212765 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab3d8c-e9fa-456b-afce-3f9838179e68 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:15.276639 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4535f8d-67ff-4f45-84a1-916d9228730c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:15.277613 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4535f8d-67ff-4f45-84a1-916d9228730c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:15.278057 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4535f8d-67ff-4f45-84a1-916d9228730c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:15.278485 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4535f8d-67ff-4f45-84a1-916d9228730c None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:15.279407 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4535f8d-67ff-4f45-84a1-916d9228730c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:15.279884 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4535f8d-67ff-4f45-84a1-916d9228730c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:15.281456 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4535f8d-67ff-4f45-84a1-916d9228730c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:15.283009 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e7eaf-3518-4e49-847b-1641270b57da None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:15.291111 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 132/264] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jun 21 20:08:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:08:15.301084 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4535f8d-67ff-4f45-84a1-916d9228730c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:15.323000 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43b8375-c6f5-4d6d-b17a-978682050cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:15.324017 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b8375-c6f5-4d6d-b17a-978682050cf5 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:15.324489 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b8375-c6f5-4d6d-b17a-978682050cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:15.325018 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b8375-c6f5-4d6d-b17a-978682050cf5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:15.326149 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43b8375-c6f5-4d6d-b17a-978682050cf5 None admin] RBAC: Adding query filter params (role.id=1f5332f48d9e4c2aac866d0d546c94d5, scope.project.id=54407b3e711b40fd9b6c485b32db95cd, user.id=634721ecd4f74416a0110cd84300e0ad) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:15.326761 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43b8375-c6f5-4d6d-b17a-978682050cf5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:15.328538 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43b8375-c6f5-4d6d-b17a-978682050cf5 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:15.335498 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 133/265] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jun 21 20:08:15 2022] GET /identity/v3/role_assignments?user.id=634721ecd4f74416a0110cd84300e0ad&scope.project.id=54407b3e711b40fd9b6c485b32db95cd&role.id=1f5332f48d9e4c2aac866d0d546c94d5 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:15.433936 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:15.441290 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4535f8d-67ff-4f45-84a1-916d9228730c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:15.492029 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e2c4d-ceba-4e22-9575-f3e1338ce871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:15.493223 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e2c4d-ceba-4e22-9575-f3e1338ce871 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:15.493718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e2c4d-ceba-4e22-9575-f3e1338ce871 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:15.494187 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e2c4d-ceba-4e22-9575-f3e1338ce871 None admin] PATH_INFO: `/v3/users/634721ecd4f74416a0110cd84300e0ad` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:15.495590 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956e2c4d-ceba-4e22-9575-f3e1338ce871 None admin] RBAC: Authorizing `identity:get_user(user_id=634721ecd4f74416a0110cd84300e0ad)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:15.497249 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956e2c4d-ceba-4e22-9575-f3e1338ce871 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:15.502950 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 133/266] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jun 21 20:08:15 2022] GET /identity/v3/users/634721ecd4f74416a0110cd84300e0ad => generated 283 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:15.504642 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43b8375-c6f5-4d6d-b17a-978682050cf5 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:15.564113 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c7468-38b9-48ad-aebd-c2e6791681cb None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:15.564694 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c7468-38b9-48ad-aebd-c2e6791681cb None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:15.565437 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c7468-38b9-48ad-aebd-c2e6791681cb None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:15.567751 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 134/267] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:08:15.577073 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96c406-00be-4a15-b3e8-b046f76d0a74 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:15.577897 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96c406-00be-4a15-b3e8-b046f76d0a74 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:15.578365 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96c406-00be-4a15-b3e8-b046f76d0a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:15.595857 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:15.614860 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-2f96c406-00be-4a15-b3e8-b046f76d0a74 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:15.616620 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2f96c406-00be-4a15-b3e8-b046f76d0a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:15.663434 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43b8375-c6f5-4d6d-b17a-978682050cf5 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:15.736578 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f9436-1897-419f-9184-ed18800526ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:15.737518 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f9436-1897-419f-9184-ed18800526ea None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:15.738534 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f9436-1897-419f-9184-ed18800526ea None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:15.739166 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f9436-1897-419f-9184-ed18800526ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:15.745467 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 135/268] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 20:08:15.832057 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f9436-1897-419f-9184-ed18800526ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:15.833835 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f9436-1897-419f-9184-ed18800526ea None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:15.906026 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f96c406-00be-4a15-b3e8-b046f76d0a74 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:15.929299 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:16.000847 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 134/269] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:08:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 20:08:16.007409 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f9436-1897-419f-9184-ed18800526ea None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:16.075345 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:16.084564 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f96c406-00be-4a15-b3e8-b046f76d0a74 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:16.145332 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f9436-1897-419f-9184-ed18800526ea None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:16.154702 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ec47e-5fb1-46bb-b295-f4b8cc2e0ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:16.155535 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ec47e-5fb1-46bb-b295-f4b8cc2e0ef0 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:16.155829 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ec47e-5fb1-46bb-b295-f4b8cc2e0ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:16.156148 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ec47e-5fb1-46bb-b295-f4b8cc2e0ef0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:16.175626 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ec47e-5fb1-46bb-b295-f4b8cc2e0ef0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:08:16.187753 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872fcf69-952d-4903-97d3-a282f3927068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:16.187945 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-ea0ec47e-5fb1-46bb-b295-f4b8cc2e0ef0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 20:08:16.187945 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:16.187945 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:16.187945 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:16.187945 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:16.187945 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:16.187945 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:16.187945 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:16.187945 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:16.187945 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:16.187945 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:16.187945 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:16.187945 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:08:16.187945 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:08:16.187945 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:08:16.187945 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:08:16.188786 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:08:16.188786 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:08:16.188786 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:08:16.188786 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:08:16.188786 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:16.188786 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:16.188786 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:16.188786 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:16.188786 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:16.188786 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:16.188786 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:16.188786 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:16.188786 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:16.188786 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:16.188786 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:16.188786 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:16.189573 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:16.189573 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:16.189573 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:16.189573 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:16.189573 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:08:16.189573 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:08:16.189573 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:08:16.189573 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:08:16.189573 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:08:16.189573 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:08:16.189573 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 20:08:16.189573 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:08:16.190168 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872fcf69-952d-4903-97d3-a282f3927068 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:16.190168 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872fcf69-952d-4903-97d3-a282f3927068 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:16.190168 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872fcf69-952d-4903-97d3-a282f3927068 None admin] PATH_INFO: `/v3/projects/54407b3e711b40fd9b6c485b32db95cd` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:16.190348 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 136/270] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:08:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:08:16.190412 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872fcf69-952d-4903-97d3-a282f3927068 None admin] RBAC: Authorizing `identity:get_project(project_id=54407b3e711b40fd9b6c485b32db95cd)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:16.190412 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872fcf69-952d-4903-97d3-a282f3927068 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:16.191338 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 135/271] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jun 21 20:08:16 2022] GET /identity/v3/projects/54407b3e711b40fd9b6c485b32db95cd => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:16.195939 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ec47e-5fb1-46bb-b295-f4b8cc2e0ef0 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:16.197418 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872fcf69-952d-4903-97d3-a282f3927068 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:16.236280 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:16.308302 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872fcf69-952d-4903-97d3-a282f3927068 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:16.344719 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa2281f-1620-4c10-925e-3e9c036002da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:16.345744 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2281f-1620-4c10-925e-3e9c036002da None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:16.346220 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2281f-1620-4c10-925e-3e9c036002da None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:16.346685 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2281f-1620-4c10-925e-3e9c036002da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:16.347707 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa2281f-1620-4c10-925e-3e9c036002da None admin] RBAC: Adding query filter params (role.id=141a45d0143342f2ac0eafc233c9b6c3, scope.project.id=54407b3e711b40fd9b6c485b32db95cd, user.id=634721ecd4f74416a0110cd84300e0ad) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:16.348251 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa2281f-1620-4c10-925e-3e9c036002da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:16.349913 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa2281f-1620-4c10-925e-3e9c036002da None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:16.356356 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 136/272] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jun 21 20:08:16 2022] GET /identity/v3/role_assignments?user.id=634721ecd4f74416a0110cd84300e0ad&scope.project.id=54407b3e711b40fd9b6c485b32db95cd&role.id=141a45d0143342f2ac0eafc233c9b6c3 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:08:16.357871 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a046e-1487-41ce-b503-b5086c9e6f34 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:16.358300 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a046e-1487-41ce-b503-b5086c9e6f34 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:16.358781 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a046e-1487-41ce-b503-b5086c9e6f34 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:16.360482 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 137/273] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:08:16.369018 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392bc9ac-f23d-4124-8db6-f7e6b2aae603 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:16.369541 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392bc9ac-f23d-4124-8db6-f7e6b2aae603 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:16.369996 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392bc9ac-f23d-4124-8db6-f7e6b2aae603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:16.401997 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-392bc9ac-f23d-4124-8db6-f7e6b2aae603 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:16.404372 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-392bc9ac-f23d-4124-8db6-f7e6b2aae603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:16.421675 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ec47e-5fb1-46bb-b295-f4b8cc2e0ef0 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:16.482239 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153b8ba-f27d-4573-84a1-78ddc52a6ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:16.483449 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153b8ba-f27d-4573-84a1-78ddc52a6ec7 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:16.483932 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153b8ba-f27d-4573-84a1-78ddc52a6ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:16.484634 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153b8ba-f27d-4573-84a1-78ddc52a6ec7 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:16.486360 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0153b8ba-f27d-4573-84a1-78ddc52a6ec7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:16.487120 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0153b8ba-f27d-4573-84a1-78ddc52a6ec7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:16.489492 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0153b8ba-f27d-4573-84a1-78ddc52a6ec7 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:16.503072 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 137/274] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Jun 21 20:08:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:16.504846 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2002a4-7015-4bc5-8d46-c30f8e5752a1 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:16.505291 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2002a4-7015-4bc5-8d46-c30f8e5752a1 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:16.505738 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2002a4-7015-4bc5-8d46-c30f8e5752a1 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:16.508445 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 138/275] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:08:16.509692 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2002a4-7015-4bc5-8d46-c30f8e5752a1 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:16.520024 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 138/276] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:08:16.522347 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cac843-7c0c-4b9a-a783-d065de7f7c24 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:16.522792 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cac843-7c0c-4b9a-a783-d065de7f7c24 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:16.523203 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cac843-7c0c-4b9a-a783-d065de7f7c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:16.539970 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:16.555859 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-d0cac843-7c0c-4b9a-a783-d065de7f7c24 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:16.557636 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-d0cac843-7c0c-4b9a-a783-d065de7f7c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:16.588129 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:16.653677 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 139/277] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:08:16.655078 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cac843-7c0c-4b9a-a783-d065de7f7c24 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:16.661636 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2002a4-7015-4bc5-8d46-c30f8e5752a1 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:16.701356 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa9fc9-3802-4c33-9201-0924a098937e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:16.702238 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa9fc9-3802-4c33-9201-0924a098937e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:16.702529 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa9fc9-3802-4c33-9201-0924a098937e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:16.702806 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa9fc9-3802-4c33-9201-0924a098937e None admin] PATH_INFO: `/v3/users/7ce29da001cf4336bcf8dcb9b299fa4d` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:16.716060 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daa9fc9-3802-4c33-9201-0924a098937e None admin] RBAC: Authorizing `identity:get_user(user_id=7ce29da001cf4336bcf8dcb9b299fa4d)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:16.717519 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daa9fc9-3802-4c33-9201-0924a098937e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:16.723631 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 139/278] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jun 21 20:08:16 2022] GET /identity/v3/users/7ce29da001cf4336bcf8dcb9b299fa4d => generated 293 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:16.723631 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa9fc9-3802-4c33-9201-0924a098937e None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:16.769749 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cac843-7c0c-4b9a-a783-d065de7f7c24 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:16.804727 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:16.807512 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be294c1-074d-484b-ac0f-146e6a089e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:16.808478 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be294c1-074d-484b-ac0f-146e6a089e6b None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:16.808765 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be294c1-074d-484b-ac0f-146e6a089e6b None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:16.809043 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be294c1-074d-484b-ac0f-146e6a089e6b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:16.810236 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be294c1-074d-484b-ac0f-146e6a089e6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:16.811684 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be294c1-074d-484b-ac0f-146e6a089e6b None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:16.815967 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 140/279] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:08:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:16.815967 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be294c1-074d-484b-ac0f-146e6a089e6b None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:16.843397 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa9fc9-3802-4c33-9201-0924a098937e None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:16.846245 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:16.879665 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ec0a3-45fd-4896-a185-9d69bf8bf6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:16.880370 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ec0a3-45fd-4896-a185-9d69bf8bf6d1 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:16.880725 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ec0a3-45fd-4896-a185-9d69bf8bf6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:16.880960 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ec0a3-45fd-4896-a185-9d69bf8bf6d1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:16.891389 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ec0a3-45fd-4896-a185-9d69bf8bf6d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:08:16.899216 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-bc0ec0a3-45fd-4896-a185-9d69bf8bf6d1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 20:08:16.899216 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:16.899216 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:16.899216 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:16.899216 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:16.899216 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:16.899216 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:16.899216 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:16.899216 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:16.899216 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:16.899216 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:16.899216 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:16.899216 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:08:16.899216 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:08:16.899216 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:08:16.899216 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:08:16.900113 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:08:16.900113 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:08:16.900113 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:08:16.900113 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:08:16.900113 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:16.900113 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:16.900113 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:16.900113 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:16.900113 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:16.900113 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:16.900113 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:16.900113 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:16.900113 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:16.900113 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:16.900113 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:16.900113 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:16.900906 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:16.900906 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:16.900906 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:16.900906 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:16.900906 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:08:16.900906 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:08:16.900906 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:08:16.900906 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:08:16.900906 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:08:16.900906 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:08:16.900906 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 20:08:16.900906 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:08:16.900906 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 140/280] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:08:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:16.901545 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ec0a3-45fd-4896-a185-9d69bf8bf6d1 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:16.930977 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be294c1-074d-484b-ac0f-146e6a089e6b None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:16.966037 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71985e7-4efe-4072-9be1-c40a870741a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:16.966695 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71985e7-4efe-4072-9be1-c40a870741a6 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:16.966986 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71985e7-4efe-4072-9be1-c40a870741a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:16.967272 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71985e7-4efe-4072-9be1-c40a870741a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:16.968145 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71985e7-4efe-4072-9be1-c40a870741a6 None admin] RBAC: Adding query filter params (role.id=0e9566d3696545f9b49bdc8a9574577c, user.id=7ce29da001cf4336bcf8dcb9b299fa4d, scope.system=all) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:16.968469 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71985e7-4efe-4072-9be1-c40a870741a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:16.969900 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71985e7-4efe-4072-9be1-c40a870741a6 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:16.974981 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 141/281] 10.222.0.15 () {56 vars in 1308 bytes} [Tue Jun 21 20:08:16 2022] GET /identity/v3/role_assignments?user.id=7ce29da001cf4336bcf8dcb9b299fa4d&scope.system=all&role.id=0e9566d3696545f9b49bdc8a9574577c => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:16.976572 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71985e7-4efe-4072-9be1-c40a870741a6 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:17.028375 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ec0a3-45fd-4896-a185-9d69bf8bf6d1 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:17.073580 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae25c259-a98d-468d-ad83-f2c267fba43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:17.074500 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25c259-a98d-468d-ad83-f2c267fba43e None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:17.074609 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25c259-a98d-468d-ad83-f2c267fba43e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:17.074835 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25c259-a98d-468d-ad83-f2c267fba43e None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:17.075576 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae25c259-a98d-468d-ad83-f2c267fba43e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:17.077121 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae25c259-a98d-468d-ad83-f2c267fba43e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:17.085204 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:17.086442 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:17.098777 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71985e7-4efe-4072-9be1-c40a870741a6 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:17.107961 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 141/282] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Jun 21 20:08:16 2022] POST /identity/v3/users => generated 293 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:08:17.107961 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48858140-b373-4217-84aa-28f25f7ee4ae None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:17.107961 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48858140-b373-4217-84aa-28f25f7ee4ae None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:17.107961 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48858140-b373-4217-84aa-28f25f7ee4ae None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:17.112290 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 142/283] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:08:17.112656 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c206922-841e-4c4e-96d7-80a884a58709 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:17.112954 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c206922-841e-4c4e-96d7-80a884a58709 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:17.113242 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c206922-841e-4c4e-96d7-80a884a58709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:17.133061 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-1c206922-841e-4c4e-96d7-80a884a58709 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:17.134599 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1c206922-841e-4c4e-96d7-80a884a58709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:17.143400 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b274b06-0dad-4967-91ef-819d4f8e73e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:17.144125 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b274b06-0dad-4967-91ef-819d4f8e73e9 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:17.144417 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b274b06-0dad-4967-91ef-819d4f8e73e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:17.144707 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b274b06-0dad-4967-91ef-819d4f8e73e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:17.145483 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b274b06-0dad-4967-91ef-819d4f8e73e9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:17.146041 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b274b06-0dad-4967-91ef-819d4f8e73e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:17.147751 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b274b06-0dad-4967-91ef-819d4f8e73e9 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:17.161116 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 142/284] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Jun 21 20:08:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:17.167476 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b274b06-0dad-4967-91ef-819d4f8e73e9 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:17.229503 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 143/285] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:08:17.258678 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c206922-841e-4c4e-96d7-80a884a58709 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:17.293377 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b274b06-0dad-4967-91ef-819d4f8e73e9 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:17.342323 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2729b8-cfdb-46b6-98c0-872aa408394a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:17.343589 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2729b8-cfdb-46b6-98c0-872aa408394a None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:17.344175 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2729b8-cfdb-46b6-98c0-872aa408394a None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:17.344701 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2729b8-cfdb-46b6-98c0-872aa408394a None admin] PATH_INFO: `/v3/users/6a685df3bb8d4730b19d955a3790edeb` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:17.345982 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2729b8-cfdb-46b6-98c0-872aa408394a None admin] RBAC: Authorizing `identity:get_user(user_id=6a685df3bb8d4730b19d955a3790edeb)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:17.347514 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2729b8-cfdb-46b6-98c0-872aa408394a None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:17.349743 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 143/286] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jun 21 20:08:17 2022] GET /identity/v3/users/6a685df3bb8d4730b19d955a3790edeb => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:08:17.356923 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2729b8-cfdb-46b6-98c0-872aa408394a None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:17.387780 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:17.399571 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c206922-841e-4c4e-96d7-80a884a58709 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:17.422513 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:17.443186 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149aecf0-e1e6-4033-a712-0e12ab697b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:17.444554 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149aecf0-e1e6-4033-a712-0e12ab697b93 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:17.444846 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149aecf0-e1e6-4033-a712-0e12ab697b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:17.445239 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149aecf0-e1e6-4033-a712-0e12ab697b93 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:17.459581 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149aecf0-e1e6-4033-a712-0e12ab697b93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:08:17.467758 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-149aecf0-e1e6-4033-a712-0e12ab697b93 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 20:08:17.467758 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:17.467758 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:17.467758 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:17.467758 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:17.467758 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:17.467758 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:17.467758 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:17.467758 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:17.467758 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:17.467758 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:17.467758 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:17.467758 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:08:17.467758 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:08:17.467758 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:08:17.467758 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:08:17.468689 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:08:17.468689 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:08:17.468689 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:08:17.468689 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:08:17.468689 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:17.468689 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:17.468689 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:17.468689 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:17.468689 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:17.468689 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:17.468689 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:17.468689 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:17.468689 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:17.468689 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:17.468689 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:17.468689 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:17.469497 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:17.469497 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:17.469497 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:17.469497 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:17.469497 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:08:17.469497 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:08:17.469497 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:08:17.469497 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:08:17.469497 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:08:17.469497 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:08:17.469497 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 20:08:17.469497 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:08:17.469497 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 144/287] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:08:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:08:17.474619 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149aecf0-e1e6-4033-a712-0e12ab697b93 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:17.490872 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2729b8-cfdb-46b6-98c0-872aa408394a None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:17.544629 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc71b89d-b57d-4fd2-b63e-71ad1cbef0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:17.545520 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71b89d-b57d-4fd2-b63e-71ad1cbef0ba None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:17.545804 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71b89d-b57d-4fd2-b63e-71ad1cbef0ba None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:17.546076 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71b89d-b57d-4fd2-b63e-71ad1cbef0ba None admin] PATH_INFO: `/v3/projects/54407b3e711b40fd9b6c485b32db95cd` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:17.547291 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc71b89d-b57d-4fd2-b63e-71ad1cbef0ba None admin] RBAC: Authorizing `identity:get_project(project_id=54407b3e711b40fd9b6c485b32db95cd)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:17.548773 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc71b89d-b57d-4fd2-b63e-71ad1cbef0ba None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:17.550487 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 144/288] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jun 21 20:08:17 2022] GET /identity/v3/projects/54407b3e711b40fd9b6c485b32db95cd => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:17.556074 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc71b89d-b57d-4fd2-b63e-71ad1cbef0ba None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:17.595505 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149aecf0-e1e6-4033-a712-0e12ab697b93 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:17.668586 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0caa177-6fd3-420a-b7e5-9b7eade33928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:17.669695 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0caa177-6fd3-420a-b7e5-9b7eade33928 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:17.670181 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0caa177-6fd3-420a-b7e5-9b7eade33928 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:17.670640 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0caa177-6fd3-420a-b7e5-9b7eade33928 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:17.671698 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0caa177-6fd3-420a-b7e5-9b7eade33928 None admin] RBAC: Adding query filter params (name=member) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:17.672225 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0caa177-6fd3-420a-b7e5-9b7eade33928 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:17.673893 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0caa177-6fd3-420a-b7e5-9b7eade33928 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:17.682824 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:17.685079 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 145/289] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Jun 21 20:08:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:08:17.691964 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0caa177-6fd3-420a-b7e5-9b7eade33928 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:17.699077 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc71b89d-b57d-4fd2-b63e-71ad1cbef0ba None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:17.768749 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d50937-4664-47d9-bfb9-86fb0cdcece0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:17.769655 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d50937-4664-47d9-bfb9-86fb0cdcece0 None admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:17.769940 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d50937-4664-47d9-bfb9-86fb0cdcece0 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:17.770218 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d50937-4664-47d9-bfb9-86fb0cdcece0 None admin] PATH_INFO: `/v3/projects/54407b3e711b40fd9b6c485b32db95cd/users/6a685df3bb8d4730b19d955a3790edeb/roles/38547a2f0ca04335b9d13bf66f4f412f` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:17.772914 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d50937-4664-47d9-bfb9-86fb0cdcece0 None admin] RBAC: Authorizing `identity:create_grant(project_id=54407b3e711b40fd9b6c485b32db95cd, user_id=6a685df3bb8d4730b19d955a3790edeb, role_id=38547a2f0ca04335b9d13bf66f4f412f)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:17.774353 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d50937-4664-47d9-bfb9-86fb0cdcece0 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:17.778841 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:17.811350 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 145/290] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Jun 21 20:08:17 2022] PUT /identity/v3/projects/54407b3e711b40fd9b6c485b32db95cd/users/6a685df3bb8d4730b19d955a3790edeb/roles/38547a2f0ca04335b9d13bf66f4f412f => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:08:17.875031 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0caa177-6fd3-420a-b7e5-9b7eade33928 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:17.927373 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2129f491-dc38-4ea6-8d69-1aa92f93783c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:17.928204 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129f491-dc38-4ea6-8d69-1aa92f93783c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:17.929037 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129f491-dc38-4ea6-8d69-1aa92f93783c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:17.929315 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129f491-dc38-4ea6-8d69-1aa92f93783c None admin] PATH_INFO: `/v3/users/9a1b74e72b284ac2940cca82561e9bd4` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:17.933955 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2129f491-dc38-4ea6-8d69-1aa92f93783c None admin] RBAC: Authorizing `identity:get_user(user_id=9a1b74e72b284ac2940cca82561e9bd4)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:17.935445 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2129f491-dc38-4ea6-8d69-1aa92f93783c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:17.937606 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 146/291] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jun 21 20:08:17 2022] GET /identity/v3/users/9a1b74e72b284ac2940cca82561e9bd4 => generated 297 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:08:17.943312 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d50937-4664-47d9-bfb9-86fb0cdcece0 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:18.103802 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d50937-4664-47d9-bfb9-86fb0cdcece0 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:18.141879 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef9b11-11ae-46eb-81ce-4f8dca4982e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:18.142539 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef9b11-11ae-46eb-81ce-4f8dca4982e9 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:18.142823 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef9b11-11ae-46eb-81ce-4f8dca4982e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:18.143099 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef9b11-11ae-46eb-81ce-4f8dca4982e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:18.162577 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:18.219483 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef9b11-11ae-46eb-81ce-4f8dca4982e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:18.220884 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef9b11-11ae-46eb-81ce-4f8dca4982e9 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:18.348418 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 146/292] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:08:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 20:08:18.354185 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2129f491-dc38-4ea6-8d69-1aa92f93783c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:18.483988 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2129f491-dc38-4ea6-8d69-1aa92f93783c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:18.495228 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:18.519521 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cf6b93-3451-48e3-bf28-a2538d6220ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:18.520425 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf6b93-3451-48e3-bf28-a2538d6220ed None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:18.520718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf6b93-3451-48e3-bf28-a2538d6220ed None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:18.521003 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf6b93-3451-48e3-bf28-a2538d6220ed None admin] PATH_INFO: `/v3/projects/54407b3e711b40fd9b6c485b32db95cd` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:18.522237 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cf6b93-3451-48e3-bf28-a2538d6220ed None admin] RBAC: Authorizing `identity:get_project(project_id=54407b3e711b40fd9b6c485b32db95cd)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:18.523692 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cf6b93-3451-48e3-bf28-a2538d6220ed None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:18.525798 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 147/293] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jun 21 20:08:18 2022] GET /identity/v3/projects/54407b3e711b40fd9b6c485b32db95cd => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:18.531400 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef9b11-11ae-46eb-81ce-4f8dca4982e9 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:18.622867 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:18.680332 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef9b11-11ae-46eb-81ce-4f8dca4982e9 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:18.723634 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fcdbae-9540-4221-93ad-c48bc3cc20c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:18.724723 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcdbae-9540-4221-93ad-c48bc3cc20c8 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:18.725769 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcdbae-9540-4221-93ad-c48bc3cc20c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:18.726244 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcdbae-9540-4221-93ad-c48bc3cc20c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:18.727282 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fcdbae-9540-4221-93ad-c48bc3cc20c8 None admin] RBAC: Adding query filter params (role.id=0e9566d3696545f9b49bdc8a9574577c, scope.project.id=54407b3e711b40fd9b6c485b32db95cd, user.id=9a1b74e72b284ac2940cca82561e9bd4) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:18.727808 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fcdbae-9540-4221-93ad-c48bc3cc20c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:18.729482 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fcdbae-9540-4221-93ad-c48bc3cc20c8 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:18.736717 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 147/294] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jun 21 20:08:18 2022] GET /identity/v3/role_assignments?user.id=9a1b74e72b284ac2940cca82561e9bd4&scope.project.id=54407b3e711b40fd9b6c485b32db95cd&role.id=0e9566d3696545f9b49bdc8a9574577c => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:19.379200 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ebc9b0-b54a-42a3-b800-fda0c5c9ff8f None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:19.379730 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ebc9b0-b54a-42a3-b800-fda0c5c9ff8f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:19.379730 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ebc9b0-b54a-42a3-b800-fda0c5c9ff8f None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:19.382058 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 148/295] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:08:19.387906 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09234403-ba82-4a83-b137-1efc48799ff3 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:19.388423 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09234403-ba82-4a83-b137-1efc48799ff3 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:19.388495 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09234403-ba82-4a83-b137-1efc48799ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:19.406448 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-09234403-ba82-4a83-b137-1efc48799ff3 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:19.407627 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-09234403-ba82-4a83-b137-1efc48799ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:19.484126 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 148/296] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:08:19.507020 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ebc9b0-b54a-42a3-b800-fda0c5c9ff8f None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:19.609050 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ebc9b0-b54a-42a3-b800-fda0c5c9ff8f None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:19.643677 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b342313c-a3e1-4c1f-ac66-b3fe050c402c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:19.644437 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342313c-a3e1-4c1f-ac66-b3fe050c402c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:19.644725 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342313c-a3e1-4c1f-ac66-b3fe050c402c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:19.645008 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342313c-a3e1-4c1f-ac66-b3fe050c402c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:19.655887 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b342313c-a3e1-4c1f-ac66-b3fe050c402c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:08:19.664429 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-b342313c-a3e1-4c1f-ac66-b3fe050c402c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 20:08:19.664429 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:19.664429 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:19.664429 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:19.664429 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:19.664429 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:19.664429 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:19.664429 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:19.664429 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:19.664429 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:19.664429 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:19.664429 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:19.664429 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:08:19.664429 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:08:19.664429 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:08:19.664429 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:08:19.665277 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:08:19.665277 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:08:19.665277 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:08:19.665277 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:08:19.665277 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:19.665277 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:19.665277 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:19.665277 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:19.665277 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:19.665277 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:19.665277 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:19.665277 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:19.665277 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:19.665277 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:19.665277 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:19.665277 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:19.666085 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:19.666085 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:19.666085 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:19.666085 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:19.666085 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:08:19.666085 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:08:19.666085 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:08:19.666085 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:08:19.666085 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:08:19.666085 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:08:19.666085 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 20:08:19.666085 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:08:19.666085 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 149/297] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:08:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:19.671806 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09234403-ba82-4a83-b137-1efc48799ff3 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:19.696794 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab56245-06e7-4ddf-9cc3-78fea191f031 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:19.697064 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab56245-06e7-4ddf-9cc3-78fea191f031 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:19.697429 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab56245-06e7-4ddf-9cc3-78fea191f031 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:19.699006 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 150/298] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 20:08:19.703869 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf10da6-9e50-429d-b70c-346b9ed5e75b None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:19.704269 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf10da6-9e50-429d-b70c-346b9ed5e75b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:19.704646 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf10da6-9e50-429d-b70c-346b9ed5e75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:19.723101 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-cdf10da6-9e50-429d-b70c-346b9ed5e75b None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:19.723273 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:19.724440 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-cdf10da6-9e50-429d-b70c-346b9ed5e75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:19.756831 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:19.782963 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09234403-ba82-4a83-b137-1efc48799ff3 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:19.800100 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 151/299] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 20:08:19.800100 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8ba12-8480-4949-a5e9-69d80206bed2 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:19.800100 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8ba12-8480-4949-a5e9-69d80206bed2 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:19.800100 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8ba12-8480-4949-a5e9-69d80206bed2 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:19.800100 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 152/300] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:08:19.805097 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526167b2-acbe-4639-9708-9454fb21c655 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:19.805594 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526167b2-acbe-4639-9708-9454fb21c655 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:19.805854 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526167b2-acbe-4639-9708-9454fb21c655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:19.823108 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6fa070-8430-48a7-b1d0-7d148148c2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:19.823778 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6fa070-8430-48a7-b1d0-7d148148c2d5 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:19.824101 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6fa070-8430-48a7-b1d0-7d148148c2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:19.824379 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6fa070-8430-48a7-b1d0-7d148148c2d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:19.825149 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6fa070-8430-48a7-b1d0-7d148148c2d5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:19.825462 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6fa070-8430-48a7-b1d0-7d148148c2d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:19.826858 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6fa070-8430-48a7-b1d0-7d148148c2d5 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:19.828594 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-526167b2-acbe-4639-9708-9454fb21c655 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:19.830097 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-526167b2-acbe-4639-9708-9454fb21c655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:19.840111 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 149/301] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Jun 21 20:08:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:19.840111 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6fa070-8430-48a7-b1d0-7d148148c2d5 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:19.906828 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 153/302] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 20:08:19.907960 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526167b2-acbe-4639-9708-9454fb21c655 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:19.967066 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6fa070-8430-48a7-b1d0-7d148148c2d5 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:19.975145 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:20.008021 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c190f-35a3-4631-9687-a32e7c4d018e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:20.008845 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c190f-35a3-4631-9687-a32e7c4d018e None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:20.009143 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c190f-35a3-4631-9687-a32e7c4d018e None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:20.009424 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c190f-35a3-4631-9687-a32e7c4d018e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:20.013882 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:20.018233 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526167b2-acbe-4639-9708-9454fb21c655 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:20.020581 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50c190f-35a3-4631-9687-a32e7c4d018e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:08:20.029052 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-c50c190f-35a3-4631-9687-a32e7c4d018e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 20:08:20.029052 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:20.029052 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:20.029052 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:20.029052 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:20.029052 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:20.029052 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:20.029052 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:20.029052 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:20.029052 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:20.029052 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:20.029052 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:20.029052 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:08:20.029052 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:08:20.029052 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:08:20.029052 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:08:20.029965 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:08:20.029965 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:08:20.029965 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:08:20.029965 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:08:20.029965 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:20.029965 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:20.029965 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:20.029965 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:20.029965 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:20.029965 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:20.029965 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:20.029965 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:20.029965 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:20.029965 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:20.029965 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:20.029965 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:20.030751 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:20.030751 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:20.030751 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:20.030751 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:20.030751 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:08:20.030751 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:08:20.030751 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:08:20.030751 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:08:20.030751 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:08:20.030751 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:08:20.030751 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 20:08:20.030751 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:08:20.030751 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 150/303] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:08:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:20.031390 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c190f-35a3-4631-9687-a32e7c4d018e None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:20.058965 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bce49f-7e98-47ec-8e4c-b9199d32c644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:20.059839 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bce49f-7e98-47ec-8e4c-b9199d32c644 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:20.060151 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bce49f-7e98-47ec-8e4c-b9199d32c644 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:20.060512 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bce49f-7e98-47ec-8e4c-b9199d32c644 None admin] PATH_INFO: `/v3/users/7ce29da001cf4336bcf8dcb9b299fa4d` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:20.061627 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bce49f-7e98-47ec-8e4c-b9199d32c644 None admin] RBAC: Authorizing `identity:get_user(user_id=7ce29da001cf4336bcf8dcb9b299fa4d)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:20.063072 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bce49f-7e98-47ec-8e4c-b9199d32c644 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:20.064741 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 154/304] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jun 21 20:08:19 2022] GET /identity/v3/users/7ce29da001cf4336bcf8dcb9b299fa4d => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:20.064741 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bce49f-7e98-47ec-8e4c-b9199d32c644 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:20.141995 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c190f-35a3-4631-9687-a32e7c4d018e None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:20.169762 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bce49f-7e98-47ec-8e4c-b9199d32c644 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:20.174907 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a0c79-503f-4d73-b957-112310a6597f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:20.175707 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a0c79-503f-4d73-b957-112310a6597f None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:20.176017 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a0c79-503f-4d73-b957-112310a6597f None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:20.176308 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a0c79-503f-4d73-b957-112310a6597f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:20.177452 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a0c79-503f-4d73-b957-112310a6597f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:20.179409 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a0c79-503f-4d73-b957-112310a6597f None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:20.181346 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 151/305] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:08:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:20.182175 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a0c79-503f-4d73-b957-112310a6597f None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:20.210729 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f56e270-311b-4311-8f9b-56a204a2b70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:20.211727 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56e270-311b-4311-8f9b-56a204a2b70d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:20.212217 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56e270-311b-4311-8f9b-56a204a2b70d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:20.212491 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56e270-311b-4311-8f9b-56a204a2b70d None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:20.213253 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f56e270-311b-4311-8f9b-56a204a2b70d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:20.213570 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f56e270-311b-4311-8f9b-56a204a2b70d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:20.214950 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f56e270-311b-4311-8f9b-56a204a2b70d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:20.217719 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:20.227868 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 155/306] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Jun 21 20:08:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:20.227868 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f56e270-311b-4311-8f9b-56a204a2b70d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:20.254627 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:20.291598 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a0c79-503f-4d73-b957-112310a6597f None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:20.326291 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df8a323-dd3a-431b-8540-a7209b08062d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:20.326559 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f56e270-311b-4311-8f9b-56a204a2b70d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:20.327161 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df8a323-dd3a-431b-8540-a7209b08062d None admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:20.327450 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df8a323-dd3a-431b-8540-a7209b08062d None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:20.327733 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df8a323-dd3a-431b-8540-a7209b08062d None admin] PATH_INFO: `/v3/system/users/7ce29da001cf4336bcf8dcb9b299fa4d/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:20.329295 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df8a323-dd3a-431b-8540-a7209b08062d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7ce29da001cf4336bcf8dcb9b299fa4d, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:20.330675 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df8a323-dd3a-431b-8540-a7209b08062d None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:20.339587 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 152/307] 10.222.0.15 () {58 vars in 1334 bytes} [Tue Jun 21 20:08:20 2022] PUT /identity/v3/system/users/7ce29da001cf4336bcf8dcb9b299fa4d/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:08:20.340932 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df8a323-dd3a-431b-8540-a7209b08062d None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:20.367351 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10773048-0ead-49fb-b544-6ed108c1ef93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:20.368088 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10773048-0ead-49fb-b544-6ed108c1ef93 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:20.368441 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10773048-0ead-49fb-b544-6ed108c1ef93 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:20.368731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10773048-0ead-49fb-b544-6ed108c1ef93 None admin] PATH_INFO: `/v3/groups` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:20.369531 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10773048-0ead-49fb-b544-6ed108c1ef93 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:20.371117 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10773048-0ead-49fb-b544-6ed108c1ef93 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:20.388984 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 156/308] 10.222.0.15 () {60 vars in 1134 bytes} [Tue Jun 21 20:08:20 2022] POST /identity/v3/groups => generated 229 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:08:20.390171 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba17b6-2409-4fb8-880a-d4ce30fb4318 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:20.390466 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba17b6-2409-4fb8-880a-d4ce30fb4318 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:20.390745 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba17b6-2409-4fb8-880a-d4ce30fb4318 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:20.392564 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 157/309] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:08:20.398034 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ea8b4-89ef-4f23-973a-b1afa7d480d4 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:20.398538 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ea8b4-89ef-4f23-973a-b1afa7d480d4 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:20.398969 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ea8b4-89ef-4f23-973a-b1afa7d480d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:20.419462 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-263ea8b4-89ef-4f23-973a-b1afa7d480d4 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:20.421058 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-263ea8b4-89ef-4f23-973a-b1afa7d480d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:20.500128 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:20.507243 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df8a323-dd3a-431b-8540-a7209b08062d None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:20.510978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 158/310] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:08:20.534695 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ea8b4-89ef-4f23-973a-b1afa7d480d4 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:20.550231 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5111ea-ef9e-4165-b33a-37bad9923acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:20.551128 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5111ea-ef9e-4165-b33a-37bad9923acb None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:20.551418 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5111ea-ef9e-4165-b33a-37bad9923acb None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:20.551701 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5111ea-ef9e-4165-b33a-37bad9923acb None admin] PATH_INFO: `/v3/users/f8dd8995dec3434bb38c40e32dee54bc` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:20.557808 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:20.569521 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5111ea-ef9e-4165-b33a-37bad9923acb None admin] RBAC: Authorizing `identity:get_user(user_id=f8dd8995dec3434bb38c40e32dee54bc)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:20.571835 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5111ea-ef9e-4165-b33a-37bad9923acb None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:20.573427 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 153/311] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jun 21 20:08:20 2022] GET /identity/v3/users/f8dd8995dec3434bb38c40e32dee54bc => generated 293 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:20.578786 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5111ea-ef9e-4165-b33a-37bad9923acb None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:20.666690 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ea8b4-89ef-4f23-973a-b1afa7d480d4 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:20.690131 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5111ea-ef9e-4165-b33a-37bad9923acb None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:20.713644 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226f7ae-fa1e-4262-8673-0f6179f3dc05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:20.714738 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226f7ae-fa1e-4262-8673-0f6179f3dc05 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:20.715032 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226f7ae-fa1e-4262-8673-0f6179f3dc05 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:20.715567 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226f7ae-fa1e-4262-8673-0f6179f3dc05 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:20.728148 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2ba0a-436e-4e7d-b4cc-3fc63575e684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:20.728901 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2ba0a-436e-4e7d-b4cc-3fc63575e684 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:20.729256 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2ba0a-436e-4e7d-b4cc-3fc63575e684 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:20.729599 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2ba0a-436e-4e7d-b4cc-3fc63575e684 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:20.730519 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e2ba0a-436e-4e7d-b4cc-3fc63575e684 None admin] RBAC: Adding query filter params (role.id=38547a2f0ca04335b9d13bf66f4f412f, user.id=f8dd8995dec3434bb38c40e32dee54bc, scope.system=all) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:20.730864 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8226f7ae-fa1e-4262-8673-0f6179f3dc05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:08:20.730971 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e2ba0a-436e-4e7d-b4cc-3fc63575e684 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:20.732447 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e2ba0a-436e-4e7d-b4cc-3fc63575e684 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:20.738509 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 154/312] 10.222.0.15 () {56 vars in 1308 bytes} [Tue Jun 21 20:08:20 2022] GET /identity/v3/role_assignments?user.id=f8dd8995dec3434bb38c40e32dee54bc&scope.system=all&role.id=38547a2f0ca04335b9d13bf66f4f412f => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:08:20.740359 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-8226f7ae-fa1e-4262-8673-0f6179f3dc05 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 20:08:20.740359 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:20.740359 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:20.740359 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:20.740359 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:20.740359 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:20.740359 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:20.740359 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:20.740359 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:20.740359 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:20.740359 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:20.740359 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:20.740359 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:08:20.740359 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:08:20.740359 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:08:20.740359 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:08:20.741815 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:08:20.741815 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:08:20.741815 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:08:20.741815 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:08:20.741815 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:20.741815 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:20.741815 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:20.741815 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:20.741815 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:20.741815 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:20.741815 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:20.741815 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:20.741815 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:20.741815 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:20.741815 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:20.741815 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:20.742912 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:20.742912 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:20.742912 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:20.742912 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:20.742912 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:08:20.742912 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:08:20.742912 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:08:20.742912 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:08:20.742912 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:08:20.742912 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:08:20.742912 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 20:08:20.742912 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:08:20.742912 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 159/313] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:08:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:20.749359 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2ba0a-436e-4e7d-b4cc-3fc63575e684 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:20.776172 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:20.868478 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2ba0a-436e-4e7d-b4cc-3fc63575e684 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:20.906050 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27844bd5-0fe0-4243-aa24-a2739822b8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:20.906733 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27844bd5-0fe0-4243-aa24-a2739822b8b5 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:20.907015 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27844bd5-0fe0-4243-aa24-a2739822b8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:20.907288 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27844bd5-0fe0-4243-aa24-a2739822b8b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:20.908079 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27844bd5-0fe0-4243-aa24-a2739822b8b5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:20.908386 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27844bd5-0fe0-4243-aa24-a2739822b8b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:20.909787 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27844bd5-0fe0-4243-aa24-a2739822b8b5 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:20.920666 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 155/314] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Jun 21 20:08:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:20.925430 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226f7ae-fa1e-4262-8673-0f6179f3dc05 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:21.011806 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:21.035868 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226f7ae-fa1e-4262-8673-0f6179f3dc05 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:21.072006 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b017c5-ff06-4bb5-9c52-48c1e9ca2d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:21.072901 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b017c5-ff06-4bb5-9c52-48c1e9ca2d18 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:21.073188 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b017c5-ff06-4bb5-9c52-48c1e9ca2d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:21.073470 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b017c5-ff06-4bb5-9c52-48c1e9ca2d18 None admin] PATH_INFO: `/v3/users/6a685df3bb8d4730b19d955a3790edeb` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:21.074680 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b017c5-ff06-4bb5-9c52-48c1e9ca2d18 None admin] RBAC: Authorizing `identity:get_user(user_id=6a685df3bb8d4730b19d955a3790edeb)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:21.076163 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b017c5-ff06-4bb5-9c52-48c1e9ca2d18 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:21.078161 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 160/315] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jun 21 20:08:20 2022] GET /identity/v3/users/6a685df3bb8d4730b19d955a3790edeb => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:21.083357 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27844bd5-0fe0-4243-aa24-a2739822b8b5 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:21.168876 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:21.188847 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27844bd5-0fe0-4243-aa24-a2739822b8b5 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:21.228207 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ade28-98e3-4150-bfb3-0988db82dc0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:21.229007 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ade28-98e3-4150-bfb3-0988db82dc0b None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:21.229390 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ade28-98e3-4150-bfb3-0988db82dc0b None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:21.229766 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ade28-98e3-4150-bfb3-0988db82dc0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:21.300074 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ade28-98e3-4150-bfb3-0988db82dc0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:21.301609 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ade28-98e3-4150-bfb3-0988db82dc0b None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:21.382070 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:21.406503 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 156/316] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:08:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 20:08:21.412243 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b017c5-ff06-4bb5-9c52-48c1e9ca2d18 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:21.516087 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b017c5-ff06-4bb5-9c52-48c1e9ca2d18 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:21.552572 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f46ded3-7172-4891-ae3d-685056276d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:21.553922 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f46ded3-7172-4891-ae3d-685056276d79 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:21.554214 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f46ded3-7172-4891-ae3d-685056276d79 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:21.554507 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f46ded3-7172-4891-ae3d-685056276d79 None admin] PATH_INFO: `/v3/projects/54407b3e711b40fd9b6c485b32db95cd` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:21.555694 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f46ded3-7172-4891-ae3d-685056276d79 None admin] RBAC: Authorizing `identity:get_project(project_id=54407b3e711b40fd9b6c485b32db95cd)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:21.557174 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f46ded3-7172-4891-ae3d-685056276d79 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:21.559184 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 161/317] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jun 21 20:08:21 2022] GET /identity/v3/projects/54407b3e711b40fd9b6c485b32db95cd => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:21.564732 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ade28-98e3-4150-bfb3-0988db82dc0b None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:21.675881 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ade28-98e3-4150-bfb3-0988db82dc0b None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:21.710725 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962623d3-c3a0-4c31-a6e6-310ca73bdedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:21.711385 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962623d3-c3a0-4c31-a6e6-310ca73bdedc None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:21.711675 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962623d3-c3a0-4c31-a6e6-310ca73bdedc None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:21.711980 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962623d3-c3a0-4c31-a6e6-310ca73bdedc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:21.712832 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962623d3-c3a0-4c31-a6e6-310ca73bdedc None admin] RBAC: Adding query filter params (role.id=38547a2f0ca04335b9d13bf66f4f412f, scope.project.id=54407b3e711b40fd9b6c485b32db95cd, user.id=6a685df3bb8d4730b19d955a3790edeb) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:21.713151 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962623d3-c3a0-4c31-a6e6-310ca73bdedc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:21.714583 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962623d3-c3a0-4c31-a6e6-310ca73bdedc None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:21.720916 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 157/318] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jun 21 20:08:21 2022] GET /identity/v3/role_assignments?user.id=6a685df3bb8d4730b19d955a3790edeb&scope.project.id=54407b3e711b40fd9b6c485b32db95cd&role.id=38547a2f0ca04335b9d13bf66f4f412f => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:22.473206 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16e276-9fa4-4826-847d-4f4bbae366e8 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:22.473769 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16e276-9fa4-4826-847d-4f4bbae366e8 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:22.473769 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16e276-9fa4-4826-847d-4f4bbae366e8 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:22.475218 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 162/319] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:08:22.480345 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913a207-79ba-4223-bcbb-b4463b65a024 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:22.480645 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913a207-79ba-4223-bcbb-b4463b65a024 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:22.480929 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913a207-79ba-4223-bcbb-b4463b65a024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:22.498176 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-2913a207-79ba-4223-bcbb-b4463b65a024 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:22.499361 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-2913a207-79ba-4223-bcbb-b4463b65a024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:22.541669 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:22.567960 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 158/320] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:08:22.591642 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f16e276-9fa4-4826-847d-4f4bbae366e8 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:22.608213 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:22.617792 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec35d93-b42b-43c3-b63e-1c0ebb01583a None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:22.618091 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec35d93-b42b-43c3-b63e-1c0ebb01583a None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:22.618376 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec35d93-b42b-43c3-b63e-1c0ebb01583a None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:22.619754 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 159/321] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 20:08:22.624621 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb15d2e-9da8-4ba3-8dd2-b9fb13df23a6 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:22.624918 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb15d2e-9da8-4ba3-8dd2-b9fb13df23a6 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:22.625204 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb15d2e-9da8-4ba3-8dd2-b9fb13df23a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:22.643165 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-aeb15d2e-9da8-4ba3-8dd2-b9fb13df23a6 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:22.644751 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-aeb15d2e-9da8-4ba3-8dd2-b9fb13df23a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:22.706819 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f16e276-9fa4-4826-847d-4f4bbae366e8 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:22.713319 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 160/322] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 20:08:22.736287 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb15d2e-9da8-4ba3-8dd2-b9fb13df23a6 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:22.742483 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd11e4a9-8501-4f96-bfd7-1370772f3e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:22.743291 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11e4a9-8501-4f96-bfd7-1370772f3e14 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:22.743632 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11e4a9-8501-4f96-bfd7-1370772f3e14 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:22.743940 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11e4a9-8501-4f96-bfd7-1370772f3e14 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:22.755041 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd11e4a9-8501-4f96-bfd7-1370772f3e14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:08:22.763351 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-bd11e4a9-8501-4f96-bfd7-1370772f3e14 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 20:08:22.763351 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:22.763351 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:22.763351 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:22.763351 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:22.763351 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:22.763351 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:22.763351 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:22.763351 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:22.763351 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:22.763351 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:22.763351 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:22.763351 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:08:22.763351 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:08:22.763351 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:08:22.763351 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:08:22.764370 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:08:22.764370 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:08:22.764370 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:08:22.764370 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:08:22.764370 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:22.764370 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:22.764370 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:22.764370 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:22.764370 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:22.764370 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:22.764370 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:22.764370 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:22.764370 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:22.764370 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:22.764370 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:22.764370 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:22.765170 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:22.765170 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:22.765170 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:22.765170 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:22.765170 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:08:22.765170 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:08:22.765170 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:08:22.765170 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:08:22.765170 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:08:22.765170 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:08:22.765170 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 20:08:22.765170 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:08:22.765170 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 163/323] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:08:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:22.770189 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd11e4a9-8501-4f96-bfd7-1370772f3e14 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:22.837599 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb15d2e-9da8-4ba3-8dd2-b9fb13df23a6 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:22.846094 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:22.848981 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:22.876975 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd11e4a9-8501-4f96-bfd7-1370772f3e14 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:22.877272 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96e84e7-1fb0-469f-a827-56425ab4e830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:22.878068 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e84e7-1fb0-469f-a827-56425ab4e830 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:22.878357 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e84e7-1fb0-469f-a827-56425ab4e830 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:22.878632 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e84e7-1fb0-469f-a827-56425ab4e830 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:22.879786 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96e84e7-1fb0-469f-a827-56425ab4e830 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:22.881304 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96e84e7-1fb0-469f-a827-56425ab4e830 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:22.882920 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 161/324] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:08:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:08:22.884437 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78908839-9958-4fd9-bdee-396abf2c3bfc None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:22.884437 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78908839-9958-4fd9-bdee-396abf2c3bfc None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:22.884651 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78908839-9958-4fd9-bdee-396abf2c3bfc None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:22.885959 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 162/325] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:08:22.888264 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78908839-9958-4fd9-bdee-396abf2c3bfc None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:22.911080 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49556d3d-1a17-4c0a-b77a-9aa4cfce815e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:22.911752 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49556d3d-1a17-4c0a-b77a-9aa4cfce815e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:22.912079 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49556d3d-1a17-4c0a-b77a-9aa4cfce815e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:22.912362 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49556d3d-1a17-4c0a-b77a-9aa4cfce815e None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:22.913631 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49556d3d-1a17-4c0a-b77a-9aa4cfce815e None admin] RBAC: Adding query filter params (name=member) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:22.913945 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49556d3d-1a17-4c0a-b77a-9aa4cfce815e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:22.915314 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49556d3d-1a17-4c0a-b77a-9aa4cfce815e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:22.923166 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 164/326] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Jun 21 20:08:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:08:22.924428 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b8f00-29bc-42fa-b3c9-eaa74f3cb575 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:22.924730 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b8f00-29bc-42fa-b3c9-eaa74f3cb575 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:22.925016 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b8f00-29bc-42fa-b3c9-eaa74f3cb575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:22.941497 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-6c5b8f00-29bc-42fa-b3c9-eaa74f3cb575 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:22.942696 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6c5b8f00-29bc-42fa-b3c9-eaa74f3cb575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:22.986978 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78908839-9958-4fd9-bdee-396abf2c3bfc None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:23.007039 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 165/327] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:08:23.007855 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b8f00-29bc-42fa-b3c9-eaa74f3cb575 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:23.020436 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45085f-206a-4970-9e1c-a1030608728f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:23.021097 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45085f-206a-4970-9e1c-a1030608728f None admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:23.021378 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45085f-206a-4970-9e1c-a1030608728f None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:23.021653 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45085f-206a-4970-9e1c-a1030608728f None admin] PATH_INFO: `/v3/groups` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:23.022341 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d45085f-206a-4970-9e1c-a1030608728f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:23.023762 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d45085f-206a-4970-9e1c-a1030608728f None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:23.038937 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 163/328] 10.222.0.15 () {60 vars in 1134 bytes} [Tue Jun 21 20:08:22 2022] POST /identity/v3/groups => generated 226 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 20:08:23.039569 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45085f-206a-4970-9e1c-a1030608728f None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:23.081845 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:23.085535 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:23.124984 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b8f00-29bc-42fa-b3c9-eaa74f3cb575 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:23.160046 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45085f-206a-4970-9e1c-a1030608728f None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:23.164231 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a16c9-b747-4b62-a0df-e4e487ff817e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:23.165142 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a16c9-b747-4b62-a0df-e4e487ff817e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:23.165429 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a16c9-b747-4b62-a0df-e4e487ff817e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:23.165705 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a16c9-b747-4b62-a0df-e4e487ff817e None admin] PATH_INFO: `/v3/users/7ce29da001cf4336bcf8dcb9b299fa4d` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:23.166951 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7a16c9-b747-4b62-a0df-e4e487ff817e None admin] RBAC: Authorizing `identity:get_user(user_id=7ce29da001cf4336bcf8dcb9b299fa4d)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:23.168473 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7a16c9-b747-4b62-a0df-e4e487ff817e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:23.170208 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 166/329] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jun 21 20:08:23 2022] GET /identity/v3/users/7ce29da001cf4336bcf8dcb9b299fa4d => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:23.176130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a16c9-b747-4b62-a0df-e4e487ff817e None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:23.206239 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6c0a0-b136-4cbe-8f2a-6f932d45fcf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:23.206440 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6c0a0-b136-4cbe-8f2a-6f932d45fcf7 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:23.206953 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6c0a0-b136-4cbe-8f2a-6f932d45fcf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:23.207058 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6c0a0-b136-4cbe-8f2a-6f932d45fcf7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:23.220047 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d6c0a0-b136-4cbe-8f2a-6f932d45fcf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:08:23.229584 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-e9d6c0a0-b136-4cbe-8f2a-6f932d45fcf7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 20:08:23.229584 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:23.229584 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:23.229584 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:23.229584 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:23.229584 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:23.229584 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:23.229584 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:23.229584 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:23.229584 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:23.229584 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:23.229584 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:23.229584 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:08:23.229584 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:08:23.229584 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:08:23.229584 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:08:23.230495 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:08:23.230495 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:08:23.230495 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:08:23.230495 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:08:23.230495 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:23.230495 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:23.230495 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:23.230495 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:23.230495 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:23.230495 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:23.230495 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:23.230495 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:23.230495 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:23.230495 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:23.230495 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:23.230495 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:23.231417 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:23.231417 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:23.231417 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:23.231417 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:23.231417 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:08:23.231417 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:08:23.231417 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:08:23.231417 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:08:23.231417 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:08:23.231417 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:08:23.231417 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 20:08:23.231417 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:08:23.231417 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 164/330] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:08:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:23.239091 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6c0a0-b136-4cbe-8f2a-6f932d45fcf7 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:23.293211 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a16c9-b747-4b62-a0df-e4e487ff817e None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:23.332317 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8225451-1765-479b-8ad2-1120a845c55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:23.333108 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8225451-1765-479b-8ad2-1120a845c55b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:23.333401 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8225451-1765-479b-8ad2-1120a845c55b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:23.333686 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8225451-1765-479b-8ad2-1120a845c55b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:23.335075 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8225451-1765-479b-8ad2-1120a845c55b None admin] RBAC: Adding query filter params (role.id=0e9566d3696545f9b49bdc8a9574577c, user.id=7ce29da001cf4336bcf8dcb9b299fa4d, scope.system=all) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:23.335392 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8225451-1765-479b-8ad2-1120a845c55b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:23.337098 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8225451-1765-479b-8ad2-1120a845c55b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:23.339010 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:23.353788 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 167/331] 10.222.0.15 () {56 vars in 1308 bytes} [Tue Jun 21 20:08:23 2022] GET /identity/v3/role_assignments?user.id=7ce29da001cf4336bcf8dcb9b299fa4d&scope.system=all&role.id=0e9566d3696545f9b49bdc8a9574577c => generated 510 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:08:23.361614 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:23.372342 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6c0a0-b136-4cbe-8f2a-6f932d45fcf7 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:23.413623 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fbeff2-5823-4d8f-af5e-a15e5f9e3c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:23.414431 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fbeff2-5823-4d8f-af5e-a15e5f9e3c80 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:23.414724 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fbeff2-5823-4d8f-af5e-a15e5f9e3c80 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:23.415004 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fbeff2-5823-4d8f-af5e-a15e5f9e3c80 None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:23.415793 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fbeff2-5823-4d8f-af5e-a15e5f9e3c80 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:23.416140 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fbeff2-5823-4d8f-af5e-a15e5f9e3c80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:23.417552 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fbeff2-5823-4d8f-af5e-a15e5f9e3c80 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:23.427682 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 165/332] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Jun 21 20:08:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:23.434157 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8225451-1765-479b-8ad2-1120a845c55b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:23.561262 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8225451-1765-479b-8ad2-1120a845c55b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:23.599520 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d78ceb-4a0e-4bda-8ff1-226aa83ea418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:23.601087 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d78ceb-4a0e-4bda-8ff1-226aa83ea418 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:23.601609 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d78ceb-4a0e-4bda-8ff1-226aa83ea418 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:23.602081 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d78ceb-4a0e-4bda-8ff1-226aa83ea418 None admin] PATH_INFO: `/v3/users/f8dd8995dec3434bb38c40e32dee54bc` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:23.603682 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d78ceb-4a0e-4bda-8ff1-226aa83ea418 None admin] RBAC: Authorizing `identity:get_user(user_id=f8dd8995dec3434bb38c40e32dee54bc)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:23.605307 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d78ceb-4a0e-4bda-8ff1-226aa83ea418 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:23.607272 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 168/333] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jun 21 20:08:23 2022] GET /identity/v3/users/f8dd8995dec3434bb38c40e32dee54bc => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:23.613851 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fbeff2-5823-4d8f-af5e-a15e5f9e3c80 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:23.733340 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fbeff2-5823-4d8f-af5e-a15e5f9e3c80 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:23.773429 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62265a-47ab-4563-bba9-03f5b93855a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:23.774547 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62265a-47ab-4563-bba9-03f5b93855a0 None admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:23.775002 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62265a-47ab-4563-bba9-03f5b93855a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:23.775428 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62265a-47ab-4563-bba9-03f5b93855a0 None admin] PATH_INFO: `/v3/system/users/f8dd8995dec3434bb38c40e32dee54bc/roles/38547a2f0ca04335b9d13bf66f4f412f` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:23.777127 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db62265a-47ab-4563-bba9-03f5b93855a0 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f8dd8995dec3434bb38c40e32dee54bc, role_id=38547a2f0ca04335b9d13bf66f4f412f)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:23.778740 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db62265a-47ab-4563-bba9-03f5b93855a0 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:23.790780 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 166/334] 10.222.0.15 () {58 vars in 1334 bytes} [Tue Jun 21 20:08:23 2022] PUT /identity/v3/system/users/f8dd8995dec3434bb38c40e32dee54bc/roles/38547a2f0ca04335b9d13bf66f4f412f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:08:25.714596 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575def4e-8f9e-4220-8bb5-2299d29ddf50 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:25.715153 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575def4e-8f9e-4220-8bb5-2299d29ddf50 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:25.715454 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575def4e-8f9e-4220-8bb5-2299d29ddf50 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:25.717189 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 169/335] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:08:25.724077 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270029a5-0d4c-49c2-8469-1d36766a6392 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:25.724521 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270029a5-0d4c-49c2-8469-1d36766a6392 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:25.724670 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270029a5-0d4c-49c2-8469-1d36766a6392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:25.748987 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-270029a5-0d4c-49c2-8469-1d36766a6392 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:25.750207 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-270029a5-0d4c-49c2-8469-1d36766a6392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:25.769906 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:25.837193 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 167/336] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:08:25.868655 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575def4e-8f9e-4220-8bb5-2299d29ddf50 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:25.939140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:25.957958 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e8de1-6589-4181-bc61-3592d2c3bb75 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:25.958282 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e8de1-6589-4181-bc61-3592d2c3bb75 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:25.958516 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e8de1-6589-4181-bc61-3592d2c3bb75 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:25.960613 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 168/337] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 20:08:25.967150 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea955999-052b-4029-9582-806ab2ae4c4d None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:25.967382 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea955999-052b-4029-9582-806ab2ae4c4d None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:25.967647 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea955999-052b-4029-9582-806ab2ae4c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:25.991073 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575def4e-8f9e-4220-8bb5-2299d29ddf50 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:26.001951 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-ea955999-052b-4029-9582-806ab2ae4c4d None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:26.003275 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-ea955999-052b-4029-9582-806ab2ae4c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:26.049643 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c788a4f-e9f4-4657-8b6b-6f4c3e3754b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:26.051757 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c788a4f-e9f4-4657-8b6b-6f4c3e3754b8 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:26.055521 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c788a4f-e9f4-4657-8b6b-6f4c3e3754b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:26.060083 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c788a4f-e9f4-4657-8b6b-6f4c3e3754b8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:26.078121 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c788a4f-e9f4-4657-8b6b-6f4c3e3754b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:08:26.087978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-4c788a4f-e9f4-4657-8b6b-6f4c3e3754b8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 20:08:26.087978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:26.087978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:26.087978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:26.087978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:26.087978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:26.087978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:26.087978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:26.087978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:26.087978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:26.087978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:26.087978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:26.087978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:08:26.087978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:08:26.087978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:08:26.087978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:08:26.088886 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:08:26.088886 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:08:26.088886 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:08:26.088886 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:08:26.088886 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:26.088886 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:26.088886 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:26.088886 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:26.088886 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:26.088886 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:26.088886 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:26.088886 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:26.088886 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:26.088886 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:26.088886 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:26.088886 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:26.089671 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:26.089671 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:26.089671 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:26.089671 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:26.089671 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:08:26.089671 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:08:26.089671 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:08:26.089671 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:08:26.089671 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:08:26.089671 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:08:26.089671 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 20:08:26.089671 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:08:26.093932 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 170/338] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Jun 21 20:08:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:26.099458 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c788a4f-e9f4-4657-8b6b-6f4c3e3754b8 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:26.155384 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 169/339] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:08:26.159974 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005a4cf-63d7-4d22-a7f7-35b0247e75f5 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:26.159974 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005a4cf-63d7-4d22-a7f7-35b0247e75f5 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:26.159974 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005a4cf-63d7-4d22-a7f7-35b0247e75f5 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:26.159974 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 170/340] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:08:26.165884 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326ea1c-35bc-420a-b08e-5d76b7a8b5dd None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:26.166171 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326ea1c-35bc-420a-b08e-5d76b7a8b5dd None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:26.166453 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326ea1c-35bc-420a-b08e-5d76b7a8b5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:26.192656 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-f326ea1c-35bc-420a-b08e-5d76b7a8b5dd None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:26.194389 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-f326ea1c-35bc-420a-b08e-5d76b7a8b5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:26.290992 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c788a4f-e9f4-4657-8b6b-6f4c3e3754b8 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:26.313264 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 171/341] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 20:08:26.314200 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f326ea1c-35bc-420a-b08e-5d76b7a8b5dd None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:26.316529 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:26.333407 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:26.334958 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490962c4-9f99-415b-842b-01839cb0ccea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:26.335638 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490962c4-9f99-415b-842b-01839cb0ccea None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:26.335983 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490962c4-9f99-415b-842b-01839cb0ccea None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:26.336235 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490962c4-9f99-415b-842b-01839cb0ccea None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:26.337001 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490962c4-9f99-415b-842b-01839cb0ccea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:26.337311 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490962c4-9f99-415b-842b-01839cb0ccea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:26.338681 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490962c4-9f99-415b-842b-01839cb0ccea None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:26.352746 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 171/342] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jun 21 20:08:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:08:26.355446 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490962c4-9f99-415b-842b-01839cb0ccea None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:26.471518 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490962c4-9f99-415b-842b-01839cb0ccea None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:26.512421 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f607d5-5cb0-4673-b51c-a267aae5f95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:26.513090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f607d5-5cb0-4673-b51c-a267aae5f95e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:26.513379 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f607d5-5cb0-4673-b51c-a267aae5f95e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:26.513663 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f607d5-5cb0-4673-b51c-a267aae5f95e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:26.528783 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f326ea1c-35bc-420a-b08e-5d76b7a8b5dd None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:26.569191 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a548c-680e-4240-acaa-1c043cfd6248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:26.570934 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a548c-680e-4240-acaa-1c043cfd6248 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:26.571673 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a548c-680e-4240-acaa-1c043cfd6248 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:26.572295 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a548c-680e-4240-acaa-1c043cfd6248 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:26.589674 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:26.593787 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a548c-680e-4240-acaa-1c043cfd6248 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:08:26.604742 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-7c3a548c-680e-4240-acaa-1c043cfd6248 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 20:08:26.604742 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:26.604742 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:26.604742 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:26.604742 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:26.604742 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:26.604742 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:26.604742 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:26.604742 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:26.604742 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:26.604742 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:26.604742 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:26.604742 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:08:26.604742 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:08:26.604742 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:08:26.604742 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:08:26.605937 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:08:26.605937 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:08:26.605937 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:08:26.605937 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:08:26.605937 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:26.605937 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:26.605937 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:26.605937 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:26.605937 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:26.605937 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:26.605937 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:26.605937 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:26.605937 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:26.605937 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:26.605937 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:26.605937 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:26.606740 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:26.606740 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:26.606740 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:26.606740 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:26.606740 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:08:26.606740 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:08:26.606740 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:08:26.606740 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:08:26.606740 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:08:26.606740 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:08:26.606740 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 20:08:26.606740 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:08:26.609381 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 172/343] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:08:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:26.611056 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a548c-680e-4240-acaa-1c043cfd6248 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:26.615260 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f607d5-5cb0-4673-b51c-a267aae5f95e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:26.618271 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f607d5-5cb0-4673-b51c-a267aae5f95e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:26.694573 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:26.731242 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a548c-680e-4240-acaa-1c043cfd6248 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:26.747115 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 172/344] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:08:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 21 20:08:26.748492 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58ae3d-c7bb-4f76-aad0-bd0da606b621 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:26.748783 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58ae3d-c7bb-4f76-aad0-bd0da606b621 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:26.749063 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58ae3d-c7bb-4f76-aad0-bd0da606b621 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:26.750519 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 173/345] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:08:26.751717 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd58ae3d-c7bb-4f76-aad0-bd0da606b621 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:26.776496 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7072f7-5f33-48a8-82e9-2878c33f0aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:26.777820 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7072f7-5f33-48a8-82e9-2878c33f0aa9 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:26.778477 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7072f7-5f33-48a8-82e9-2878c33f0aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:26.779089 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7072f7-5f33-48a8-82e9-2878c33f0aa9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:26.793101 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7072f7-5f33-48a8-82e9-2878c33f0aa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:08:26.801764 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-ea7072f7-5f33-48a8-82e9-2878c33f0aa9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 20:08:26.801764 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:26.801764 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:26.801764 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:26.801764 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:26.801764 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:26.801764 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:26.801764 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:26.801764 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:26.801764 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:26.801764 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:26.801764 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:26.801764 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:08:26.801764 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:08:26.801764 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:08:26.801764 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:08:26.802676 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:08:26.802676 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:08:26.802676 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:08:26.802676 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:08:26.802676 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:26.802676 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:26.802676 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:26.802676 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:26.802676 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:26.802676 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:26.802676 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:26.802676 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:26.802676 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:26.802676 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:26.802676 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:26.802676 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:26.804099 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:26.804099 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:26.804099 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:26.804099 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:26.804099 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:08:26.804099 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:08:26.804099 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:08:26.804099 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:08:26.804099 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:08:26.804099 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:08:26.804099 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 20:08:26.804099 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:08:26.806955 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 173/346] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:08:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:26.812569 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f43c13-fa9d-40b7-99d3-e4ee12e6c5ea None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:26.813103 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f43c13-fa9d-40b7-99d3-e4ee12e6c5ea None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:26.813587 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f43c13-fa9d-40b7-99d3-e4ee12e6c5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:26.834012 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-13f43c13-fa9d-40b7-99d3-e4ee12e6c5ea None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:26.837362 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-13f43c13-fa9d-40b7-99d3-e4ee12e6c5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:26.863900 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:26.889495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd58ae3d-c7bb-4f76-aad0-bd0da606b621 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:26.928947 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 174/347] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:08:26.929812 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f43c13-fa9d-40b7-99d3-e4ee12e6c5ea None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:26.939629 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fd16eb-f0ed-4f3e-bdb4-57e569fde032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:26.940674 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd16eb-f0ed-4f3e-bdb4-57e569fde032 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:26.941218 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd16eb-f0ed-4f3e-bdb4-57e569fde032 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:26.941782 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd16eb-f0ed-4f3e-bdb4-57e569fde032 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:26.942736 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fd16eb-f0ed-4f3e-bdb4-57e569fde032 None admin] RBAC: Adding query filter params (name=member) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:26.943299 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fd16eb-f0ed-4f3e-bdb4-57e569fde032 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:26.945675 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fd16eb-f0ed-4f3e-bdb4-57e569fde032 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:26.955460 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 174/348] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Jun 21 20:08:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:26.956576 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fd16eb-f0ed-4f3e-bdb4-57e569fde032 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:27.002771 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:27.057648 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f43c13-fa9d-40b7-99d3-e4ee12e6c5ea None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:27.098897 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fd16eb-f0ed-4f3e-bdb4-57e569fde032 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:27.112696 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa97dcd5-8ea4-4a4d-9eb4-e3624d834ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:27.113681 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa97dcd5-8ea4-4a4d-9eb4-e3624d834ea0 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:27.116195 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa97dcd5-8ea4-4a4d-9eb4-e3624d834ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:27.116195 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa97dcd5-8ea4-4a4d-9eb4-e3624d834ea0 None admin] PATH_INFO: `/v3/projects/54e781b3ce904441a3692659b01df849` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:27.118051 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa97dcd5-8ea4-4a4d-9eb4-e3624d834ea0 None admin] RBAC: Authorizing `identity:get_project(project_id=54e781b3ce904441a3692659b01df849)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:27.120360 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa97dcd5-8ea4-4a4d-9eb4-e3624d834ea0 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:27.123071 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 175/349] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jun 21 20:08:26 2022] GET /identity/v3/projects/54e781b3ce904441a3692659b01df849 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:27.123855 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa97dcd5-8ea4-4a4d-9eb4-e3624d834ea0 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:27.143260 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda1bcb-feb0-437b-80ce-a7a3d8dcd9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:27.144422 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda1bcb-feb0-437b-80ce-a7a3d8dcd9b6 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:27.144913 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda1bcb-feb0-437b-80ce-a7a3d8dcd9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:27.145403 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda1bcb-feb0-437b-80ce-a7a3d8dcd9b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:27.146381 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eda1bcb-feb0-437b-80ce-a7a3d8dcd9b6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:27.147484 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eda1bcb-feb0-437b-80ce-a7a3d8dcd9b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:27.149282 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eda1bcb-feb0-437b-80ce-a7a3d8dcd9b6 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:27.164271 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 175/350] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Jun 21 20:08:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:27.165518 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda1bcb-feb0-437b-80ce-a7a3d8dcd9b6 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:27.175021 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:27.243880 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa97dcd5-8ea4-4a4d-9eb4-e3624d834ea0 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:27.277598 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:27.288667 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c9cba-8ade-44f3-996c-25892a49a619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:27.289884 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c9cba-8ade-44f3-996c-25892a49a619 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:27.290742 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c9cba-8ade-44f3-996c-25892a49a619 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:27.291270 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c9cba-8ade-44f3-996c-25892a49a619 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:27.296513 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda1bcb-feb0-437b-80ce-a7a3d8dcd9b6 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:27.338157 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29100df-39fb-4f66-ad8f-061711883ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:27.338976 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29100df-39fb-4f66-ad8f-061711883ac5 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:27.339263 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29100df-39fb-4f66-ad8f-061711883ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:27.339540 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29100df-39fb-4f66-ad8f-061711883ac5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:27.353615 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29100df-39fb-4f66-ad8f-061711883ac5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:08:27.364414 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-a29100df-39fb-4f66-ad8f-061711883ac5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 20:08:27.364414 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:27.364414 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:27.364414 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:27.364414 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:27.364414 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:27.364414 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:27.364414 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:27.364414 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:27.364414 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:27.364414 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:27.364414 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:27.364414 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:08:27.364414 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:08:27.364414 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:08:27.364414 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:08:27.365306 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:08:27.365306 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:08:27.365306 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:08:27.365306 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:08:27.365306 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:27.365306 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:27.365306 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:27.365306 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:27.365306 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:27.365306 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:27.365306 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:27.365306 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:27.365306 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:27.365306 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:27.365306 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:27.365306 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:27.366147 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:27.366147 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:27.366147 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:27.366147 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:27.366147 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:08:27.366147 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:08:27.366147 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:08:27.366147 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:08:27.366147 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:08:27.366147 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:08:27.366147 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 20:08:27.366147 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:08:27.366147 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 176/351] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:08:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:27.366793 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29100df-39fb-4f66-ad8f-061711883ac5 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:27.380813 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643c9cba-8ade-44f3-996c-25892a49a619 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:27.383247 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643c9cba-8ade-44f3-996c-25892a49a619 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:27.443473 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:27.493498 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29100df-39fb-4f66-ad8f-061711883ac5 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:27.509980 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 176/352] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:08:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 20:08:27.511052 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c9cba-8ade-44f3-996c-25892a49a619 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:27.532659 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a22c0-7165-4058-bf8b-9647127c3c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:27.533646 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a22c0-7165-4058-bf8b-9647127c3c0c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:27.533941 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a22c0-7165-4058-bf8b-9647127c3c0c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:27.534214 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a22c0-7165-4058-bf8b-9647127c3c0c None admin] PATH_INFO: `/v3/groups/4bb296687fec4606bd79935a9f8dcac7` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:27.542363 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a22c0-7165-4058-bf8b-9647127c3c0c None admin] RBAC: Authorizing `identity:get_group(group_id=4bb296687fec4606bd79935a9f8dcac7)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:27.543812 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a22c0-7165-4058-bf8b-9647127c3c0c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:27.545229 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:27.545545 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 177/353] 10.222.0.15 () {56 vars in 1180 bytes} [Tue Jun 21 20:08:27 2022] GET /identity/v3/groups/4bb296687fec4606bd79935a9f8dcac7 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:27.546875 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9654c-a29d-439d-9357-b0f9b0ed1816 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:27.547153 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9654c-a29d-439d-9357-b0f9b0ed1816 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:27.547510 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9654c-a29d-439d-9357-b0f9b0ed1816 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:27.548802 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 178/354] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:08:27.549490 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf9654c-a29d-439d-9357-b0f9b0ed1816 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:27.653637 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c9cba-8ade-44f3-996c-25892a49a619 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:27.676204 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf9654c-a29d-439d-9357-b0f9b0ed1816 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:27.699438 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827583be-7a90-445c-9a00-082ec7763669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:27.700346 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827583be-7a90-445c-9a00-082ec7763669 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:27.700633 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827583be-7a90-445c-9a00-082ec7763669 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:27.700913 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827583be-7a90-445c-9a00-082ec7763669 None admin] PATH_INFO: `/v3/users/f8dd8995dec3434bb38c40e32dee54bc` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:27.702513 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827583be-7a90-445c-9a00-082ec7763669 None admin] RBAC: Authorizing `identity:get_user(user_id=f8dd8995dec3434bb38c40e32dee54bc)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:27.704486 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827583be-7a90-445c-9a00-082ec7763669 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:27.706168 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 177/355] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jun 21 20:08:27 2022] GET /identity/v3/users/f8dd8995dec3434bb38c40e32dee54bc => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:27.707018 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827583be-7a90-445c-9a00-082ec7763669 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:27.707977 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:27.716797 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1736aec0-3ae1-49a9-bd5e-ae5dd24c3e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:27.717478 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1736aec0-3ae1-49a9-bd5e-ae5dd24c3e55 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:27.717768 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1736aec0-3ae1-49a9-bd5e-ae5dd24c3e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:27.718050 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1736aec0-3ae1-49a9-bd5e-ae5dd24c3e55 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:27.718811 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1736aec0-3ae1-49a9-bd5e-ae5dd24c3e55 None admin] RBAC: Adding query filter params (name=member) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:27.719120 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1736aec0-3ae1-49a9-bd5e-ae5dd24c3e55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:27.720908 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1736aec0-3ae1-49a9-bd5e-ae5dd24c3e55 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:27.731487 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 179/356] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Jun 21 20:08:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:27.737314 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1736aec0-3ae1-49a9-bd5e-ae5dd24c3e55 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:27.817503 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:27.824716 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827583be-7a90-445c-9a00-082ec7763669 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:27.868728 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9408d3-5f61-4435-aaf2-62d5865327ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:27.869611 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9408d3-5f61-4435-aaf2-62d5865327ab None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:27.869902 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9408d3-5f61-4435-aaf2-62d5865327ab None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:27.870183 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9408d3-5f61-4435-aaf2-62d5865327ab None admin] PATH_INFO: `/v3/projects/54e781b3ce904441a3692659b01df849` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:27.870279 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1736aec0-3ae1-49a9-bd5e-ae5dd24c3e55 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:27.872721 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9408d3-5f61-4435-aaf2-62d5865327ab None admin] RBAC: Authorizing `identity:get_project(project_id=54e781b3ce904441a3692659b01df849)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:27.874180 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9408d3-5f61-4435-aaf2-62d5865327ab None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:27.875908 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 178/357] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jun 21 20:08:27 2022] GET /identity/v3/projects/54e781b3ce904441a3692659b01df849 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:27.877655 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052886f6-d9c0-42b6-8a2d-898b082bbeae None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:27.877947 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052886f6-d9c0-42b6-8a2d-898b082bbeae None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:27.878230 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052886f6-d9c0-42b6-8a2d-898b082bbeae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:27.895810 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-052886f6-d9c0-42b6-8a2d-898b082bbeae None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:27.897591 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-052886f6-d9c0-42b6-8a2d-898b082bbeae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:27.910629 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127eb691-6aab-42e5-bcb3-e1a2bf05fe5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:27.911224 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127eb691-6aab-42e5-bcb3-e1a2bf05fe5e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:27.911507 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127eb691-6aab-42e5-bcb3-e1a2bf05fe5e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:27.911787 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127eb691-6aab-42e5-bcb3-e1a2bf05fe5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:27.913580 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127eb691-6aab-42e5-bcb3-e1a2bf05fe5e None admin] RBAC: Adding query filter params (group.id=4bb296687fec4606bd79935a9f8dcac7, role.id=141a45d0143342f2ac0eafc233c9b6c3, scope.project.id=54e781b3ce904441a3692659b01df849) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:27.913580 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127eb691-6aab-42e5-bcb3-e1a2bf05fe5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:27.915310 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127eb691-6aab-42e5-bcb3-e1a2bf05fe5e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:27.921016 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 180/358] 10.222.0.15 () {56 vars in 1376 bytes} [Tue Jun 21 20:08:27 2022] GET /identity/v3/role_assignments?group.id=4bb296687fec4606bd79935a9f8dcac7&scope.project.id=54e781b3ce904441a3692659b01df849&role.id=141a45d0143342f2ac0eafc233c9b6c3 => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:27.922097 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468f301-0435-4817-8bf0-f83e092d1363 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:27.922385 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468f301-0435-4817-8bf0-f83e092d1363 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:27.922661 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468f301-0435-4817-8bf0-f83e092d1363 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:27.924079 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 181/359] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:08:27.924664 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3468f301-0435-4817-8bf0-f83e092d1363 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:27.986659 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 179/360] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:08:27.988238 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052886f6-d9c0-42b6-8a2d-898b082bbeae None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:28.003503 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:28.058781 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3468f301-0435-4817-8bf0-f83e092d1363 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:28.105000 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e1b6c-dccf-4057-a1ca-6e5af4e367eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:28.105679 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e1b6c-dccf-4057-a1ca-6e5af4e367eb None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:28.105967 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e1b6c-dccf-4057-a1ca-6e5af4e367eb None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:28.106243 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e1b6c-dccf-4057-a1ca-6e5af4e367eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:28.107087 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e1b6c-dccf-4057-a1ca-6e5af4e367eb None admin] RBAC: Adding query filter params (role.id=38547a2f0ca04335b9d13bf66f4f412f, user.id=f8dd8995dec3434bb38c40e32dee54bc, scope.system=all) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:28.107404 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e1b6c-dccf-4057-a1ca-6e5af4e367eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:28.108211 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:28.108888 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e1b6c-dccf-4057-a1ca-6e5af4e367eb None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:28.115742 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052886f6-d9c0-42b6-8a2d-898b082bbeae None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:28.123359 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 182/361] 10.222.0.15 () {56 vars in 1308 bytes} [Tue Jun 21 20:08:27 2022] GET /identity/v3/role_assignments?user.id=f8dd8995dec3434bb38c40e32dee54bc&scope.system=all&role.id=38547a2f0ca04335b9d13bf66f4f412f => generated 510 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:28.124068 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e1b6c-dccf-4057-a1ca-6e5af4e367eb None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:28.158810 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7902047-e501-4cac-86bb-8879f1e1c44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:28.159498 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7902047-e501-4cac-86bb-8879f1e1c44e None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:28.159783 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7902047-e501-4cac-86bb-8879f1e1c44e None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:28.160146 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7902047-e501-4cac-86bb-8879f1e1c44e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:28.249064 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7902047-e501-4cac-86bb-8879f1e1c44e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:28.250920 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7902047-e501-4cac-86bb-8879f1e1c44e None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:28.262886 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e1b6c-dccf-4057-a1ca-6e5af4e367eb None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:28.284300 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:28.313784 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a18877c-6f5f-40bc-bf02-77713c688eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:28.315071 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18877c-6f5f-40bc-bf02-77713c688eb0 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:28.315071 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18877c-6f5f-40bc-bf02-77713c688eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:28.315260 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18877c-6f5f-40bc-bf02-77713c688eb0 None admin] PATH_INFO: `/v3/groups/4bb296687fec4606bd79935a9f8dcac7` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:28.317960 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a18877c-6f5f-40bc-bf02-77713c688eb0 None admin] RBAC: Authorizing `identity:get_group(group_id=4bb296687fec4606bd79935a9f8dcac7)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:28.320309 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a18877c-6f5f-40bc-bf02-77713c688eb0 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:28.322778 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 183/362] 10.222.0.15 () {56 vars in 1180 bytes} [Tue Jun 21 20:08:28 2022] GET /identity/v3/groups/4bb296687fec4606bd79935a9f8dcac7 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:28.324696 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410b187-f482-4fd5-8246-d623b85f4256 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:28.324696 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410b187-f482-4fd5-8246-d623b85f4256 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:28.324696 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410b187-f482-4fd5-8246-d623b85f4256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:28.345533 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f410b187-f482-4fd5-8246-d623b85f4256 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:28.346724 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f410b187-f482-4fd5-8246-d623b85f4256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:28.373937 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:28.386679 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 180/363] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:08:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 20:08:28.388133 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7902047-e501-4cac-86bb-8879f1e1c44e None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:28.435230 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 184/364] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:08:28.437091 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410b187-f482-4fd5-8246-d623b85f4256 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:28.541675 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7902047-e501-4cac-86bb-8879f1e1c44e None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:28.563427 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410b187-f482-4fd5-8246-d623b85f4256 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:28.581579 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:28.590429 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ee0df-0467-4078-a147-a53bc5f6c207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:28.591260 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ee0df-0467-4078-a147-a53bc5f6c207 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:28.592058 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ee0df-0467-4078-a147-a53bc5f6c207 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:28.592186 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ee0df-0467-4078-a147-a53bc5f6c207 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:28.605645 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70ee0df-0467-4078-a147-a53bc5f6c207 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:08:28.613790 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a40444-e46f-4586-a603-f4301f6cb349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:28.614461 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a40444-e46f-4586-a603-f4301f6cb349 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:28.614747 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a40444-e46f-4586-a603-f4301f6cb349 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:28.615023 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a40444-e46f-4586-a603-f4301f6cb349 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:28.617297 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a40444-e46f-4586-a603-f4301f6cb349 None admin] RBAC: Adding query filter params (group.id=4bb296687fec4606bd79935a9f8dcac7, role.id=0e9566d3696545f9b49bdc8a9574577c, scope.project.id=54e781b3ce904441a3692659b01df849) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:28.617297 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a40444-e46f-4586-a603-f4301f6cb349 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:28.618529 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a40444-e46f-4586-a603-f4301f6cb349 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:28.621323 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-d70ee0df-0467-4078-a147-a53bc5f6c207 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 20:08:28.621323 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:28.621323 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:28.621323 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:28.621323 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:28.621323 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:28.621323 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:28.621323 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:28.621323 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:28.621323 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:28.621323 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:28.621323 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:28.621323 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:08:28.621323 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:08:28.621323 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:08:28.621323 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:08:28.622203 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:08:28.622203 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:08:28.622203 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:08:28.622203 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:08:28.622203 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:28.622203 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:28.622203 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:28.622203 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:28.622203 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:28.622203 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:28.622203 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:28.622203 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:28.622203 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:28.622203 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:28.622203 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:28.622203 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:28.623005 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:28.623005 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:28.623005 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:28.623005 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:28.623005 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:08:28.623005 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:08:28.623005 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:08:28.623005 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:08:28.623005 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:08:28.623005 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:08:28.623005 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 20:08:28.623005 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:08:28.625644 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 185/366] 10.222.0.15 () {56 vars in 1376 bytes} [Tue Jun 21 20:08:28 2022] GET /identity/v3/role_assignments?group.id=4bb296687fec4606bd79935a9f8dcac7&scope.project.id=54e781b3ce904441a3692659b01df849&role.id=0e9566d3696545f9b49bdc8a9574577c => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:28.625644 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a40444-e46f-4586-a603-f4301f6cb349 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:28.625815 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 181/366] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Jun 21 20:08:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:28.629353 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ee0df-0467-4078-a147-a53bc5f6c207 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:28.709841 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:28.769463 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ee0df-0467-4078-a147-a53bc5f6c207 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:28.781787 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a40444-e46f-4586-a603-f4301f6cb349 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:28.812391 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac9f3e6-9921-47a3-8eeb-60239af371b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:28.813281 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9f3e6-9921-47a3-8eeb-60239af371b6 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:28.813672 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9f3e6-9921-47a3-8eeb-60239af371b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:28.814157 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9f3e6-9921-47a3-8eeb-60239af371b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:28.827475 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac9f3e6-9921-47a3-8eeb-60239af371b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:08:28.836445 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-bac9f3e6-9921-47a3-8eeb-60239af371b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 20:08:28.836445 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:28.836445 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:28.836445 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:28.836445 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:28.836445 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:28.836445 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:28.836445 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:28.836445 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:28.836445 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:28.836445 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:28.836445 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:28.836445 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:08:28.836445 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:08:28.836445 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:08:28.836445 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:08:28.837535 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:08:28.837535 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:08:28.837535 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:08:28.837535 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:08:28.837535 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:28.837535 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:28.837535 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:28.837535 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:28.837535 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:28.837535 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:28.837535 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:28.837535 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:28.837535 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:28.837535 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:28.837535 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:28.837535 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:28.838429 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:28.838429 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:28.838429 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:28.838429 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:28.838429 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:08:28.838429 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:08:28.838429 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:08:28.838429 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:08:28.838429 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:08:28.838429 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:08:28.838429 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 20:08:28.838429 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:08:28.840685 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 182/367] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jun 21 20:08:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:28.841638 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac9f3e6-9921-47a3-8eeb-60239af371b6 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:28.841897 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8727f0c0-8f00-46fb-bed3-57bfa257d849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:28.847158 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727f0c0-8f00-46fb-bed3-57bfa257d849 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:28.847158 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727f0c0-8f00-46fb-bed3-57bfa257d849 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:28.847158 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727f0c0-8f00-46fb-bed3-57bfa257d849 None admin] PATH_INFO: `/v3/projects/54407b3e711b40fd9b6c485b32db95cd` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:28.848288 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8727f0c0-8f00-46fb-bed3-57bfa257d849 None admin] RBAC: Authorizing `identity:get_project(project_id=54407b3e711b40fd9b6c485b32db95cd)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:28.850429 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8727f0c0-8f00-46fb-bed3-57bfa257d849 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:28.852854 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 186/368] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jun 21 20:08:28 2022] GET /identity/v3/projects/54407b3e711b40fd9b6c485b32db95cd => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:28.860995 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8727f0c0-8f00-46fb-bed3-57bfa257d849 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:28.914538 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:28.980404 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8727f0c0-8f00-46fb-bed3-57bfa257d849 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:28.985380 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac9f3e6-9921-47a3-8eeb-60239af371b6 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:29.004599 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:29.024360 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51868b10-5fe8-49be-9789-34efe6e57b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:29.025198 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51868b10-5fe8-49be-9789-34efe6e57b51 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:29.025547 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51868b10-5fe8-49be-9789-34efe6e57b51 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:29.027147 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51868b10-5fe8-49be-9789-34efe6e57b51 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:29.027147 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51868b10-5fe8-49be-9789-34efe6e57b51 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:29.027340 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51868b10-5fe8-49be-9789-34efe6e57b51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:29.028970 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51868b10-5fe8-49be-9789-34efe6e57b51 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:29.033504 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc6b2a-538c-4f5e-9cf4-9686724048d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:29.034574 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc6b2a-538c-4f5e-9cf4-9686724048d5 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:29.036393 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc6b2a-538c-4f5e-9cf4-9686724048d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:29.036764 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc6b2a-538c-4f5e-9cf4-9686724048d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:29.038990 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dc6b2a-538c-4f5e-9cf4-9686724048d5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:29.038990 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dc6b2a-538c-4f5e-9cf4-9686724048d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:29.041342 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dc6b2a-538c-4f5e-9cf4-9686724048d5 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:29.045805 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 187/369] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:08:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:29.046910 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51868b10-5fe8-49be-9789-34efe6e57b51 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:29.058151 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 183/370] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jun 21 20:08:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:29.059137 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc6b2a-538c-4f5e-9cf4-9686724048d5 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:29.183091 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc6b2a-538c-4f5e-9cf4-9686724048d5 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:29.187948 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51868b10-5fe8-49be-9789-34efe6e57b51 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:29.197215 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:29.226349 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b368cd-d5cd-4bf3-8fc5-a506d2a4a7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:29.227230 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b368cd-d5cd-4bf3-8fc5-a506d2a4a7cf None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:29.227600 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b368cd-d5cd-4bf3-8fc5-a506d2a4a7cf None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:29.227976 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b368cd-d5cd-4bf3-8fc5-a506d2a4a7cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:29.230638 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba90529-1d4f-466b-aadc-d192754f944b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:29.232724 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba90529-1d4f-466b-aadc-d192754f944b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:29.233221 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba90529-1d4f-466b-aadc-d192754f944b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:29.233723 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba90529-1d4f-466b-aadc-d192754f944b None admin] PATH_INFO: `/v3/groups/4bb296687fec4606bd79935a9f8dcac7` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:29.235365 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba90529-1d4f-466b-aadc-d192754f944b None admin] RBAC: Authorizing `identity:get_group(group_id=4bb296687fec4606bd79935a9f8dcac7)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:29.237234 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba90529-1d4f-466b-aadc-d192754f944b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:29.239530 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 188/371] 10.222.0.15 () {56 vars in 1180 bytes} [Tue Jun 21 20:08:29 2022] GET /identity/v3/groups/4bb296687fec4606bd79935a9f8dcac7 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:29.240935 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba90529-1d4f-466b-aadc-d192754f944b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:29.290856 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:29.320577 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b368cd-d5cd-4bf3-8fc5-a506d2a4a7cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:29.322018 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b368cd-d5cd-4bf3-8fc5-a506d2a4a7cf None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:29.377404 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba90529-1d4f-466b-aadc-d192754f944b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:29.423336 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de1e3d-9727-4879-a418-8934a48c1226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:29.424405 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de1e3d-9727-4879-a418-8934a48c1226 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:29.424698 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de1e3d-9727-4879-a418-8934a48c1226 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:29.424977 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de1e3d-9727-4879-a418-8934a48c1226 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:29.443259 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 184/372] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:08:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 20:08:29.444716 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b368cd-d5cd-4bf3-8fc5-a506d2a4a7cf None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:29.481658 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:29.517939 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de1e3d-9727-4879-a418-8934a48c1226 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:29.520082 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de1e3d-9727-4879-a418-8934a48c1226 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:29.539462 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:29.572338 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b368cd-d5cd-4bf3-8fc5-a506d2a4a7cf None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:29.615256 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf99192e-4776-485f-a12d-12e6a1eb608d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:29.616029 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf99192e-4776-485f-a12d-12e6a1eb608d None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:29.616326 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf99192e-4776-485f-a12d-12e6a1eb608d None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:29.616610 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf99192e-4776-485f-a12d-12e6a1eb608d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:29.617457 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf99192e-4776-485f-a12d-12e6a1eb608d None admin] RBAC: Adding query filter params (group.id=4bb296687fec4606bd79935a9f8dcac7, role.id=0e9566d3696545f9b49bdc8a9574577c, scope.project.id=54407b3e711b40fd9b6c485b32db95cd) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:29.617777 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf99192e-4776-485f-a12d-12e6a1eb608d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:29.619219 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf99192e-4776-485f-a12d-12e6a1eb608d None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:29.625142 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 185/373] 10.222.0.15 () {56 vars in 1376 bytes} [Tue Jun 21 20:08:29 2022] GET /identity/v3/role_assignments?group.id=4bb296687fec4606bd79935a9f8dcac7&scope.project.id=54407b3e711b40fd9b6c485b32db95cd&role.id=0e9566d3696545f9b49bdc8a9574577c => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:29.626037 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf99192e-4776-485f-a12d-12e6a1eb608d None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:29.677427 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 189/374] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:08:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 20:08:29.683351 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de1e3d-9727-4879-a418-8934a48c1226 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:29.814537 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf99192e-4776-485f-a12d-12e6a1eb608d None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:29.856745 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:29.873359 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b7547-a879-4338-8443-ee1da5156806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:29.874271 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b7547-a879-4338-8443-ee1da5156806 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:29.874562 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b7547-a879-4338-8443-ee1da5156806 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:29.874844 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b7547-a879-4338-8443-ee1da5156806 None admin] PATH_INFO: `/v3/projects/ef19f22f6a3d44fc841048b493a62bd9` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:29.876413 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b7547-a879-4338-8443-ee1da5156806 None admin] RBAC: Authorizing `identity:get_project(project_id=ef19f22f6a3d44fc841048b493a62bd9)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:29.877893 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b7547-a879-4338-8443-ee1da5156806 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:29.883448 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 186/375] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jun 21 20:08:29 2022] GET /identity/v3/projects/ef19f22f6a3d44fc841048b493a62bd9 => generated 344 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:29.887818 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b7547-a879-4338-8443-ee1da5156806 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:29.904203 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:29.910783 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de1e3d-9727-4879-a418-8934a48c1226 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:29.954849 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5974694e-c267-46a1-8c3f-9230073dfd9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:29.956186 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974694e-c267-46a1-8c3f-9230073dfd9b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:29.956483 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974694e-c267-46a1-8c3f-9230073dfd9b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:29.956773 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974694e-c267-46a1-8c3f-9230073dfd9b None admin] PATH_INFO: `/v3/projects/54407b3e711b40fd9b6c485b32db95cd` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:29.958279 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5974694e-c267-46a1-8c3f-9230073dfd9b None admin] RBAC: Authorizing `identity:get_project(project_id=54407b3e711b40fd9b6c485b32db95cd)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:29.960077 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5974694e-c267-46a1-8c3f-9230073dfd9b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:29.962765 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 190/376] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jun 21 20:08:29 2022] GET /identity/v3/projects/54407b3e711b40fd9b6c485b32db95cd => generated 302 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:08:29.969041 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5974694e-c267-46a1-8c3f-9230073dfd9b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:30.057520 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b7547-a879-4338-8443-ee1da5156806 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:30.096310 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e502a3-5adb-4b7d-b0ba-d96107f819c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:30.097428 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e502a3-5adb-4b7d-b0ba-d96107f819c0 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:30.097846 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e502a3-5adb-4b7d-b0ba-d96107f819c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:30.098262 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e502a3-5adb-4b7d-b0ba-d96107f819c0 None admin] PATH_INFO: `/v3/groups/c11f965706164876bd4b6ae35e6fab27` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:30.106141 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e502a3-5adb-4b7d-b0ba-d96107f819c0 None admin] RBAC: Authorizing `identity:get_group(group_id=c11f965706164876bd4b6ae35e6fab27)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:30.107834 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e502a3-5adb-4b7d-b0ba-d96107f819c0 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:30.110346 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 187/377] 10.222.0.15 () {56 vars in 1180 bytes} [Tue Jun 21 20:08:29 2022] GET /identity/v3/groups/c11f965706164876bd4b6ae35e6fab27 => generated 229 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:30.117252 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e502a3-5adb-4b7d-b0ba-d96107f819c0 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:30.119265 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5974694e-c267-46a1-8c3f-9230073dfd9b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:30.163054 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afae1e8e-e2e6-49dd-ad12-8d15ca25b3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:30.164318 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae1e8e-e2e6-49dd-ad12-8d15ca25b3ea None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:30.164831 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae1e8e-e2e6-49dd-ad12-8d15ca25b3ea None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:30.165374 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae1e8e-e2e6-49dd-ad12-8d15ca25b3ea None admin] PATH_INFO: `/v3/groups/4bb296687fec4606bd79935a9f8dcac7` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:30.166810 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afae1e8e-e2e6-49dd-ad12-8d15ca25b3ea None admin] RBAC: Authorizing `identity:get_group(group_id=4bb296687fec4606bd79935a9f8dcac7)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:30.168517 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afae1e8e-e2e6-49dd-ad12-8d15ca25b3ea None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:30.170709 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 191/378] 10.222.0.15 () {56 vars in 1180 bytes} [Tue Jun 21 20:08:29 2022] GET /identity/v3/groups/4bb296687fec4606bd79935a9f8dcac7 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:30.176188 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afae1e8e-e2e6-49dd-ad12-8d15ca25b3ea None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:30.199493 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:30.205114 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:30.245450 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e502a3-5adb-4b7d-b0ba-d96107f819c0 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:30.292515 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aa1f26-1429-44bb-9b1c-7be49d45cd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:30.293554 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa1f26-1429-44bb-9b1c-7be49d45cd2f None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:30.294082 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa1f26-1429-44bb-9b1c-7be49d45cd2f None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:30.294585 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa1f26-1429-44bb-9b1c-7be49d45cd2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:30.295632 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aa1f26-1429-44bb-9b1c-7be49d45cd2f None admin] RBAC: Adding query filter params (group.id=c11f965706164876bd4b6ae35e6fab27, role.id=1f5332f48d9e4c2aac866d0d546c94d5, scope.project.id=ef19f22f6a3d44fc841048b493a62bd9) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:30.296182 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aa1f26-1429-44bb-9b1c-7be49d45cd2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:30.297847 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aa1f26-1429-44bb-9b1c-7be49d45cd2f None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:30.313766 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 188/379] 10.222.0.15 () {56 vars in 1376 bytes} [Tue Jun 21 20:08:30 2022] GET /identity/v3/role_assignments?group.id=c11f965706164876bd4b6ae35e6fab27&scope.project.id=ef19f22f6a3d44fc841048b493a62bd9&role.id=1f5332f48d9e4c2aac866d0d546c94d5 => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:08:30.351108 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afae1e8e-e2e6-49dd-ad12-8d15ca25b3ea None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:30.385670 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af493ee1-eb51-4cd0-afc6-bd27ed956ffc None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:30.386327 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af493ee1-eb51-4cd0-afc6-bd27ed956ffc None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:30.386817 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af493ee1-eb51-4cd0-afc6-bd27ed956ffc None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:30.388503 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 189/380] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 20:08:30.394969 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17ff3f-87e4-4a96-9531-701e58fb06bc None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:30.395561 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17ff3f-87e4-4a96-9531-701e58fb06bc None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:30.395667 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b76358-4535-448f-9831-f8b4ada71fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:30.396223 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17ff3f-87e4-4a96-9531-701e58fb06bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:30.396327 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b76358-4535-448f-9831-f8b4ada71fe9 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:30.396607 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b76358-4535-448f-9831-f8b4ada71fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:30.397041 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b76358-4535-448f-9831-f8b4ada71fe9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:30.397780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b76358-4535-448f-9831-f8b4ada71fe9 None admin] RBAC: Adding query filter params (group.id=4bb296687fec4606bd79935a9f8dcac7, role.id=141a45d0143342f2ac0eafc233c9b6c3, scope.project.id=54407b3e711b40fd9b6c485b32db95cd) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:30.398098 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b76358-4535-448f-9831-f8b4ada71fe9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:30.399557 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b76358-4535-448f-9831-f8b4ada71fe9 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:30.406127 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 192/381] 10.222.0.15 () {56 vars in 1376 bytes} [Tue Jun 21 20:08:30 2022] GET /identity/v3/role_assignments?group.id=4bb296687fec4606bd79935a9f8dcac7&scope.project.id=54407b3e711b40fd9b6c485b32db95cd&role.id=141a45d0143342f2ac0eafc233c9b6c3 => generated 260 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:30.422934 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-3f17ff3f-87e4-4a96-9531-701e58fb06bc None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:30.424795 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-3f17ff3f-87e4-4a96-9531-701e58fb06bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:30.516051 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 190/382] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 20:08:30.533542 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b76358-4535-448f-9831-f8b4ada71fe9 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:30.640319 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:30.673301 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b76358-4535-448f-9831-f8b4ada71fe9 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:30.712261 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94b789-0b18-4908-9130-101ee8977adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:30.713090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94b789-0b18-4908-9130-101ee8977adf None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:30.713377 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94b789-0b18-4908-9130-101ee8977adf None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:30.713656 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94b789-0b18-4908-9130-101ee8977adf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:30.726535 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a94b789-0b18-4908-9130-101ee8977adf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:08:30.734675 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-5a94b789-0b18-4908-9130-101ee8977adf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 20:08:30.734675 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:30.734675 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:30.734675 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:30.734675 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:30.734675 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:30.734675 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:30.734675 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:30.734675 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:30.734675 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:30.734675 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:30.734675 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:30.734675 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:08:30.734675 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:08:30.734675 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:08:30.734675 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:08:30.735898 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:08:30.735898 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:08:30.735898 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:08:30.735898 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:08:30.735898 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:30.735898 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:30.735898 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:30.735898 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:30.735898 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:30.735898 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:30.735898 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:30.735898 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:30.735898 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:30.735898 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:30.735898 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:30.735898 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:30.737178 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:30.737178 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:30.737178 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:30.737178 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:30.737178 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:08:30.737178 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:08:30.737178 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:08:30.737178 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:08:30.737178 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:08:30.737178 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:08:30.737178 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 20:08:30.737178 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:08:30.737178 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 193/383] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Jun 21 20:08:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:30.744380 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f17ff3f-87e4-4a96-9531-701e58fb06bc None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:30.816819 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:30.854354 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f17ff3f-87e4-4a96-9531-701e58fb06bc None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:30.890497 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fbbfdd-b021-4019-892f-1eb1ac7735c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:30.891213 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fbbfdd-b021-4019-892f-1eb1ac7735c6 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:30.891425 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fbbfdd-b021-4019-892f-1eb1ac7735c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:30.891711 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fbbfdd-b021-4019-892f-1eb1ac7735c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:30.892498 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fbbfdd-b021-4019-892f-1eb1ac7735c6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:30.892813 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fbbfdd-b021-4019-892f-1eb1ac7735c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:30.894272 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fbbfdd-b021-4019-892f-1eb1ac7735c6 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:30.903411 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 191/384] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jun 21 20:08:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:30.909051 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94b789-0b18-4908-9130-101ee8977adf None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:30.918890 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3d7a7-5a58-4d43-b096-39c138e257c0 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:30.919227 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3d7a7-5a58-4d43-b096-39c138e257c0 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:30.919515 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3d7a7-5a58-4d43-b096-39c138e257c0 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:30.920904 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 192/385] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 20:08:30.925862 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae463da-7686-460f-af11-b715fba0463d None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:30.926155 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae463da-7686-460f-af11-b715fba0463d None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:30.926493 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae463da-7686-460f-af11-b715fba0463d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:30.951390 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-dae463da-7686-460f-af11-b715fba0463d None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:30.952616 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-dae463da-7686-460f-af11-b715fba0463d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:31.083402 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 193/386] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 20:08:31.100586 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94b789-0b18-4908-9130-101ee8977adf None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:31.132599 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae463da-7686-460f-af11-b715fba0463d None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:31.157847 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b8ed4-4ed8-48c8-a3c5-f77fc763c4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:31.159163 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b8ed4-4ed8-48c8-a3c5-f77fc763c4b3 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:31.159649 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b8ed4-4ed8-48c8-a3c5-f77fc763c4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:31.160150 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b8ed4-4ed8-48c8-a3c5-f77fc763c4b3 None admin] PATH_INFO: `/v3/groups/4bb296687fec4606bd79935a9f8dcac7` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:31.161761 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3b8ed4-4ed8-48c8-a3c5-f77fc763c4b3 None admin] RBAC: Authorizing `identity:get_group(group_id=4bb296687fec4606bd79935a9f8dcac7)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:31.163464 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3b8ed4-4ed8-48c8-a3c5-f77fc763c4b3 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:31.165548 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 194/387] 10.222.0.15 () {56 vars in 1180 bytes} [Tue Jun 21 20:08:30 2022] GET /identity/v3/groups/4bb296687fec4606bd79935a9f8dcac7 => generated 226 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:31.175702 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b8ed4-4ed8-48c8-a3c5-f77fc763c4b3 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:31.181993 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:31.199908 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:31.245718 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae463da-7686-460f-af11-b715fba0463d None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:31.287539 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f08206d-9ea3-4393-8b71-fb0b162acd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:31.288653 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08206d-9ea3-4393-8b71-fb0b162acd85 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:31.289100 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08206d-9ea3-4393-8b71-fb0b162acd85 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:31.289526 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08206d-9ea3-4393-8b71-fb0b162acd85 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:31.309325 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f08206d-9ea3-4393-8b71-fb0b162acd85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:08:31.317537 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-7f08206d-9ea3-4393-8b71-fb0b162acd85 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 20:08:31.317537 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:31.317537 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:31.317537 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:31.317537 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:31.317537 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:31.317537 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:31.317537 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:31.317537 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:31.317537 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:31.317537 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:31.317537 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:31.317537 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:08:31.317537 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:08:31.317537 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:08:31.317537 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:08:31.319220 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:08:31.319220 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:08:31.319220 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:08:31.319220 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:08:31.319220 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:31.319220 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:31.319220 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:31.319220 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:31.319220 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:31.319220 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:31.319220 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:31.319220 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:31.319220 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:31.319220 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:31.319220 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:31.319220 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:31.320256 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:31.320256 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:31.320256 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:31.320256 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:31.320256 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:08:31.320256 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:08:31.320256 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:08:31.320256 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:08:31.320256 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:08:31.320256 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:08:31.320256 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 20:08:31.320256 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:08:31.322530 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 194/388] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:08:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:08:31.327828 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f08206d-9ea3-4393-8b71-fb0b162acd85 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:31.436580 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f08206d-9ea3-4393-8b71-fb0b162acd85 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:31.468268 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:31.476517 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646169d7-2278-4360-a6ea-ff666e612f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:31.477587 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646169d7-2278-4360-a6ea-ff666e612f7d None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:31.478061 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646169d7-2278-4360-a6ea-ff666e612f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:31.478509 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646169d7-2278-4360-a6ea-ff666e612f7d None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:31.479442 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646169d7-2278-4360-a6ea-ff666e612f7d None admin] RBAC: Adding query filter params (name=member) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:31.479955 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646169d7-2278-4360-a6ea-ff666e612f7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:31.481630 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646169d7-2278-4360-a6ea-ff666e612f7d None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:31.491754 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 195/389] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Jun 21 20:08:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:08:31.498103 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646169d7-2278-4360-a6ea-ff666e612f7d None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:31.510746 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b8ed4-4ed8-48c8-a3c5-f77fc763c4b3 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:31.581488 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6aa96e-9a24-4a57-ac7f-eb5a121567ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:31.582710 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6aa96e-9a24-4a57-ac7f-eb5a121567ef None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:31.583183 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6aa96e-9a24-4a57-ac7f-eb5a121567ef None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:31.583646 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6aa96e-9a24-4a57-ac7f-eb5a121567ef None admin] PATH_INFO: `/v3/projects/54e781b3ce904441a3692659b01df849` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:31.586140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6aa96e-9a24-4a57-ac7f-eb5a121567ef None admin] RBAC: Authorizing `identity:get_project(project_id=54e781b3ce904441a3692659b01df849)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:31.590262 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6aa96e-9a24-4a57-ac7f-eb5a121567ef None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:31.599095 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 195/390] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jun 21 20:08:31 2022] GET /identity/v3/projects/54e781b3ce904441a3692659b01df849 => generated 298 bytes in 419 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:08:31.602222 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6aa96e-9a24-4a57-ac7f-eb5a121567ef None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:31.689810 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646169d7-2278-4360-a6ea-ff666e612f7d None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:31.724364 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:31.734692 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6aa96e-9a24-4a57-ac7f-eb5a121567ef None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:31.771286 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef36a5e-641e-4d2e-ad41-2005687d40a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:31.772682 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef36a5e-641e-4d2e-ad41-2005687d40a2 None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:31.773153 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef36a5e-641e-4d2e-ad41-2005687d40a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:31.773651 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef36a5e-641e-4d2e-ad41-2005687d40a2 None admin] PATH_INFO: `/v3/projects/54e781b3ce904441a3692659b01df849/groups/4bb296687fec4606bd79935a9f8dcac7/roles/141a45d0143342f2ac0eafc233c9b6c3` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:31.776194 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef36a5e-641e-4d2e-ad41-2005687d40a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=54e781b3ce904441a3692659b01df849, group_id=4bb296687fec4606bd79935a9f8dcac7, role_id=141a45d0143342f2ac0eafc233c9b6c3)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:31.778089 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef36a5e-641e-4d2e-ad41-2005687d40a2 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:31.804303 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 196/391] 10.222.0.15 () {58 vars in 1442 bytes} [Tue Jun 21 20:08:31 2022] PUT /identity/v3/projects/54e781b3ce904441a3692659b01df849/groups/4bb296687fec4606bd79935a9f8dcac7/roles/141a45d0143342f2ac0eafc233c9b6c3 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:08:31.845891 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68abe01-c398-4be9-bb22-d1f701824ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:31.846781 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68abe01-c398-4be9-bb22-d1f701824ce3 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:31.847065 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68abe01-c398-4be9-bb22-d1f701824ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:31.847341 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68abe01-c398-4be9-bb22-d1f701824ce3 None admin] PATH_INFO: `/v3/groups/4bb296687fec4606bd79935a9f8dcac7` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:31.852933 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68abe01-c398-4be9-bb22-d1f701824ce3 None admin] RBAC: Authorizing `identity:get_group(group_id=4bb296687fec4606bd79935a9f8dcac7)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:31.854466 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68abe01-c398-4be9-bb22-d1f701824ce3 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:31.856661 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 196/392] 10.222.0.15 () {56 vars in 1180 bytes} [Tue Jun 21 20:08:31 2022] GET /identity/v3/groups/4bb296687fec4606bd79935a9f8dcac7 => generated 226 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:31.862810 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef36a5e-641e-4d2e-ad41-2005687d40a2 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:32.003457 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef36a5e-641e-4d2e-ad41-2005687d40a2 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:32.034784 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:32.042298 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07834fdd-93ec-4f15-b465-b98b5a557294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:32.043521 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07834fdd-93ec-4f15-b465-b98b5a557294 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:32.044046 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07834fdd-93ec-4f15-b465-b98b5a557294 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:32.044599 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07834fdd-93ec-4f15-b465-b98b5a557294 None admin] PATH_INFO: `/v3/projects/54e781b3ce904441a3692659b01df849` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:32.046057 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07834fdd-93ec-4f15-b465-b98b5a557294 None admin] RBAC: Authorizing `identity:get_project(project_id=54e781b3ce904441a3692659b01df849)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:32.047709 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07834fdd-93ec-4f15-b465-b98b5a557294 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:32.054992 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 197/393] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jun 21 20:08:31 2022] GET /identity/v3/projects/54e781b3ce904441a3692659b01df849 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:32.056613 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68abe01-c398-4be9-bb22-d1f701824ce3 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:32.109428 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:32.163654 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68abe01-c398-4be9-bb22-d1f701824ce3 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:32.199078 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff251e7-74c4-45a2-8ea5-8547c6859b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:32.199911 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff251e7-74c4-45a2-8ea5-8547c6859b4c None admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:32.200229 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff251e7-74c4-45a2-8ea5-8547c6859b4c None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:32.200510 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff251e7-74c4-45a2-8ea5-8547c6859b4c None admin] PATH_INFO: `/v3/projects/54e781b3ce904441a3692659b01df849/groups/4bb296687fec4606bd79935a9f8dcac7/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:32.202486 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff251e7-74c4-45a2-8ea5-8547c6859b4c None admin] RBAC: Authorizing `identity:create_grant(project_id=54e781b3ce904441a3692659b01df849, group_id=4bb296687fec4606bd79935a9f8dcac7, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:32.203951 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff251e7-74c4-45a2-8ea5-8547c6859b4c None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:32.224046 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 197/394] 10.222.0.15 () {58 vars in 1442 bytes} [Tue Jun 21 20:08:32 2022] PUT /identity/v3/projects/54e781b3ce904441a3692659b01df849/groups/4bb296687fec4606bd79935a9f8dcac7/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:08:32.282056 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc622f8f-2d33-47c1-8d48-6ec432406d40 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:32.282573 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc622f8f-2d33-47c1-8d48-6ec432406d40 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:32.282573 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc622f8f-2d33-47c1-8d48-6ec432406d40 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:32.284262 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 198/395] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:08:32.290253 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d729ff-e90e-4362-84f4-f09e52c905f2 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:32.290602 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d729ff-e90e-4362-84f4-f09e52c905f2 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:32.290893 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d729ff-e90e-4362-84f4-f09e52c905f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:32.309313 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-04d729ff-e90e-4362-84f4-f09e52c905f2 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:32.310525 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-04d729ff-e90e-4362-84f4-f09e52c905f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:32.391670 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 198/396] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 20:08:32.407827 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc622f8f-2d33-47c1-8d48-6ec432406d40 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:32.516934 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc622f8f-2d33-47c1-8d48-6ec432406d40 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:32.552323 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae08477-a047-46c9-9a13-3218de4a5740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:32.553608 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae08477-a047-46c9-9a13-3218de4a5740 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:32.553894 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae08477-a047-46c9-9a13-3218de4a5740 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:32.554172 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae08477-a047-46c9-9a13-3218de4a5740 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:32.564734 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae08477-a047-46c9-9a13-3218de4a5740 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:08:32.572535 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-3ae08477-a047-46c9-9a13-3218de4a5740 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 20:08:32.572535 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:32.572535 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:32.572535 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:32.572535 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:32.572535 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:32.572535 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:32.572535 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:32.572535 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:32.572535 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:32.572535 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:32.572535 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:32.572535 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:08:32.572535 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:08:32.572535 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:08:32.572535 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:08:32.573422 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:08:32.573422 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:08:32.573422 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:08:32.573422 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:08:32.573422 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:32.573422 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:32.573422 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:32.573422 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:32.573422 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:32.573422 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:32.573422 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:32.573422 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:32.573422 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:32.573422 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:32.573422 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:32.573422 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:32.574226 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:32.574226 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:32.574226 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:32.574226 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:32.574226 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:08:32.574226 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:08:32.574226 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:08:32.574226 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:08:32.574226 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:08:32.574226 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:08:32.574226 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 20:08:32.574226 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:08:32.578705 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 199/397] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:08:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:32.580146 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d729ff-e90e-4362-84f4-f09e52c905f2 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:32.622461 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:32.704582 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d729ff-e90e-4362-84f4-f09e52c905f2 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:32.747407 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b448721d-49fd-4e6c-8eb3-64db7d7cc492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:32.748128 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448721d-49fd-4e6c-8eb3-64db7d7cc492 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:32.748415 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448721d-49fd-4e6c-8eb3-64db7d7cc492 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:32.748695 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448721d-49fd-4e6c-8eb3-64db7d7cc492 None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:32.749460 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b448721d-49fd-4e6c-8eb3-64db7d7cc492 None admin] RBAC: Adding query filter params (name=member) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:32.749769 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b448721d-49fd-4e6c-8eb3-64db7d7cc492 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:32.751150 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b448721d-49fd-4e6c-8eb3-64db7d7cc492 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:32.764534 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 199/398] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Jun 21 20:08:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:08:32.769940 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae08477-a047-46c9-9a13-3218de4a5740 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:32.817549 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96558043-56a7-4b25-bff7-6242dbcf24f7 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:32.817825 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96558043-56a7-4b25-bff7-6242dbcf24f7 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:32.818036 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96558043-56a7-4b25-bff7-6242dbcf24f7 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:32.819781 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 200/399] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:08:32.824413 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a03b6-cf18-4ce2-b14e-4f974bfc70ca None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:32.824705 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a03b6-cf18-4ce2-b14e-4f974bfc70ca None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:32.824989 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a03b6-cf18-4ce2-b14e-4f974bfc70ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:32.855411 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-a47a03b6-cf18-4ce2-b14e-4f974bfc70ca None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:32.856641 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-a47a03b6-cf18-4ce2-b14e-4f974bfc70ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:32.874686 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:32.934667 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae08477-a047-46c9-9a13-3218de4a5740 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:32.966584 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 201/400] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 20:08:32.968062 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e56a07-47df-4f63-8be2-c2090a8e4749 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:32.968356 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e56a07-47df-4f63-8be2-c2090a8e4749 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:32.968638 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e56a07-47df-4f63-8be2-c2090a8e4749 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:32.970178 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 202/401] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:08:32.980298 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b0324-da3c-4e53-ba4e-438da0b9cc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:32.981288 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b0324-da3c-4e53-ba4e-438da0b9cc3d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:32.981581 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b0324-da3c-4e53-ba4e-438da0b9cc3d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:32.981863 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b0324-da3c-4e53-ba4e-438da0b9cc3d None admin] PATH_INFO: `/v3/groups/4bb296687fec4606bd79935a9f8dcac7` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:32.983062 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9b0324-da3c-4e53-ba4e-438da0b9cc3d None admin] RBAC: Authorizing `identity:get_group(group_id=4bb296687fec4606bd79935a9f8dcac7)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:32.985578 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d696f-2375-4f12-87a1-53da0887910f None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:32.985867 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d696f-2375-4f12-87a1-53da0887910f None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:32.986144 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d696f-2375-4f12-87a1-53da0887910f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:32.987045 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9b0324-da3c-4e53-ba4e-438da0b9cc3d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:32.989600 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 200/402] 10.222.0.15 () {56 vars in 1180 bytes} [Tue Jun 21 20:08:32 2022] GET /identity/v3/groups/4bb296687fec4606bd79935a9f8dcac7 => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:32.994266 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b0324-da3c-4e53-ba4e-438da0b9cc3d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:33.010280 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-ad2d696f-2375-4f12-87a1-53da0887910f None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:33.011521 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-ad2d696f-2375-4f12-87a1-53da0887910f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:33.040050 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:33.104163 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 203/403] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 21 20:08:33.106961 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d696f-2375-4f12-87a1-53da0887910f None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:33.136636 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b0324-da3c-4e53-ba4e-438da0b9cc3d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:33.164477 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:33.174248 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a334b58-aa3f-4029-922a-6383e69830e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:33.175359 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a334b58-aa3f-4029-922a-6383e69830e5 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:33.175833 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a334b58-aa3f-4029-922a-6383e69830e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:33.177202 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a334b58-aa3f-4029-922a-6383e69830e5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:33.188214 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a334b58-aa3f-4029-922a-6383e69830e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:08:33.197250 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-5a334b58-aa3f-4029-922a-6383e69830e5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 20:08:33.197250 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:33.197250 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:33.197250 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:33.197250 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:33.197250 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:33.197250 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:33.197250 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:33.197250 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:33.197250 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:33.197250 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:33.197250 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:33.197250 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:08:33.197250 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:08:33.197250 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:08:33.197250 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:08:33.198103 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:08:33.198103 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:08:33.198103 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:08:33.198103 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:08:33.198103 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:33.198103 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:33.198103 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:33.198103 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:33.198103 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:33.198103 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:33.198103 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:33.198103 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:33.198103 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:33.198103 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:33.198103 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:33.198103 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:33.198900 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:33.198900 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:33.198900 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:33.198900 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:33.198900 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:08:33.198900 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:08:33.198900 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:08:33.198900 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:08:33.198900 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:08:33.198900 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:08:33.198900 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 20:08:33.198900 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:08:33.201683 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 201/404] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Jun 21 20:08:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:08:33.202745 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a334b58-aa3f-4029-922a-6383e69830e5 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:33.229887 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d696f-2375-4f12-87a1-53da0887910f None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:33.266555 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c354272-48d8-4613-88e5-e61281d077f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:33.267441 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c354272-48d8-4613-88e5-e61281d077f6 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:33.267725 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c354272-48d8-4613-88e5-e61281d077f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:33.268028 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c354272-48d8-4613-88e5-e61281d077f6 None admin] PATH_INFO: `/v3/projects/54407b3e711b40fd9b6c485b32db95cd` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:33.269276 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c354272-48d8-4613-88e5-e61281d077f6 None admin] RBAC: Authorizing `identity:get_project(project_id=54407b3e711b40fd9b6c485b32db95cd)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:33.270704 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c354272-48d8-4613-88e5-e61281d077f6 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:33.277630 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 204/405] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jun 21 20:08:33 2022] GET /identity/v3/projects/54407b3e711b40fd9b6c485b32db95cd => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:33.277630 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c354272-48d8-4613-88e5-e61281d077f6 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:33.302646 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:33.316200 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a334b58-aa3f-4029-922a-6383e69830e5 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:33.352433 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b85743-8620-410d-9082-d9676b56eaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:33.353554 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b85743-8620-410d-9082-d9676b56eaeb None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:33.354020 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b85743-8620-410d-9082-d9676b56eaeb None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:33.354530 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b85743-8620-410d-9082-d9676b56eaeb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:33.365537 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b85743-8620-410d-9082-d9676b56eaeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:08:33.373405 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-e9b85743-8620-410d-9082-d9676b56eaeb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 20:08:33.373405 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:33.373405 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:33.373405 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:33.373405 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:33.373405 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:33.373405 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:33.373405 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:33.373405 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:33.373405 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:33.373405 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:33.373405 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:33.373405 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:08:33.373405 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:08:33.373405 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:08:33.373405 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:08:33.374269 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:08:33.374269 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:08:33.374269 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:08:33.374269 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:08:33.374269 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:33.374269 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:33.374269 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:33.374269 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:33.374269 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:33.374269 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:33.374269 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:33.374269 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:33.374269 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:33.374269 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:33.374269 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:33.374269 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:33.375061 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:33.375061 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:33.375061 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:33.375061 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:33.375061 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:08:33.375061 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:08:33.375061 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:08:33.375061 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:08:33.375061 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:08:33.375061 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:08:33.375061 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 20:08:33.375061 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:08:33.377840 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 202/406] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jun 21 20:08:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:33.378366 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c354272-48d8-4613-88e5-e61281d077f6 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:33.378957 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b85743-8620-410d-9082-d9676b56eaeb None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:33.421728 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c59141-18d4-4b57-88f8-32e20536cf1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:33.422404 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c59141-18d4-4b57-88f8-32e20536cf1d None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:33.422689 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c59141-18d4-4b57-88f8-32e20536cf1d None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:33.422968 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c59141-18d4-4b57-88f8-32e20536cf1d None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:33.423723 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c59141-18d4-4b57-88f8-32e20536cf1d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:33.424061 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c59141-18d4-4b57-88f8-32e20536cf1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:33.425432 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c59141-18d4-4b57-88f8-32e20536cf1d None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:33.432164 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:33.434742 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 205/407] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jun 21 20:08:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:33.435542 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c59141-18d4-4b57-88f8-32e20536cf1d None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:33.490661 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b85743-8620-410d-9082-d9676b56eaeb None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:33.526629 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ddf45-7bb0-4fee-b8b6-175f76455ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:33.527909 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ddf45-7bb0-4fee-b8b6-175f76455ed0 None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:33.528396 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ddf45-7bb0-4fee-b8b6-175f76455ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:33.528863 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ddf45-7bb0-4fee-b8b6-175f76455ed0 None admin] PATH_INFO: `/v3/projects/54407b3e711b40fd9b6c485b32db95cd/groups/4bb296687fec4606bd79935a9f8dcac7/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:33.531016 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910ddf45-7bb0-4fee-b8b6-175f76455ed0 None admin] RBAC: Authorizing `identity:create_grant(project_id=54407b3e711b40fd9b6c485b32db95cd, group_id=4bb296687fec4606bd79935a9f8dcac7, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:33.532697 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910ddf45-7bb0-4fee-b8b6-175f76455ed0 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:33.534701 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:33.548537 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c59141-18d4-4b57-88f8-32e20536cf1d None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:33.556167 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 203/408] 10.222.0.15 () {58 vars in 1442 bytes} [Tue Jun 21 20:08:33 2022] PUT /identity/v3/projects/54407b3e711b40fd9b6c485b32db95cd/groups/4bb296687fec4606bd79935a9f8dcac7/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:08:33.556167 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ddf45-7bb0-4fee-b8b6-175f76455ed0 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:33.639951 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff1108-3731-4bb9-bc3b-fd16aa8e8142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:33.640696 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff1108-3731-4bb9-bc3b-fd16aa8e8142 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:33.640986 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff1108-3731-4bb9-bc3b-fd16aa8e8142 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:33.641267 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff1108-3731-4bb9-bc3b-fd16aa8e8142 None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:33.643499 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff1108-3731-4bb9-bc3b-fd16aa8e8142 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:33.643878 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff1108-3731-4bb9-bc3b-fd16aa8e8142 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:33.645331 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff1108-3731-4bb9-bc3b-fd16aa8e8142 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:33.666660 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 206/409] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:08:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:33.677526 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff1108-3731-4bb9-bc3b-fd16aa8e8142 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:33.762773 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ddf45-7bb0-4fee-b8b6-175f76455ed0 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:33.774153 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:33.812420 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae285d-9d5f-4d97-835e-549ea1f109a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:33.813676 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae285d-9d5f-4d97-835e-549ea1f109a8 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:33.814119 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae285d-9d5f-4d97-835e-549ea1f109a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:33.814566 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae285d-9d5f-4d97-835e-549ea1f109a8 None admin] PATH_INFO: `/v3/groups/4bb296687fec4606bd79935a9f8dcac7` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:33.816079 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae285d-9d5f-4d97-835e-549ea1f109a8 None admin] RBAC: Authorizing `identity:get_group(group_id=4bb296687fec4606bd79935a9f8dcac7)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:33.818325 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae285d-9d5f-4d97-835e-549ea1f109a8 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:33.822090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 204/410] 10.222.0.15 () {56 vars in 1180 bytes} [Tue Jun 21 20:08:33 2022] GET /identity/v3/groups/4bb296687fec4606bd79935a9f8dcac7 => generated 226 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:33.827983 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae285d-9d5f-4d97-835e-549ea1f109a8 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:33.830932 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff1108-3731-4bb9-bc3b-fd16aa8e8142 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:33.876058 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013d24d-7ad0-4d4b-bff5-a21377f6656d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:33.877064 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013d24d-7ad0-4d4b-bff5-a21377f6656d None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:33.877487 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013d24d-7ad0-4d4b-bff5-a21377f6656d None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:33.877841 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013d24d-7ad0-4d4b-bff5-a21377f6656d None admin] PATH_INFO: `/v3/groups/c11f965706164876bd4b6ae35e6fab27` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:33.879118 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d013d24d-7ad0-4d4b-bff5-a21377f6656d None admin] RBAC: Authorizing `identity:get_group(group_id=c11f965706164876bd4b6ae35e6fab27)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:33.880688 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d013d24d-7ad0-4d4b-bff5-a21377f6656d None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:33.883314 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 207/411] 10.222.0.15 () {56 vars in 1180 bytes} [Tue Jun 21 20:08:33 2022] GET /identity/v3/groups/c11f965706164876bd4b6ae35e6fab27 => generated 229 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:08:33.888148 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013d24d-7ad0-4d4b-bff5-a21377f6656d None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:33.924358 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:34.013243 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae285d-9d5f-4d97-835e-549ea1f109a8 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:34.076930 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013d24d-7ad0-4d4b-bff5-a21377f6656d None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:34.090361 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0af298-ea61-47dd-8ff1-a79d65a093a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:34.091237 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0af298-ea61-47dd-8ff1-a79d65a093a6 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:34.091521 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0af298-ea61-47dd-8ff1-a79d65a093a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:34.091800 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0af298-ea61-47dd-8ff1-a79d65a093a6 None admin] PATH_INFO: `/v3/projects/54407b3e711b40fd9b6c485b32db95cd` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:34.093035 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0af298-ea61-47dd-8ff1-a79d65a093a6 None admin] RBAC: Authorizing `identity:get_project(project_id=54407b3e711b40fd9b6c485b32db95cd)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:34.094478 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0af298-ea61-47dd-8ff1-a79d65a093a6 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:34.104940 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 205/412] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jun 21 20:08:33 2022] GET /identity/v3/projects/54407b3e711b40fd9b6c485b32db95cd => generated 302 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:34.121282 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0af298-ea61-47dd-8ff1-a79d65a093a6 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:34.151965 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e6e547-2120-4699-86c1-d3e11cfacd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:34.152860 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6e547-2120-4699-86c1-d3e11cfacd85 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:34.153151 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6e547-2120-4699-86c1-d3e11cfacd85 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:34.153430 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6e547-2120-4699-86c1-d3e11cfacd85 None admin] PATH_INFO: `/v3/projects/ef19f22f6a3d44fc841048b493a62bd9` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:34.156802 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e6e547-2120-4699-86c1-d3e11cfacd85 None admin] RBAC: Authorizing `identity:get_project(project_id=ef19f22f6a3d44fc841048b493a62bd9)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:34.158283 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e6e547-2120-4699-86c1-d3e11cfacd85 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:34.160197 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 208/413] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jun 21 20:08:33 2022] GET /identity/v3/projects/ef19f22f6a3d44fc841048b493a62bd9 => generated 344 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:08:34.166969 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e6e547-2120-4699-86c1-d3e11cfacd85 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:34.202640 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:34.288381 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:34.300220 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e6e547-2120-4699-86c1-d3e11cfacd85 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:34.339611 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc1517-072b-4092-947d-5b76d129d17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:34.340537 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc1517-072b-4092-947d-5b76d129d17b None admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:34.340824 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc1517-072b-4092-947d-5b76d129d17b None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:34.341105 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc1517-072b-4092-947d-5b76d129d17b None admin] PATH_INFO: `/v3/projects/ef19f22f6a3d44fc841048b493a62bd9/groups/c11f965706164876bd4b6ae35e6fab27/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:34.343089 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcc1517-072b-4092-947d-5b76d129d17b None admin] RBAC: Authorizing `identity:create_grant(project_id=ef19f22f6a3d44fc841048b493a62bd9, group_id=c11f965706164876bd4b6ae35e6fab27, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:34.344578 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcc1517-072b-4092-947d-5b76d129d17b None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:34.351151 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0af298-ea61-47dd-8ff1-a79d65a093a6 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:34.384811 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 209/414] 10.222.0.15 () {58 vars in 1442 bytes} [Tue Jun 21 20:08:34 2022] PUT /identity/v3/projects/ef19f22f6a3d44fc841048b493a62bd9/groups/c11f965706164876bd4b6ae35e6fab27/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:08:34.394089 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f1ebf-6057-4d0e-9678-2f05f4aeac8d None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:34.394443 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f1ebf-6057-4d0e-9678-2f05f4aeac8d None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:34.394672 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f1ebf-6057-4d0e-9678-2f05f4aeac8d None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:34.397012 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 210/415] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 20:08:34.402667 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8e11e-b3dd-43c8-98d3-5f187c19c621 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:34.402968 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8e11e-b3dd-43c8-98d3-5f187c19c621 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:34.403238 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8e11e-b3dd-43c8-98d3-5f187c19c621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:34.409758 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca1b24-76bb-4cfe-bf43-3775f1ef4986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:34.410683 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca1b24-76bb-4cfe-bf43-3775f1ef4986 None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:34.410972 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca1b24-76bb-4cfe-bf43-3775f1ef4986 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:34.411252 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca1b24-76bb-4cfe-bf43-3775f1ef4986 None admin] PATH_INFO: `/v3/projects/54407b3e711b40fd9b6c485b32db95cd/groups/4bb296687fec4606bd79935a9f8dcac7/roles/141a45d0143342f2ac0eafc233c9b6c3` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:34.418073 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cca1b24-76bb-4cfe-bf43-3775f1ef4986 None admin] RBAC: Authorizing `identity:create_grant(project_id=54407b3e711b40fd9b6c485b32db95cd, group_id=4bb296687fec4606bd79935a9f8dcac7, role_id=141a45d0143342f2ac0eafc233c9b6c3)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:34.419563 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cca1b24-76bb-4cfe-bf43-3775f1ef4986 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:34.422429 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-dcc8e11e-b3dd-43c8-98d3-5f187c19c621 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:34.423680 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-dcc8e11e-b3dd-43c8-98d3-5f187c19c621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:34.455294 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 206/416] 10.222.0.15 () {58 vars in 1442 bytes} [Tue Jun 21 20:08:34 2022] PUT /identity/v3/projects/54407b3e711b40fd9b6c485b32db95cd/groups/4bb296687fec4606bd79935a9f8dcac7/roles/141a45d0143342f2ac0eafc233c9b6c3 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:08:34.506705 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 211/417] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 20:08:34.531183 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca1b24-76bb-4cfe-bf43-3775f1ef4986 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:34.656116 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca1b24-76bb-4cfe-bf43-3775f1ef4986 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:34.657895 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:34.696020 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e5c56-0d7a-4912-84b3-b333e781af7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:34.696851 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e5c56-0d7a-4912-84b3-b333e781af7b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:34.697138 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e5c56-0d7a-4912-84b3-b333e781af7b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:34.697422 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e5c56-0d7a-4912-84b3-b333e781af7b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:34.702603 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1e484-e2e5-4bcc-84dd-4f3277caa14c None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:34.702893 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1e484-e2e5-4bcc-84dd-4f3277caa14c None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:34.703176 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1e484-e2e5-4bcc-84dd-4f3277caa14c None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:34.704839 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 212/418] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:08:34.711243 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e5c56-0d7a-4912-84b3-b333e781af7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:08:34.712315 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2860f1-606f-4fb7-9779-df0410385d0b None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:34.712609 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2860f1-606f-4fb7-9779-df0410385d0b None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:34.712891 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2860f1-606f-4fb7-9779-df0410385d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:34.720121 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-405e5c56-0d7a-4912-84b3-b333e781af7b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 20:08:34.720121 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:34.720121 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:34.720121 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:34.720121 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:34.720121 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:34.720121 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:34.720121 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:34.720121 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:34.720121 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:34.720121 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:34.720121 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:34.720121 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:08:34.720121 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:08:34.720121 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:08:34.720121 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:08:34.721003 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:08:34.721003 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:08:34.721003 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:08:34.721003 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:08:34.721003 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:34.721003 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:34.721003 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:34.721003 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:34.721003 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:34.721003 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:34.721003 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:34.721003 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:34.721003 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:34.721003 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:34.721003 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:34.721003 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:34.721798 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:34.721798 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:34.721798 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:34.721798 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:34.721798 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:08:34.721798 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:08:34.721798 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:08:34.721798 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:08:34.721798 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:08:34.721798 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:08:34.721798 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 20:08:34.721798 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:08:34.721798 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 207/419] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Jun 21 20:08:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:34.727519 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e5c56-0d7a-4912-84b3-b333e781af7b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:34.752932 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-6b2860f1-606f-4fb7-9779-df0410385d0b None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:34.754152 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-6b2860f1-606f-4fb7-9779-df0410385d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:34.867874 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e5c56-0d7a-4912-84b3-b333e781af7b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:34.892819 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 213/420] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:08:34.928621 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a035d25-d0b4-4e2d-9021-da0fd121bb63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:34.929665 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a035d25-d0b4-4e2d-9021-da0fd121bb63 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:34.930147 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a035d25-d0b4-4e2d-9021-da0fd121bb63 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:34.930653 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a035d25-d0b4-4e2d-9021-da0fd121bb63 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:34.931598 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a035d25-d0b4-4e2d-9021-da0fd121bb63 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:34.932126 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a035d25-d0b4-4e2d-9021-da0fd121bb63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:34.933685 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a035d25-d0b4-4e2d-9021-da0fd121bb63 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:34.942814 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 208/421] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jun 21 20:08:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:08:34.948898 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2860f1-606f-4fb7-9779-df0410385d0b None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:34.961431 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:34.965548 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a035d25-d0b4-4e2d-9021-da0fd121bb63 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:35.013832 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:35.099032 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2860f1-606f-4fb7-9779-df0410385d0b None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:35.135742 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3fbec-dfd3-4d00-b275-0c57e409c640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:35.136796 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3fbec-dfd3-4d00-b275-0c57e409c640 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:35.137275 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3fbec-dfd3-4d00-b275-0c57e409c640 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:35.137873 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3fbec-dfd3-4d00-b275-0c57e409c640 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:35.151707 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a035d25-d0b4-4e2d-9021-da0fd121bb63 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:35.208817 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa3fbec-dfd3-4d00-b275-0c57e409c640 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:35.211001 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa3fbec-dfd3-4d00-b275-0c57e409c640 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:35.221363 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d170c339-8c56-40af-95a6-067a3bd25a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:35.221975 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170c339-8c56-40af-95a6-067a3bd25a3c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:35.222264 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170c339-8c56-40af-95a6-067a3bd25a3c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:35.222546 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170c339-8c56-40af-95a6-067a3bd25a3c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:35.228268 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:35.249028 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d170c339-8c56-40af-95a6-067a3bd25a3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:08:35.268835 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-d170c339-8c56-40af-95a6-067a3bd25a3c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 20:08:35.268835 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:35.268835 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:35.268835 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:35.268835 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:35.268835 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:35.268835 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:35.268835 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:35.268835 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:35.268835 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:35.268835 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:35.268835 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:35.268835 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:08:35.268835 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:08:35.268835 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:08:35.268835 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:08:35.269784 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:08:35.269784 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:08:35.269784 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:08:35.269784 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:08:35.269784 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:35.269784 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:35.269784 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:35.269784 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:35.269784 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:35.269784 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:35.269784 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:35.269784 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:35.269784 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:35.269784 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:35.269784 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:35.269784 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:35.270564 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:35.270564 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:35.270564 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:35.270564 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:35.270564 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:08:35.270564 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:08:35.270564 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:08:35.270564 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:08:35.270564 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:08:35.270564 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:08:35.270564 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 20:08:35.270564 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:08:35.270564 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 209/422] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:08:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:35.280827 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d170c339-8c56-40af-95a6-067a3bd25a3c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:35.328361 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 214/423] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:08:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 20:08:35.333687 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3fbec-dfd3-4d00-b275-0c57e409c640 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:35.440206 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3fbec-dfd3-4d00-b275-0c57e409c640 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:35.477836 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:35.492297 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:35.499820 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40038129-9fc1-42ee-b498-2b9be67bf5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:35.501002 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40038129-9fc1-42ee-b498-2b9be67bf5c5 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:35.501591 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40038129-9fc1-42ee-b498-2b9be67bf5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:35.502164 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40038129-9fc1-42ee-b498-2b9be67bf5c5 None admin] PATH_INFO: `/v3/projects/54e781b3ce904441a3692659b01df849` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:35.503588 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40038129-9fc1-42ee-b498-2b9be67bf5c5 None admin] RBAC: Authorizing `identity:get_project(project_id=54e781b3ce904441a3692659b01df849)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:35.505477 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40038129-9fc1-42ee-b498-2b9be67bf5c5 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:35.507832 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 215/424] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jun 21 20:08:35 2022] GET /identity/v3/projects/54e781b3ce904441a3692659b01df849 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:08:35.513380 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40038129-9fc1-42ee-b498-2b9be67bf5c5 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:35.517927 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d170c339-8c56-40af-95a6-067a3bd25a3c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:35.587267 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2496b82-0aee-43d1-93e9-45ae427d9786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:35.587967 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2496b82-0aee-43d1-93e9-45ae427d9786 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:35.588256 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2496b82-0aee-43d1-93e9-45ae427d9786 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:35.588538 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2496b82-0aee-43d1-93e9-45ae427d9786 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:35.589304 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2496b82-0aee-43d1-93e9-45ae427d9786 None admin] RBAC: Adding query filter params (name=member) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:35.589616 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2496b82-0aee-43d1-93e9-45ae427d9786 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:35.591010 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2496b82-0aee-43d1-93e9-45ae427d9786 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:35.600549 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 210/425] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Jun 21 20:08:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:35.605842 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2496b82-0aee-43d1-93e9-45ae427d9786 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:35.719794 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2496b82-0aee-43d1-93e9-45ae427d9786 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:35.727418 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40038129-9fc1-42ee-b498-2b9be67bf5c5 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:35.764756 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46970692-65f4-4bbe-8ccd-97b38adfa5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:35.765351 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46970692-65f4-4bbe-8ccd-97b38adfa5b1 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:35.765639 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46970692-65f4-4bbe-8ccd-97b38adfa5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:35.765918 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46970692-65f4-4bbe-8ccd-97b38adfa5b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:35.801439 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:35.807783 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa8a35-c641-42f2-bd6c-4a6b997ff1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:35.809040 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa8a35-c641-42f2-bd6c-4a6b997ff1c7 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:35.809546 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa8a35-c641-42f2-bd6c-4a6b997ff1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:35.810043 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa8a35-c641-42f2-bd6c-4a6b997ff1c7 None admin] PATH_INFO: `/v3/groups/4bb296687fec4606bd79935a9f8dcac7` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:35.811465 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baa8a35-c641-42f2-bd6c-4a6b997ff1c7 None admin] RBAC: Authorizing `identity:get_group(group_id=4bb296687fec4606bd79935a9f8dcac7)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:35.813217 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baa8a35-c641-42f2-bd6c-4a6b997ff1c7 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:35.815519 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 216/426] 10.222.0.15 () {56 vars in 1180 bytes} [Tue Jun 21 20:08:35 2022] GET /identity/v3/groups/4bb296687fec4606bd79935a9f8dcac7 => generated 226 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:35.823429 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa8a35-c641-42f2-bd6c-4a6b997ff1c7 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:35.869336 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46970692-65f4-4bbe-8ccd-97b38adfa5b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:35.870833 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46970692-65f4-4bbe-8ccd-97b38adfa5b1 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:35.912158 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:36.011513 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa8a35-c641-42f2-bd6c-4a6b997ff1c7 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:36.016682 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 211/427] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:08:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 21 20:08:36.022090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46970692-65f4-4bbe-8ccd-97b38adfa5b1 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:36.051007 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56824e91-3e74-4f5d-800e-fbbeb76700bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:36.051939 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56824e91-3e74-4f5d-800e-fbbeb76700bb None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:36.052373 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56824e91-3e74-4f5d-800e-fbbeb76700bb None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:36.053111 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56824e91-3e74-4f5d-800e-fbbeb76700bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:36.054101 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56824e91-3e74-4f5d-800e-fbbeb76700bb None admin] RBAC: Adding query filter params (group.id=4bb296687fec4606bd79935a9f8dcac7, role.id=141a45d0143342f2ac0eafc233c9b6c3, scope.project.id=54e781b3ce904441a3692659b01df849) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:36.054789 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56824e91-3e74-4f5d-800e-fbbeb76700bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:36.056505 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56824e91-3e74-4f5d-800e-fbbeb76700bb None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:36.063266 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 217/428] 10.222.0.15 () {56 vars in 1376 bytes} [Tue Jun 21 20:08:35 2022] GET /identity/v3/role_assignments?group.id=4bb296687fec4606bd79935a9f8dcac7&scope.project.id=54e781b3ce904441a3692659b01df849&role.id=141a45d0143342f2ac0eafc233c9b6c3 => generated 611 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:36.111656 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db857d5c-8d1f-4ba7-8d93-5927d4d3879f None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:36.112043 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db857d5c-8d1f-4ba7-8d93-5927d4d3879f None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:36.112332 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db857d5c-8d1f-4ba7-8d93-5927d4d3879f None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:36.113964 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 218/429] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:08:36.119279 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b1e9cf-6d97-4335-939b-c5d47bcd921f None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:36.119782 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b1e9cf-6d97-4335-939b-c5d47bcd921f None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:36.120232 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b1e9cf-6d97-4335-939b-c5d47bcd921f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:36.133309 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:36.139430 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-07b1e9cf-6d97-4335-939b-c5d47bcd921f None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:36.140937 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-07b1e9cf-6d97-4335-939b-c5d47bcd921f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:36.239260 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 219/430] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 20:08:36.259536 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46970692-65f4-4bbe-8ccd-97b38adfa5b1 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:36.264617 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b1e9cf-6d97-4335-939b-c5d47bcd921f None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:36.302782 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab37e6-a504-4d8c-bb6a-e5f1dee60cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:36.303739 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab37e6-a504-4d8c-bb6a-e5f1dee60cd2 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:36.304170 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab37e6-a504-4d8c-bb6a-e5f1dee60cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:36.304581 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab37e6-a504-4d8c-bb6a-e5f1dee60cd2 None admin] PATH_INFO: `/v3/projects/54e781b3ce904441a3692659b01df849` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:36.305898 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab37e6-a504-4d8c-bb6a-e5f1dee60cd2 None admin] RBAC: Authorizing `identity:get_project(project_id=54e781b3ce904441a3692659b01df849)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:36.307460 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab37e6-a504-4d8c-bb6a-e5f1dee60cd2 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:36.309601 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 212/431] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jun 21 20:08:36 2022] GET /identity/v3/projects/54e781b3ce904441a3692659b01df849 => generated 298 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:36.313084 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:36.315136 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab37e6-a504-4d8c-bb6a-e5f1dee60cd2 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:36.392483 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b1e9cf-6d97-4335-939b-c5d47bcd921f None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:36.436751 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48930d7-b197-4eb1-bdf4-09642b7987e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:36.436990 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab37e6-a504-4d8c-bb6a-e5f1dee60cd2 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:36.437567 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48930d7-b197-4eb1-bdf4-09642b7987e6 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:36.437857 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48930d7-b197-4eb1-bdf4-09642b7987e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:36.438135 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48930d7-b197-4eb1-bdf4-09642b7987e6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:36.452639 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48930d7-b197-4eb1-bdf4-09642b7987e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:08:36.462293 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-b48930d7-b197-4eb1-bdf4-09642b7987e6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 20:08:36.462293 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:36.462293 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:36.462293 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:36.462293 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:36.462293 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:36.462293 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:36.462293 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:36.462293 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:36.462293 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:36.462293 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:36.462293 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:36.462293 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:08:36.462293 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:08:36.462293 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:08:36.462293 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:08:36.463377 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:08:36.463377 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:08:36.463377 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:08:36.463377 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:08:36.463377 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:36.463377 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:36.463377 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:36.463377 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:36.463377 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:36.463377 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:36.463377 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:36.463377 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:36.463377 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:36.463377 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:36.463377 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:36.463377 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:36.464398 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:36.464398 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:36.464398 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:36.464398 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:36.464398 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:08:36.464398 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:08:36.464398 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:08:36.464398 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:08:36.464398 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:08:36.464398 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:08:36.464398 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 20:08:36.464398 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:08:36.464398 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 220/432] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:08:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:08:36.465801 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:36.471759 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48930d7-b197-4eb1-bdf4-09642b7987e6 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:36.487556 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf23c960-bf5b-4080-a277-0dede29e74b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:36.488923 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23c960-bf5b-4080-a277-0dede29e74b8 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:36.489452 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23c960-bf5b-4080-a277-0dede29e74b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:36.489932 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23c960-bf5b-4080-a277-0dede29e74b8 None admin] PATH_INFO: `/v3/groups/4bb296687fec4606bd79935a9f8dcac7` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:36.491454 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf23c960-bf5b-4080-a277-0dede29e74b8 None admin] RBAC: Authorizing `identity:get_group(group_id=4bb296687fec4606bd79935a9f8dcac7)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:36.493300 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf23c960-bf5b-4080-a277-0dede29e74b8 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:36.495802 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 213/433] 10.222.0.15 () {56 vars in 1180 bytes} [Tue Jun 21 20:08:36 2022] GET /identity/v3/groups/4bb296687fec4606bd79935a9f8dcac7 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:36.501972 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf23c960-bf5b-4080-a277-0dede29e74b8 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:36.588031 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:36.593179 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48930d7-b197-4eb1-bdf4-09642b7987e6 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:36.630609 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf23c960-bf5b-4080-a277-0dede29e74b8 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:36.634113 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654fd3a-161c-46c6-8c53-009711aa176f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:36.635040 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654fd3a-161c-46c6-8c53-009711aa176f None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:36.635529 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654fd3a-161c-46c6-8c53-009711aa176f None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:36.636054 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654fd3a-161c-46c6-8c53-009711aa176f None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:36.637014 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8654fd3a-161c-46c6-8c53-009711aa176f None admin] RBAC: Adding query filter params (name=member) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:36.637542 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8654fd3a-161c-46c6-8c53-009711aa176f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:36.639217 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8654fd3a-161c-46c6-8c53-009711aa176f None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:36.648992 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 221/434] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Jun 21 20:08:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:36.654469 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654fd3a-161c-46c6-8c53-009711aa176f None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:36.673197 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab8afc3-1f78-460f-9035-bb22e3902498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:36.674302 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab8afc3-1f78-460f-9035-bb22e3902498 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:36.674847 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab8afc3-1f78-460f-9035-bb22e3902498 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:36.675324 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab8afc3-1f78-460f-9035-bb22e3902498 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:36.676526 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab8afc3-1f78-460f-9035-bb22e3902498 None admin] RBAC: Adding query filter params (group.id=4bb296687fec4606bd79935a9f8dcac7, role.id=0e9566d3696545f9b49bdc8a9574577c, scope.project.id=54e781b3ce904441a3692659b01df849) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:36.677149 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab8afc3-1f78-460f-9035-bb22e3902498 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:36.679423 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab8afc3-1f78-460f-9035-bb22e3902498 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:36.691948 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 214/435] 10.222.0.15 () {56 vars in 1376 bytes} [Tue Jun 21 20:08:36 2022] GET /identity/v3/role_assignments?group.id=4bb296687fec4606bd79935a9f8dcac7&scope.project.id=54e781b3ce904441a3692659b01df849&role.id=0e9566d3696545f9b49bdc8a9574577c => generated 611 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:36.780745 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654fd3a-161c-46c6-8c53-009711aa176f None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:36.817916 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0649857-9369-4f20-9ff2-6831c1d58c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:36.819146 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0649857-9369-4f20-9ff2-6831c1d58c89 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:36.819437 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0649857-9369-4f20-9ff2-6831c1d58c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:36.819718 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0649857-9369-4f20-9ff2-6831c1d58c89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:36.845275 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703610f8-d9f2-4ce8-aaf9-ff718c1ec34f None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:36.845564 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703610f8-d9f2-4ce8-aaf9-ff718c1ec34f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:36.845760 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703610f8-d9f2-4ce8-aaf9-ff718c1ec34f None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:36.847262 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 215/436] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 20:08:36.852246 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef91354-d5b3-4e7a-a724-cc5f357be67c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:36.852538 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef91354-d5b3-4e7a-a724-cc5f357be67c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:36.852826 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef91354-d5b3-4e7a-a724-cc5f357be67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:36.864644 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:36.880904 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-cef91354-d5b3-4e7a-a724-cc5f357be67c None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:36.882631 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-cef91354-d5b3-4e7a-a724-cc5f357be67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:36.909401 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0649857-9369-4f20-9ff2-6831c1d58c89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:36.910874 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0649857-9369-4f20-9ff2-6831c1d58c89 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:36.936571 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:36.964505 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 216/437] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 20:08:36.966065 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1fc1c-a1a3-43e3-943c-49eca97f331d None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:36.966511 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1fc1c-a1a3-43e3-943c-49eca97f331d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:36.966794 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1fc1c-a1a3-43e3-943c-49eca97f331d None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:36.974264 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 217/438] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:36 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:08:36.981399 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b2df7-28b0-4bc2-8877-81812eaaec28 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:36.981696 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b2df7-28b0-4bc2-8877-81812eaaec28 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:36.981980 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b2df7-28b0-4bc2-8877-81812eaaec28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:37.003147 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-705b2df7-28b0-4bc2-8877-81812eaaec28 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:37.004362 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-705b2df7-28b0-4bc2-8877-81812eaaec28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:37.024802 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 222/439] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:08:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 21 20:08:37.025924 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0649857-9369-4f20-9ff2-6831c1d58c89 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:37.089786 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 218/440] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 20:08:37.090865 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b2df7-28b0-4bc2-8877-81812eaaec28 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:37.101367 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:37.150733 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0649857-9369-4f20-9ff2-6831c1d58c89 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:37.190749 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b81a9-2975-4fcf-ab3c-fd17aebf106a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:37.191546 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b81a9-2975-4fcf-ab3c-fd17aebf106a None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:37.191827 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b81a9-2975-4fcf-ab3c-fd17aebf106a None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:37.192130 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b81a9-2975-4fcf-ab3c-fd17aebf106a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:37.202336 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783b81a9-2975-4fcf-ab3c-fd17aebf106a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:08:37.209957 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-783b81a9-2975-4fcf-ab3c-fd17aebf106a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 20:08:37.209957 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:37.209957 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:37.209957 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:37.209957 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:37.209957 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:37.209957 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:37.209957 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:37.209957 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:37.209957 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:37.209957 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:37.209957 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:37.209957 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:08:37.209957 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:08:37.209957 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:08:37.209957 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:08:37.211036 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:08:37.211036 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:08:37.211036 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:08:37.211036 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:08:37.211036 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:37.211036 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:37.211036 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:37.211036 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:37.211036 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:37.211036 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:37.211036 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:37.211036 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:37.211036 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:37.211036 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:37.211036 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:37.211036 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:37.211877 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:37.211877 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:37.211877 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:37.211877 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:37.211877 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:08:37.211877 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:08:37.211877 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:08:37.211877 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:08:37.211877 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:08:37.211877 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:08:37.211877 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 20:08:37.211877 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:08:37.212620 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b2df7-28b0-4bc2-8877-81812eaaec28 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:37.212704 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 223/441] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jun 21 20:08:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:37.213206 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b81a9-2975-4fcf-ab3c-fd17aebf106a None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:37.220177 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:37.257088 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b5df8b-4ccd-4848-930b-d5c440b81df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:37.257965 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b5df8b-4ccd-4848-930b-d5c440b81df3 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:37.258251 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b5df8b-4ccd-4848-930b-d5c440b81df3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:37.258530 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b5df8b-4ccd-4848-930b-d5c440b81df3 None admin] PATH_INFO: `/v3/projects/54407b3e711b40fd9b6c485b32db95cd` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:37.259714 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b5df8b-4ccd-4848-930b-d5c440b81df3 None admin] RBAC: Authorizing `identity:get_project(project_id=54407b3e711b40fd9b6c485b32db95cd)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:37.261241 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b5df8b-4ccd-4848-930b-d5c440b81df3 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:37.262935 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 219/442] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jun 21 20:08:37 2022] GET /identity/v3/projects/54407b3e711b40fd9b6c485b32db95cd => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:37.263696 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b5df8b-4ccd-4848-930b-d5c440b81df3 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:37.320293 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b81a9-2975-4fcf-ab3c-fd17aebf106a None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:37.339826 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:37.354456 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f03ca-8145-4f35-ac79-01ac46f8cf18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:37.355203 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f03ca-8145-4f35-ac79-01ac46f8cf18 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:37.355486 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f03ca-8145-4f35-ac79-01ac46f8cf18 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:37.355763 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f03ca-8145-4f35-ac79-01ac46f8cf18 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:37.362551 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b5df8b-4ccd-4848-930b-d5c440b81df3 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:37.365922 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976f03ca-8145-4f35-ac79-01ac46f8cf18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:08:37.374003 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-976f03ca-8145-4f35-ac79-01ac46f8cf18 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 20:08:37.374003 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:37.374003 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:37.374003 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:37.374003 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:37.374003 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:37.374003 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:37.374003 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:37.374003 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:37.374003 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:37.374003 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:37.374003 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:37.374003 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:08:37.374003 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:08:37.374003 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:08:37.374003 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:08:37.375114 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:08:37.375114 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:08:37.375114 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:08:37.375114 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:08:37.375114 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:37.375114 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:37.375114 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:37.375114 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:37.375114 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:37.375114 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:37.375114 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:37.375114 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:37.375114 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:37.375114 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:37.375114 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:37.375114 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:37.376137 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:37.376137 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:37.376137 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:37.376137 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:37.376137 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:08:37.376137 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:08:37.376137 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:08:37.376137 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:08:37.376137 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:08:37.376137 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:08:37.376137 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 20:08:37.376137 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:08:37.376137 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 224/443] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Jun 21 20:08:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:37.376926 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f03ca-8145-4f35-ac79-01ac46f8cf18 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:37.398888 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241b65a-34f4-4853-a7fa-ea7c2cfe7f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:37.399556 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241b65a-34f4-4853-a7fa-ea7c2cfe7f25 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:37.399837 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241b65a-34f4-4853-a7fa-ea7c2cfe7f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:37.400149 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241b65a-34f4-4853-a7fa-ea7c2cfe7f25 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:37.400902 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d241b65a-34f4-4853-a7fa-ea7c2cfe7f25 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:37.401213 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d241b65a-34f4-4853-a7fa-ea7c2cfe7f25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:37.402580 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d241b65a-34f4-4853-a7fa-ea7c2cfe7f25 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:37.415315 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 220/444] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:08:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:37.415315 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241b65a-34f4-4853-a7fa-ea7c2cfe7f25 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:37.445835 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:37.479318 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f03ca-8145-4f35-ac79-01ac46f8cf18 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:37.510619 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241b65a-34f4-4853-a7fa-ea7c2cfe7f25 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:37.512326 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867a1f8-e487-4592-8e06-08e33e32b06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:37.513183 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867a1f8-e487-4592-8e06-08e33e32b06d None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:37.513469 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867a1f8-e487-4592-8e06-08e33e32b06d None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:37.513750 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867a1f8-e487-4592-8e06-08e33e32b06d None admin] PATH_INFO: `/v3/groups/4bb296687fec4606bd79935a9f8dcac7` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:37.514916 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6867a1f8-e487-4592-8e06-08e33e32b06d None admin] RBAC: Authorizing `identity:get_group(group_id=4bb296687fec4606bd79935a9f8dcac7)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:37.516386 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6867a1f8-e487-4592-8e06-08e33e32b06d None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:37.517986 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 225/445] 10.222.0.15 () {56 vars in 1180 bytes} [Tue Jun 21 20:08:37 2022] GET /identity/v3/groups/4bb296687fec4606bd79935a9f8dcac7 => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:37.518737 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867a1f8-e487-4592-8e06-08e33e32b06d None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:37.544202 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf15910-c2c2-4d91-977e-f74ad2294449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:37.544897 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf15910-c2c2-4d91-977e-f74ad2294449 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:37.545183 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf15910-c2c2-4d91-977e-f74ad2294449 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:37.545465 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf15910-c2c2-4d91-977e-f74ad2294449 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:37.546215 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf15910-c2c2-4d91-977e-f74ad2294449 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:37.546530 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf15910-c2c2-4d91-977e-f74ad2294449 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:37.547887 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf15910-c2c2-4d91-977e-f74ad2294449 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:37.555570 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 221/446] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jun 21 20:08:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:37.556367 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf15910-c2c2-4d91-977e-f74ad2294449 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:37.567576 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:37.621365 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867a1f8-e487-4592-8e06-08e33e32b06d None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:37.653239 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:37.654063 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ecb00d-28ab-427c-9eba-a49849ce9ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:37.654714 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ecb00d-28ab-427c-9eba-a49849ce9ffd None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:37.655005 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ecb00d-28ab-427c-9eba-a49849ce9ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:37.655286 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ecb00d-28ab-427c-9eba-a49849ce9ffd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:37.657540 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf15910-c2c2-4d91-977e-f74ad2294449 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:37.691258 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71db9e98-9bc5-49a3-8874-fee6ba20caef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:37.691909 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db9e98-9bc5-49a3-8874-fee6ba20caef None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:37.692228 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db9e98-9bc5-49a3-8874-fee6ba20caef None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:37.692511 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db9e98-9bc5-49a3-8874-fee6ba20caef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:37.693874 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71db9e98-9bc5-49a3-8874-fee6ba20caef None admin] RBAC: Adding query filter params (group.id=4bb296687fec4606bd79935a9f8dcac7, role.id=0e9566d3696545f9b49bdc8a9574577c, scope.project.id=54407b3e711b40fd9b6c485b32db95cd) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:37.694194 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71db9e98-9bc5-49a3-8874-fee6ba20caef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:37.695624 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71db9e98-9bc5-49a3-8874-fee6ba20caef None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:37.701623 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 222/447] 10.222.0.15 () {56 vars in 1376 bytes} [Tue Jun 21 20:08:37 2022] GET /identity/v3/role_assignments?group.id=4bb296687fec4606bd79935a9f8dcac7&scope.project.id=54407b3e711b40fd9b6c485b32db95cd&role.id=0e9566d3696545f9b49bdc8a9574577c => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:37.702465 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71db9e98-9bc5-49a3-8874-fee6ba20caef None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:37.724790 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ecb00d-28ab-427c-9eba-a49849ce9ffd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:37.726362 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ecb00d-28ab-427c-9eba-a49849ce9ffd None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:37.781360 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:37.827043 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71db9e98-9bc5-49a3-8874-fee6ba20caef None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:37.843739 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 226/448] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:08:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 20:08:37.849220 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ecb00d-28ab-427c-9eba-a49849ce9ffd None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:37.871520 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc7a078-a5ca-4075-b71c-2833c7231b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:37.872268 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc7a078-a5ca-4075-b71c-2833c7231b0b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:37.872556 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc7a078-a5ca-4075-b71c-2833c7231b0b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:37.872838 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc7a078-a5ca-4075-b71c-2833c7231b0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:37.909813 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:37.956393 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc7a078-a5ca-4075-b71c-2833c7231b0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:37.958093 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc7a078-a5ca-4075-b71c-2833c7231b0b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:37.974800 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ecb00d-28ab-427c-9eba-a49849ce9ffd None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:38.014380 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7646e-297d-410d-a155-13bb9f198d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:38.015260 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7646e-297d-410d-a155-13bb9f198d70 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:38.015546 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7646e-297d-410d-a155-13bb9f198d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:38.015825 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7646e-297d-410d-a155-13bb9f198d70 None admin] PATH_INFO: `/v3/projects/ef19f22f6a3d44fc841048b493a62bd9` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:38.017066 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f7646e-297d-410d-a155-13bb9f198d70 None admin] RBAC: Authorizing `identity:get_project(project_id=ef19f22f6a3d44fc841048b493a62bd9)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:38.018517 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f7646e-297d-410d-a155-13bb9f198d70 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:38.023976 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 227/449] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jun 21 20:08:37 2022] GET /identity/v3/projects/ef19f22f6a3d44fc841048b493a62bd9 => generated 344 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:08:38.026217 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7646e-297d-410d-a155-13bb9f198d70 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:38.052212 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:38.079226 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 223/450] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:08:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 20:08:38.084716 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc7a078-a5ca-4075-b71c-2833c7231b0b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:38.136765 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7646e-297d-410d-a155-13bb9f198d70 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:38.143185 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:38.169910 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be637565-3b1b-49e0-9c08-2ae09bf023e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:38.170766 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be637565-3b1b-49e0-9c08-2ae09bf023e5 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:38.171053 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be637565-3b1b-49e0-9c08-2ae09bf023e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:38.171335 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be637565-3b1b-49e0-9c08-2ae09bf023e5 None admin] PATH_INFO: `/v3/groups/c11f965706164876bd4b6ae35e6fab27` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:38.172532 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be637565-3b1b-49e0-9c08-2ae09bf023e5 None admin] RBAC: Authorizing `identity:get_group(group_id=c11f965706164876bd4b6ae35e6fab27)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:38.174343 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be637565-3b1b-49e0-9c08-2ae09bf023e5 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:38.182255 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 228/451] 10.222.0.15 () {56 vars in 1180 bytes} [Tue Jun 21 20:08:38 2022] GET /identity/v3/groups/c11f965706164876bd4b6ae35e6fab27 => generated 229 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:08:38.182395 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc7a078-a5ca-4075-b71c-2833c7231b0b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:38.183265 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be637565-3b1b-49e0-9c08-2ae09bf023e5 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:38.215875 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e828f88-869a-48b9-b389-cce235f8fdad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:38.216758 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e828f88-869a-48b9-b389-cce235f8fdad None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:38.217038 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e828f88-869a-48b9-b389-cce235f8fdad None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:38.217310 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e828f88-869a-48b9-b389-cce235f8fdad None admin] PATH_INFO: `/v3/projects/54407b3e711b40fd9b6c485b32db95cd` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:38.218510 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e828f88-869a-48b9-b389-cce235f8fdad None admin] RBAC: Authorizing `identity:get_project(project_id=54407b3e711b40fd9b6c485b32db95cd)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:38.228027 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e828f88-869a-48b9-b389-cce235f8fdad None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:38.228027 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 224/452] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jun 21 20:08:38 2022] GET /identity/v3/projects/54407b3e711b40fd9b6c485b32db95cd => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:08:38.228027 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e828f88-869a-48b9-b389-cce235f8fdad None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:38.272675 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:38.289335 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be637565-3b1b-49e0-9c08-2ae09bf023e5 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:38.323313 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1cd558-65f9-42fc-8205-6fb76670ef2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:38.323992 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1cd558-65f9-42fc-8205-6fb76670ef2d None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:38.324277 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1cd558-65f9-42fc-8205-6fb76670ef2d None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:38.324553 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1cd558-65f9-42fc-8205-6fb76670ef2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:38.325385 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1cd558-65f9-42fc-8205-6fb76670ef2d None admin] RBAC: Adding query filter params (group.id=c11f965706164876bd4b6ae35e6fab27, role.id=1f5332f48d9e4c2aac866d0d546c94d5, scope.project.id=ef19f22f6a3d44fc841048b493a62bd9) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:38.325696 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1cd558-65f9-42fc-8205-6fb76670ef2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:38.327108 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1cd558-65f9-42fc-8205-6fb76670ef2d None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:38.330433 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e828f88-869a-48b9-b389-cce235f8fdad None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:38.332768 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 229/453] 10.222.0.15 () {56 vars in 1376 bytes} [Tue Jun 21 20:08:38 2022] GET /identity/v3/role_assignments?group.id=c11f965706164876bd4b6ae35e6fab27&scope.project.id=ef19f22f6a3d44fc841048b493a62bd9&role.id=1f5332f48d9e4c2aac866d0d546c94d5 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:38.360131 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:38.367161 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb75ace-5913-4fbd-bfed-f30d08a583fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:38.368083 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb75ace-5913-4fbd-bfed-f30d08a583fd None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:38.368371 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb75ace-5913-4fbd-bfed-f30d08a583fd None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:38.368650 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb75ace-5913-4fbd-bfed-f30d08a583fd None admin] PATH_INFO: `/v3/groups/4bb296687fec4606bd79935a9f8dcac7` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:38.369905 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb75ace-5913-4fbd-bfed-f30d08a583fd None admin] RBAC: Authorizing `identity:get_group(group_id=4bb296687fec4606bd79935a9f8dcac7)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:38.371363 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb75ace-5913-4fbd-bfed-f30d08a583fd None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:38.373060 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 225/454] 10.222.0.15 () {56 vars in 1180 bytes} [Tue Jun 21 20:08:38 2022] GET /identity/v3/groups/4bb296687fec4606bd79935a9f8dcac7 => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:08:38.379034 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1cd558-65f9-42fc-8205-6fb76670ef2d None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:38.483440 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1cd558-65f9-42fc-8205-6fb76670ef2d None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:38.516430 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711efe75-46cc-4ca4-bfa9-8d6105acf412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:38.517087 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711efe75-46cc-4ca4-bfa9-8d6105acf412 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:38.517370 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711efe75-46cc-4ca4-bfa9-8d6105acf412 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:38.517644 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711efe75-46cc-4ca4-bfa9-8d6105acf412 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:38.518468 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711efe75-46cc-4ca4-bfa9-8d6105acf412 None admin] RBAC: Adding query filter params (group.id=4bb296687fec4606bd79935a9f8dcac7, role.id=141a45d0143342f2ac0eafc233c9b6c3, scope.project.id=54407b3e711b40fd9b6c485b32db95cd) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:38.518777 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711efe75-46cc-4ca4-bfa9-8d6105acf412 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:38.520232 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711efe75-46cc-4ca4-bfa9-8d6105acf412 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:38.526035 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 230/455] 10.222.0.15 () {56 vars in 1376 bytes} [Tue Jun 21 20:08:38 2022] GET /identity/v3/role_assignments?group.id=4bb296687fec4606bd79935a9f8dcac7&scope.project.id=54407b3e711b40fd9b6c485b32db95cd&role.id=141a45d0143342f2ac0eafc233c9b6c3 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:08:41.133919 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b4e29-33e8-48d8-a9d4-152b8980b819 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:41.134438 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b4e29-33e8-48d8-a9d4-152b8980b819 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:41.134513 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b4e29-33e8-48d8-a9d4-152b8980b819 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:41.136137 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 226/456] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:08:41.141108 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186081f4-b82c-42f4-afa8-1d26111536b1 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:41.141521 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186081f4-b82c-42f4-afa8-1d26111536b1 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:41.141685 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186081f4-b82c-42f4-afa8-1d26111536b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:41.168983 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-186081f4-b82c-42f4-afa8-1d26111536b1 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:41.170223 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-186081f4-b82c-42f4-afa8-1d26111536b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:41.178539 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:41.257576 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 231/457] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:08:41.273021 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052f4e5-31dc-43c9-a3a5-286deb15742b None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:41.273600 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052f4e5-31dc-43c9-a3a5-286deb15742b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:41.274073 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052f4e5-31dc-43c9-a3a5-286deb15742b None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:41.276599 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 227/458] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:08:41.280871 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bac98a-3f75-4ffc-853e-90ac9b11d5cb None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:41.281184 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bac98a-3f75-4ffc-853e-90ac9b11d5cb None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:41.281470 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bac98a-3f75-4ffc-853e-90ac9b11d5cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:41.288601 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9052f4e5-31dc-43c9-a3a5-286deb15742b None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:41.303030 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-02bac98a-3f75-4ffc-853e-90ac9b11d5cb None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:41.304246 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-02bac98a-3f75-4ffc-853e-90ac9b11d5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:41.384487 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 232/459] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:08:41.408705 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bac98a-3f75-4ffc-853e-90ac9b11d5cb None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:41.483903 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9052f4e5-31dc-43c9-a3a5-286deb15742b None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:41.522056 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa6af9-0e1e-4176-8ee4-654ea1203f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:41.523134 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa6af9-0e1e-4176-8ee4-654ea1203f7b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:41.523581 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa6af9-0e1e-4176-8ee4-654ea1203f7b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:41.524046 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa6af9-0e1e-4176-8ee4-654ea1203f7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:41.537818 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa6af9-0e1e-4176-8ee4-654ea1203f7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:41.539473 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa6af9-0e1e-4176-8ee4-654ea1203f7b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:41.558151 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:41.563857 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-20fa6af9-0e1e-4176-8ee4-654ea1203f7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:08:41.563857 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:41.563857 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:41.563857 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:41.563857 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:41.563857 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:41.563857 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:41.563857 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:41.563857 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:41.563857 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:41.563857 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:41.563857 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:41.563857 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:08:41.563857 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:08:41.563857 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:08:41.564956 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:08:41.564956 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:41.564956 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:41.564956 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:41.564956 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:41.564956 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:41.564956 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:41.564956 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:41.564956 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:41.564956 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:41.564956 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:41.564956 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:41.564956 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:41.564956 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:41.564956 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:41.564956 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:41.564956 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:41.566096 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:08:41.566096 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:08:41.566096 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:08:41.566096 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:08:41.568027 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 228/460] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:08:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:08:41.570577 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba873d2-a24a-4ca4-b617-1ffd6be35971 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:41.571040 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba873d2-a24a-4ca4-b617-1ffd6be35971 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:41.571468 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba873d2-a24a-4ca4-b617-1ffd6be35971 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:41.573812 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 229/461] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:08:41.574772 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba873d2-a24a-4ca4-b617-1ffd6be35971 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:41.598004 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bac98a-3f75-4ffc-853e-90ac9b11d5cb None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:41.635880 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f85a0-6cad-4616-b5c0-64b04e3ef4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:41.636846 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f85a0-6cad-4616-b5c0-64b04e3ef4d8 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:41.637183 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f85a0-6cad-4616-b5c0-64b04e3ef4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:41.637557 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f85a0-6cad-4616-b5c0-64b04e3ef4d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:41.643783 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:41.651492 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819f85a0-6cad-4616-b5c0-64b04e3ef4d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:41.653323 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819f85a0-6cad-4616-b5c0-64b04e3ef4d8 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:41.672713 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-819f85a0-6cad-4616-b5c0-64b04e3ef4d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:08:41.672713 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:41.672713 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:41.672713 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:41.672713 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:41.672713 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:41.672713 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:41.672713 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:41.672713 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:41.672713 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:41.672713 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:41.672713 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:41.672713 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:08:41.672713 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:08:41.672713 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:08:41.673825 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:08:41.673825 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:41.673825 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:41.673825 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:41.673825 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:41.673825 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:41.673825 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:41.673825 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:41.673825 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:41.673825 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:41.673825 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:41.673825 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:41.673825 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:41.673825 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:41.673825 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:41.673825 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:41.673825 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:41.674914 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:08:41.674914 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:08:41.674914 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:08:41.674914 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:08:41.676216 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 233/462] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:08:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:08:41.681311 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3b29d-df2f-4614-bd9d-690f9279d2a1 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:41.683249 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3b29d-df2f-4614-bd9d-690f9279d2a1 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:41.683683 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3b29d-df2f-4614-bd9d-690f9279d2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:41.701105 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-48e3b29d-df2f-4614-bd9d-690f9279d2a1 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:41.702513 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-48e3b29d-df2f-4614-bd9d-690f9279d2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:41.707818 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba873d2-a24a-4ca4-b617-1ffd6be35971 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:41.754025 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30490c6b-fa59-451e-83bb-35ed9193b874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:41.754698 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30490c6b-fa59-451e-83bb-35ed9193b874 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:41.755348 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30490c6b-fa59-451e-83bb-35ed9193b874 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:41.755638 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30490c6b-fa59-451e-83bb-35ed9193b874 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:41.756760 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30490c6b-fa59-451e-83bb-35ed9193b874 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:41.757080 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30490c6b-fa59-451e-83bb-35ed9193b874 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:41.758616 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30490c6b-fa59-451e-83bb-35ed9193b874 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:41.771962 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 230/463] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:08:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:41.771962 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30490c6b-fa59-451e-83bb-35ed9193b874 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:41.781644 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 234/464] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:08:41.783128 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc075e3-129b-4669-b076-ccabb3ca7971 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:41.783426 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc075e3-129b-4669-b076-ccabb3ca7971 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:41.783755 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc075e3-129b-4669-b076-ccabb3ca7971 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:41.785271 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 235/465] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:08:41.785939 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc075e3-129b-4669-b076-ccabb3ca7971 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:41.846785 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:41.892282 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30490c6b-fa59-451e-83bb-35ed9193b874 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:41.899865 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc075e3-129b-4669-b076-ccabb3ca7971 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:41.905189 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:41.931273 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34bf71-a9d6-43e8-9185-b73e1f058fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:41.932016 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34bf71-a9d6-43e8-9185-b73e1f058fa0 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:41.932303 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34bf71-a9d6-43e8-9185-b73e1f058fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:41.932575 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34bf71-a9d6-43e8-9185-b73e1f058fa0 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:41.933344 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b34bf71-a9d6-43e8-9185-b73e1f058fa0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:41.933659 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b34bf71-a9d6-43e8-9185-b73e1f058fa0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:41.935029 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b34bf71-a9d6-43e8-9185-b73e1f058fa0 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:41.935836 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebd7e53-1b7a-48fb-9763-2d105025c946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:41.936711 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd7e53-1b7a-48fb-9763-2d105025c946 None admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:41.937002 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd7e53-1b7a-48fb-9763-2d105025c946 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:41.937406 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd7e53-1b7a-48fb-9763-2d105025c946 None admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:41.938114 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebd7e53-1b7a-48fb-9763-2d105025c946 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:41.939550 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebd7e53-1b7a-48fb-9763-2d105025c946 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:41.951311 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 231/466] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:08:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:41.951311 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ec10d-a622-45af-b4f5-c33b33eb69fb None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:41.951311 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ec10d-a622-45af-b4f5-c33b33eb69fb None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:41.951311 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ec10d-a622-45af-b4f5-c33b33eb69fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:41.966421 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-d13ec10d-a622-45af-b4f5-c33b33eb69fb None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:41.966584 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 236/467] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Jun 21 20:08:41 2022] POST /identity/v3/users => generated 246 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:08:41.967453 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebd7e53-1b7a-48fb-9763-2d105025c946 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:41.968889 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d13ec10d-a622-45af-b4f5-c33b33eb69fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:42.063948 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 232/468] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:08:42.063948 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ec10d-a622-45af-b4f5-c33b33eb69fb None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:42.130269 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebd7e53-1b7a-48fb-9763-2d105025c946 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:42.143030 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:42.183407 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3283df2-f5be-4604-a348-e951b78c6f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:42.184564 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3283df2-f5be-4604-a348-e951b78c6f2e None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:42.185004 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3283df2-f5be-4604-a348-e951b78c6f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:42.185514 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3283df2-f5be-4604-a348-e951b78c6f2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:42.198792 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3283df2-f5be-4604-a348-e951b78c6f2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:42.200289 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3283df2-f5be-4604-a348-e951b78c6f2e None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:42.206219 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:42.211022 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ec10d-a622-45af-b4f5-c33b33eb69fb None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:42.218395 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-c3283df2-f5be-4604-a348-e951b78c6f2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:08:42.218395 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:42.218395 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:42.218395 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:42.218395 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:42.218395 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:42.218395 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:42.218395 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:42.218395 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:42.218395 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:42.218395 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:42.218395 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:42.218395 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:08:42.218395 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:08:42.218395 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:08:42.219244 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:08:42.219244 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:42.219244 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:42.219244 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:42.219244 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:42.219244 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:42.219244 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:42.219244 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:42.219244 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:42.219244 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:42.219244 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:42.219244 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:42.219244 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:42.219244 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:42.219244 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:42.219244 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:42.219244 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:42.220131 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:08:42.220131 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:08:42.220131 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:08:42.220131 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:08:42.220809 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 237/469] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:08:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:42.222415 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3283df2-f5be-4604-a348-e951b78c6f2e None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:42.261876 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92cf016-83e9-48b8-991b-34cbd48cb91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:42.262913 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92cf016-83e9-48b8-991b-34cbd48cb91e None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:42.263391 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92cf016-83e9-48b8-991b-34cbd48cb91e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:42.264457 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92cf016-83e9-48b8-991b-34cbd48cb91e None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:42.265386 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92cf016-83e9-48b8-991b-34cbd48cb91e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:42.267863 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92cf016-83e9-48b8-991b-34cbd48cb91e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:42.291691 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 233/470] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Jun 21 20:08:42 2022] POST /identity/v3/users => generated 248 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:08:42.292667 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92cf016-83e9-48b8-991b-34cbd48cb91e None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:42.336001 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3283df2-f5be-4604-a348-e951b78c6f2e None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:42.384506 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49893f4f-7940-4afb-8f67-55f078f74fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:42.385875 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49893f4f-7940-4afb-8f67-55f078f74fc7 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:42.386355 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49893f4f-7940-4afb-8f67-55f078f74fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:42.386843 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49893f4f-7940-4afb-8f67-55f078f74fc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:42.409690 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49893f4f-7940-4afb-8f67-55f078f74fc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:42.409861 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92cf016-83e9-48b8-991b-34cbd48cb91e None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:42.411696 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49893f4f-7940-4afb-8f67-55f078f74fc7 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:42.444458 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-49893f4f-7940-4afb-8f67-55f078f74fc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:08:42.444458 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:42.444458 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:42.444458 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:42.444458 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:42.444458 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:42.444458 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:42.444458 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:42.444458 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:42.444458 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:42.444458 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:42.444458 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:42.444458 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:08:42.444458 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:08:42.444458 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:08:42.445365 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:08:42.445365 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:42.445365 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:42.445365 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:42.445365 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:42.445365 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:42.445365 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:42.445365 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:42.445365 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:42.445365 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:42.445365 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:42.445365 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:42.445365 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:42.445365 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:42.445365 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:42.445365 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:42.445365 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:42.446713 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:08:42.446713 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:08:42.446713 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:08:42.446713 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:08:42.446713 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 238/471] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:08:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:42.452392 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca6f07-44bc-4db7-a6ad-47fb6c367a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:42.452923 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49893f4f-7940-4afb-8f67-55f078f74fc7 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:42.453139 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca6f07-44bc-4db7-a6ad-47fb6c367a38 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:42.453537 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca6f07-44bc-4db7-a6ad-47fb6c367a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:42.453825 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca6f07-44bc-4db7-a6ad-47fb6c367a38 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:42.454573 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ca6f07-44bc-4db7-a6ad-47fb6c367a38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:42.454887 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ca6f07-44bc-4db7-a6ad-47fb6c367a38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:42.456318 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ca6f07-44bc-4db7-a6ad-47fb6c367a38 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:42.471487 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 234/472] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:08:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:42.478197 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca6f07-44bc-4db7-a6ad-47fb6c367a38 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:42.502584 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:42.507259 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:42.592179 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca6f07-44bc-4db7-a6ad-47fb6c367a38 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:42.634061 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1487c36a-5c91-4180-9f97-1912a3535351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:42.635209 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487c36a-5c91-4180-9f97-1912a3535351 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:42.635209 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487c36a-5c91-4180-9f97-1912a3535351 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:42.635384 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487c36a-5c91-4180-9f97-1912a3535351 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:42.636073 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1487c36a-5c91-4180-9f97-1912a3535351 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:42.637634 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1487c36a-5c91-4180-9f97-1912a3535351 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:42.644840 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49893f4f-7940-4afb-8f67-55f078f74fc7 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:42.679940 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 235/473] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Jun 21 20:08:42 2022] POST /identity/v3/users => generated 248 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 20:08:42.679940 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46f866-adea-438a-9616-01edf7b62844 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:42.679940 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46f866-adea-438a-9616-01edf7b62844 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:42.679940 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46f866-adea-438a-9616-01edf7b62844 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:42.679940 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 236/474] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:08:42.685533 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d6246-8860-4952-803b-fcecc59811a4 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:42.685831 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d6246-8860-4952-803b-fcecc59811a4 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:42.686162 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d6246-8860-4952-803b-fcecc59811a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:42.690501 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999a65e-fb88-48a6-b3b7-cbdc1ef6fea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:42.691421 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999a65e-fb88-48a6-b3b7-cbdc1ef6fea4 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:42.691899 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999a65e-fb88-48a6-b3b7-cbdc1ef6fea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:42.692405 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999a65e-fb88-48a6-b3b7-cbdc1ef6fea4 None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:42.693406 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7999a65e-fb88-48a6-b3b7-cbdc1ef6fea4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:42.693932 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7999a65e-fb88-48a6-b3b7-cbdc1ef6fea4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:42.695523 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7999a65e-fb88-48a6-b3b7-cbdc1ef6fea4 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:42.705919 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ec7d6246-8860-4952-803b-fcecc59811a4 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:42.707134 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ec7d6246-8860-4952-803b-fcecc59811a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:42.719369 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 239/475] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:08:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:42.720733 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999a65e-fb88-48a6-b3b7-cbdc1ef6fea4 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:42.866606 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 237/476] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 20:08:42.871839 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:42.903776 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d6246-8860-4952-803b-fcecc59811a4 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:42.906000 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:42.915784 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999a65e-fb88-48a6-b3b7-cbdc1ef6fea4 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:42.952906 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31810680-25ed-4a8b-b9b3-c64458a731df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:42.953919 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31810680-25ed-4a8b-b9b3-c64458a731df None admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:42.954413 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31810680-25ed-4a8b-b9b3-c64458a731df None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:42.954881 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31810680-25ed-4a8b-b9b3-c64458a731df None admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:42.955788 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31810680-25ed-4a8b-b9b3-c64458a731df None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:42.957438 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31810680-25ed-4a8b-b9b3-c64458a731df None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:42.987482 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 240/477] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Jun 21 20:08:42 2022] POST /identity/v3/users => generated 249 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:08:43.023687 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d6246-8860-4952-803b-fcecc59811a4 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:43.062180 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c6c6fd-8563-4571-bae6-0070cfe96ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:43.062981 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6c6fd-8563-4571-bae6-0070cfe96ced None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:43.063273 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6c6fd-8563-4571-bae6-0070cfe96ced None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:43.063556 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6c6fd-8563-4571-bae6-0070cfe96ced None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:43.065285 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c6c6fd-8563-4571-bae6-0070cfe96ced None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:43.066727 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c6c6fd-8563-4571-bae6-0070cfe96ced None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:43.077506 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.sql.core [None req-09c6c6fd-8563-4571-bae6-0070cfe96ced None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 21 20:08:43.077506 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 21 20:08:43.077506 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [parameters: {'id': '7525cb62b16b4428a24862381e406ede', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 21 20:08:43.077506 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80135) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 21 20:08:43.096409 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-09c6c6fd-8563-4571-bae6-0070cfe96ced None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 21 20:08:43.096409 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:43.096409 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 21 20:08:43.096409 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 21 20:08:43.096409 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 21 20:08:43.096409 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 21 20:08:43.096409 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 21 20:08:43.096409 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application result = self._query(query) Jun 21 20:08:43.096409 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 21 20:08:43.096409 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application conn.query(q) Jun 21 20:08:43.096409 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 21 20:08:43.096409 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 21 20:08:43.096409 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 21 20:08:43.096409 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application result.read() Jun 21 20:08:43.096409 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 21 20:08:43.097323 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 21 20:08:43.097323 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 21 20:08:43.097323 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 21 20:08:43.097323 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 21 20:08:43.097323 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 21 20:08:43.097323 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 21 20:08:43.097323 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 21 20:08:43.097323 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 21 20:08:43.097323 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:08:43.097323 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 21 20:08:43.097323 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:08:43.097323 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:43.097323 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 21 20:08:43.097323 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 21 20:08:43.097323 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 21 20:08:43.097323 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return ref.to_dict() Jun 21 20:08:43.097323 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 21 20:08:43.097323 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application next(self.gen) Jun 21 20:08:43.098441 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 21 20:08:43.098441 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application yield resource Jun 21 20:08:43.098441 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 21 20:08:43.098441 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application next(self.gen) Jun 21 20:08:43.098441 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 21 20:08:43.098441 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self.session.rollback() Jun 21 20:08:43.098441 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 21 20:08:43.098441 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self.force_reraise() Jun 21 20:08:43.098441 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 21 20:08:43.098441 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise self.value Jun 21 20:08:43.098441 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 21 20:08:43.098441 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 21 20:08:43.098441 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 21 20:08:43.098441 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application session.commit() Jun 21 20:08:43.098441 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 21 20:08:43.098441 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 21 20:08:43.098441 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 21 20:08:43.099643 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._prepare_impl() Jun 21 20:08:43.099643 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 21 20:08:43.099643 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self.session.flush() Jun 21 20:08:43.099643 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 21 20:08:43.099643 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._flush(objects) Jun 21 20:08:43.099643 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 21 20:08:43.099643 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 21 20:08:43.099643 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 21 20:08:43.099643 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application compat.raise_( Jun 21 20:08:43.099643 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 21 20:08:43.099643 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception Jun 21 20:08:43.099643 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 21 20:08:43.099643 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application flush_context.execute() Jun 21 20:08:43.099643 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 21 20:08:43.099643 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rec.execute(self) Jun 21 20:08:43.099643 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 21 20:08:43.099643 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 21 20:08:43.100539 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 21 20:08:43.100539 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 21 20:08:43.100539 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 21 20:08:43.100539 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 21 20:08:43.100539 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 21 20:08:43.100539 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 21 20:08:43.100539 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 21 20:08:43.100539 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 21 20:08:43.100539 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 21 20:08:43.100539 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 21 20:08:43.100539 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 21 20:08:43.100539 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 21 20:08:43.100539 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 21 20:08:43.100539 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 21 20:08:43.100539 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 21 20:08:43.100539 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception Jun 21 20:08:43.101320 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 21 20:08:43.101320 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 21 20:08:43.101320 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 21 20:08:43.101320 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 21 20:08:43.101320 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 21 20:08:43.101320 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application result = self._query(query) Jun 21 20:08:43.101320 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 21 20:08:43.101320 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application conn.query(q) Jun 21 20:08:43.101320 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 21 20:08:43.101320 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 21 20:08:43.101320 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 21 20:08:43.101320 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application result.read() Jun 21 20:08:43.101320 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 21 20:08:43.101320 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 21 20:08:43.101320 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 21 20:08:43.101320 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 21 20:08:43.102114 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 21 20:08:43.102114 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 21 20:08:43.102114 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 21 20:08:43.102114 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 21 20:08:43.102114 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 21 20:08:43.102114 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 21 20:08:43.102114 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [parameters: {'id': '7525cb62b16b4428a24862381e406ede', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 21 20:08:43.102114 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 21 20:08:43.102114 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:08:43.102114 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 20:08:43.102114 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:08:43.102114 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:43.102114 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:43.102114 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:43.102114 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:43.102114 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:43.104469 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:43.104469 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:43.104469 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:43.104469 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:43.104469 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:43.104469 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:43.104469 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 21 20:08:43.104469 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 21 20:08:43.104469 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:43.104469 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:43.104469 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 21 20:08:43.104469 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 21 20:08:43.104469 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 21 20:08:43.104469 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 21 20:08:43.104469 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 21 20:08:43.104469 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:08:43.106105 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 238/478] 10.222.0.15 () {60 vars in 1131 bytes} [Tue Jun 21 20:08:42 2022] POST /identity/v3/roles => generated 144 bytes in 195 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:08:43.107789 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31810680-25ed-4a8b-b9b3-c64458a731df None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:43.245299 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31810680-25ed-4a8b-b9b3-c64458a731df None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:43.280031 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:43.283620 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96addd31-5ec2-4727-a3d3-6cdb36ac2390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:43.284490 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96addd31-5ec2-4727-a3d3-6cdb36ac2390 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:43.284782 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96addd31-5ec2-4727-a3d3-6cdb36ac2390 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:43.285066 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96addd31-5ec2-4727-a3d3-6cdb36ac2390 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:43.298434 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96addd31-5ec2-4727-a3d3-6cdb36ac2390 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:08:43.307791 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-96addd31-5ec2-4727-a3d3-6cdb36ac2390 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 20:08:43.307791 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:43.307791 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:43.307791 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:43.307791 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:43.307791 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:43.307791 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:43.307791 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:43.307791 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:43.307791 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:43.307791 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:43.307791 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:43.307791 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:08:43.307791 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:08:43.307791 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:08:43.307791 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:08:43.308762 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:08:43.308762 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:08:43.308762 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:08:43.308762 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:08:43.308762 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:43.308762 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:43.308762 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:43.308762 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:43.308762 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:43.308762 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:43.308762 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:43.308762 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:43.308762 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:43.308762 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:43.308762 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:43.308762 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:43.309721 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:43.309721 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:43.309721 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:43.309721 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:43.309721 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:08:43.309721 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:08:43.309721 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:08:43.309721 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:08:43.309721 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:08:43.309721 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:08:43.309721 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 20:08:43.309721 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:08:43.309721 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 241/479] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Jun 21 20:08:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:43.317024 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c6c6fd-8563-4571-bae6-0070cfe96ced None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:43.393143 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:43.436408 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c6c6fd-8563-4571-bae6-0070cfe96ced None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:43.476320 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf43030-eee1-435f-b5b2-5eed4df0b55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:43.477343 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf43030-eee1-435f-b5b2-5eed4df0b55c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:43.477834 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf43030-eee1-435f-b5b2-5eed4df0b55c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:43.478316 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf43030-eee1-435f-b5b2-5eed4df0b55c None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:43.479311 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf43030-eee1-435f-b5b2-5eed4df0b55c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:43.479886 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf43030-eee1-435f-b5b2-5eed4df0b55c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:43.481485 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf43030-eee1-435f-b5b2-5eed4df0b55c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:43.491315 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 239/480] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jun 21 20:08:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:44.332108 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587bb7c7-188e-4061-b6b4-1df051317837 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:44.333115 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587bb7c7-188e-4061-b6b4-1df051317837 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:44.333596 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587bb7c7-188e-4061-b6b4-1df051317837 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:44.336021 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 242/481] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:08:44.341558 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411090a-d559-422e-a36c-fb2971afed83 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:44.342392 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411090a-d559-422e-a36c-fb2971afed83 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:44.342893 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411090a-d559-422e-a36c-fb2971afed83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:44.360536 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-8411090a-d559-422e-a36c-fb2971afed83 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:44.362012 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8411090a-d559-422e-a36c-fb2971afed83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:44.450205 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 240/482] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:08:44.486538 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587bb7c7-188e-4061-b6b4-1df051317837 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:44.603376 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587bb7c7-188e-4061-b6b4-1df051317837 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:44.644664 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6cb0b8-1766-464c-9f05-8ac7ea5fc49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:44.645837 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6cb0b8-1766-464c-9f05-8ac7ea5fc49d None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:44.646996 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6cb0b8-1766-464c-9f05-8ac7ea5fc49d None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:44.647486 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6cb0b8-1766-464c-9f05-8ac7ea5fc49d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:44.663231 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6cb0b8-1766-464c-9f05-8ac7ea5fc49d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:08:44.671268 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-db6cb0b8-1766-464c-9f05-8ac7ea5fc49d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 20:08:44.671268 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:44.671268 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:44.671268 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:44.671268 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:44.671268 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:44.671268 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:44.671268 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:44.671268 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:44.671268 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:44.671268 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:44.671268 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:44.671268 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:08:44.671268 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:08:44.671268 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:08:44.671268 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:08:44.672171 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:08:44.672171 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:08:44.672171 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:08:44.672171 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:08:44.672171 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:44.672171 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:44.672171 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:44.672171 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:44.672171 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:44.672171 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:44.672171 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:44.672171 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:44.672171 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:44.672171 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:44.672171 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:44.672171 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:44.672951 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:44.672951 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:44.672951 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:44.672951 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:44.672951 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:08:44.672951 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:08:44.672951 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:08:44.672951 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:08:44.672951 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:08:44.672951 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:08:44.672951 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 20:08:44.672951 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:08:44.675264 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 243/483] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Jun 21 20:08:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:44.681100 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411090a-d559-422e-a36c-fb2971afed83 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:44.749358 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:44.806606 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411090a-d559-422e-a36c-fb2971afed83 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:44.872662 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d03b92b-4f88-4ccf-8849-842783e15e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:44.873531 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03b92b-4f88-4ccf-8849-842783e15e54 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:44.873976 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03b92b-4f88-4ccf-8849-842783e15e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:44.874382 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03b92b-4f88-4ccf-8849-842783e15e54 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:44.875273 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d03b92b-4f88-4ccf-8849-842783e15e54 None admin] RBAC: Adding query filter params (name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:44.875723 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d03b92b-4f88-4ccf-8849-842783e15e54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:44.877250 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d03b92b-4f88-4ccf-8849-842783e15e54 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:44.890929 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 241/484] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Jun 21 20:08:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:44.896525 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6cb0b8-1766-464c-9f05-8ac7ea5fc49d None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:44.964307 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:45.038094 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a6abe-de91-48de-ad5e-7b1ec4f37d90 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:45.038610 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a6abe-de91-48de-ad5e-7b1ec4f37d90 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:45.039030 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a6abe-de91-48de-ad5e-7b1ec4f37d90 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:45.040579 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 242/485] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 20:08:45.042629 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6cb0b8-1766-464c-9f05-8ac7ea5fc49d None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:45.057172 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac055a4-fd08-4f19-a380-12327c44e223 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:45.057627 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac055a4-fd08-4f19-a380-12327c44e223 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:45.058012 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac055a4-fd08-4f19-a380-12327c44e223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:45.078476 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-bac055a4-fd08-4f19-a380-12327c44e223 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:45.079859 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-bac055a4-fd08-4f19-a380-12327c44e223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:45.101687 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308916b-4f59-4831-b195-1d49e10d7f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:45.102767 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308916b-4f59-4831-b195-1d49e10d7f04 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:45.103267 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308916b-4f59-4831-b195-1d49e10d7f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:45.103706 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308916b-4f59-4831-b195-1d49e10d7f04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:45.125314 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308916b-4f59-4831-b195-1d49e10d7f04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:45.127092 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308916b-4f59-4831-b195-1d49e10d7f04 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:45.160951 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-3308916b-4f59-4831-b195-1d49e10d7f04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:08:45.160951 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:45.160951 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:45.160951 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:45.160951 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:45.160951 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:45.160951 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:45.160951 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:45.160951 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:45.160951 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:45.160951 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:45.160951 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:45.160951 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:08:45.160951 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:08:45.160951 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:08:45.162069 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:08:45.162069 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:45.162069 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:45.162069 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:45.162069 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:45.162069 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:45.162069 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:45.162069 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:45.162069 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:45.162069 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:45.162069 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:45.162069 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:45.162069 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:45.162069 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:45.162069 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:45.162069 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:45.162069 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:45.163135 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:08:45.163135 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:08:45.163135 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:08:45.163135 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:08:45.167580 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 244/486] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:08:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:08:45.171804 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308916b-4f59-4831-b195-1d49e10d7f04 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:45.210642 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 243/487] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 20:08:45.252007 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac055a4-fd08-4f19-a380-12327c44e223 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:45.322325 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308916b-4f59-4831-b195-1d49e10d7f04 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:45.325995 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:45.360221 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:45.384049 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f4e6b4-14ed-43fa-87a4-44f433d3440c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:45.384654 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4e6b4-14ed-43fa-87a4-44f433d3440c None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:45.384945 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4e6b4-14ed-43fa-87a4-44f433d3440c None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:45.385228 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4e6b4-14ed-43fa-87a4-44f433d3440c None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:45.385961 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f4e6b4-14ed-43fa-87a4-44f433d3440c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:45.386276 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f4e6b4-14ed-43fa-87a4-44f433d3440c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:45.387666 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f4e6b4-14ed-43fa-87a4-44f433d3440c None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:45.415778 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 245/488] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:08:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:45.424881 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f4e6b4-14ed-43fa-87a4-44f433d3440c None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:45.444662 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac055a4-fd08-4f19-a380-12327c44e223 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:45.488537 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8cdea-468c-463d-9164-00bf0c538733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:45.489347 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8cdea-468c-463d-9164-00bf0c538733 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:45.489628 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8cdea-468c-463d-9164-00bf0c538733 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:45.489938 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8cdea-468c-463d-9164-00bf0c538733 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:45.515332 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8cdea-468c-463d-9164-00bf0c538733 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:08:45.523254 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-b8f8cdea-468c-463d-9164-00bf0c538733 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 20:08:45.523254 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:45.523254 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:45.523254 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:45.523254 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:45.523254 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:45.523254 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:45.523254 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:45.523254 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:45.523254 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:45.523254 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:45.523254 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:45.523254 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:08:45.523254 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:08:45.523254 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:08:45.523254 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:08:45.524190 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:08:45.524190 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:08:45.524190 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:08:45.524190 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:08:45.524190 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:45.524190 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:45.524190 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:45.524190 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:45.524190 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:45.524190 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:45.524190 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:45.524190 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:45.524190 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:45.524190 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:45.524190 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:45.524190 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:45.530000 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:45.530000 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:45.530000 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:45.530000 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:45.530000 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:08:45.530000 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:08:45.530000 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:08:45.530000 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:08:45.530000 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:08:45.530000 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:08:45.530000 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 20:08:45.530000 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:08:45.530000 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 244/489] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Jun 21 20:08:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:45.530000 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d30d6-6f87-43c3-97b8-6578fa1b6de4 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:45.530727 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d30d6-6f87-43c3-97b8-6578fa1b6de4 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:45.530727 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d30d6-6f87-43c3-97b8-6578fa1b6de4 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:45.530727 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 245/490] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:08:45.532317 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d30d6-6f87-43c3-97b8-6578fa1b6de4 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:45.598430 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f4e6b4-14ed-43fa-87a4-44f433d3440c None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:45.640517 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39358dca-5049-4c4e-a93a-60ae46037086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:45.641232 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39358dca-5049-4c4e-a93a-60ae46037086 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:45.641514 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39358dca-5049-4c4e-a93a-60ae46037086 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:45.641955 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39358dca-5049-4c4e-a93a-60ae46037086 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:45.646689 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d30d6-6f87-43c3-97b8-6578fa1b6de4 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:45.650295 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39358dca-5049-4c4e-a93a-60ae46037086 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:45.651730 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39358dca-5049-4c4e-a93a-60ae46037086 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:45.657436 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:45.669341 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-39358dca-5049-4c4e-a93a-60ae46037086 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 20:08:45.669341 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:45.669341 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:45.669341 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:45.669341 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:45.669341 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:45.669341 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:45.669341 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:45.669341 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:45.669341 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:45.669341 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:45.669341 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:45.669341 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 20:08:45.669341 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 20:08:45.669341 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 20:08:45.669341 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 20:08:45.670303 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:45.670303 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:45.670303 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 20:08:45.670303 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:08:45.670303 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 20:08:45.670303 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:08:45.670303 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:45.670303 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:45.670303 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:45.670303 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:45.670303 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:45.670303 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:45.670303 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:45.670303 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:45.670303 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:45.670303 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:45.670303 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:45.670303 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:45.671200 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:45.671200 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:45.671200 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 20:08:45.671200 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 20:08:45.671200 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 20:08:45.671200 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 20:08:45.671200 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 20:08:45.671200 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 20:08:45.671200 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 20:08:45.671200 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:08:45.671200 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 246/491] 10.222.0.15 () {56 vars in 1093 bytes} [Tue Jun 21 20:08:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:45.671777 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eefbf0-c04d-4a1e-9669-1e4ba3d87acb None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:45.672536 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eefbf0-c04d-4a1e-9669-1e4ba3d87acb None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:45.672536 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eefbf0-c04d-4a1e-9669-1e4ba3d87acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:45.688974 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-98eefbf0-c04d-4a1e-9669-1e4ba3d87acb None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:45.689386 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45129db8-ff27-4ce0-8988-238d5305aa3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:45.690066 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45129db8-ff27-4ce0-8988-238d5305aa3a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:45.690161 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-98eefbf0-c04d-4a1e-9669-1e4ba3d87acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:45.690359 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45129db8-ff27-4ce0-8988-238d5305aa3a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:45.690644 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45129db8-ff27-4ce0-8988-238d5305aa3a None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:45.691407 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45129db8-ff27-4ce0-8988-238d5305aa3a None admin] RBAC: Adding query filter params (name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:45.691719 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45129db8-ff27-4ce0-8988-238d5305aa3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:45.693177 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45129db8-ff27-4ce0-8988-238d5305aa3a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:45.701480 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 246/492] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Jun 21 20:08:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:45.701480 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa4468-e0d8-4b8d-b1b8-e198cf074fa0 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:45.701480 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa4468-e0d8-4b8d-b1b8-e198cf074fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:45.701480 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa4468-e0d8-4b8d-b1b8-e198cf074fa0 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:45.708611 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 247/493] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:08:45.709933 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa4468-e0d8-4b8d-b1b8-e198cf074fa0 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:45.711452 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:45.767275 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 247/494] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:08:45.768518 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eefbf0-c04d-4a1e-9669-1e4ba3d87acb None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:45.840931 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa4468-e0d8-4b8d-b1b8-e198cf074fa0 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:45.877536 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eefbf0-c04d-4a1e-9669-1e4ba3d87acb None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:45.882157 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1524e0-cc59-42d3-811a-1587015a4a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:45.882832 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1524e0-cc59-42d3-811a-1587015a4a83 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:45.883118 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1524e0-cc59-42d3-811a-1587015a4a83 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:45.883398 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1524e0-cc59-42d3-811a-1587015a4a83 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:45.884270 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1524e0-cc59-42d3-811a-1587015a4a83 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:45.884586 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1524e0-cc59-42d3-811a-1587015a4a83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:45.886125 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1524e0-cc59-42d3-811a-1587015a4a83 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:45.911586 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5879ea1e-42a3-413c-9147-46448a9a7ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:45.912889 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879ea1e-42a3-413c-9147-46448a9a7ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:45.913179 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879ea1e-42a3-413c-9147-46448a9a7ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:45.913458 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879ea1e-42a3-413c-9147-46448a9a7ee5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:45.924016 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5879ea1e-42a3-413c-9147-46448a9a7ee5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:45.925492 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5879ea1e-42a3-413c-9147-46448a9a7ee5 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:45.931618 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 248/495] 10.222.0.15 () {56 vars in 1133 bytes} [Tue Jun 21 20:08:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:45.932990 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae0cf7-fea3-4366-a6eb-26cccc87e3d5 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:45.933288 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae0cf7-fea3-4366-a6eb-26cccc87e3d5 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:45.933573 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae0cf7-fea3-4366-a6eb-26cccc87e3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:45.945850 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-5879ea1e-42a3-413c-9147-46448a9a7ee5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:08:45.945850 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:45.945850 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:45.945850 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:45.945850 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:45.945850 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:45.945850 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:45.945850 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:45.945850 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:45.945850 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:45.945850 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:45.945850 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:45.945850 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:08:45.945850 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:08:45.945850 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:08:45.946703 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:08:45.946703 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:45.946703 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:45.946703 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:45.946703 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:45.946703 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:45.946703 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:45.946703 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:45.946703 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:45.946703 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:45.946703 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:45.946703 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:45.946703 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:45.946703 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:45.946703 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:45.946703 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:45.946703 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:45.947529 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:08:45.947529 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:08:45.947529 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:08:45.947529 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:08:45.947529 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 248/496] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:08:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:45.947821 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5879ea1e-42a3-413c-9147-46448a9a7ee5 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:45.951600 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:45.956017 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-2aae0cf7-fea3-4366-a6eb-26cccc87e3d5 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:45.957229 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2aae0cf7-fea3-4366-a6eb-26cccc87e3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:45.982215 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:46.029518 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 249/497] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:08:46.030376 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae0cf7-fea3-4366-a6eb-26cccc87e3d5 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:46.069722 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5879ea1e-42a3-413c-9147-46448a9a7ee5 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:46.106132 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3c9833-1182-4752-a803-885df7c7f8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:46.107312 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c9833-1182-4752-a803-885df7c7f8f6 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:46.107804 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c9833-1182-4752-a803-885df7c7f8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:46.108307 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c9833-1182-4752-a803-885df7c7f8f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:46.119859 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3c9833-1182-4752-a803-885df7c7f8f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:08:46.128654 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-7d3c9833-1182-4752-a803-885df7c7f8f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 20:08:46.128654 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:46.128654 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:46.128654 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:46.128654 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:46.128654 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:46.128654 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:46.128654 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:46.128654 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:46.128654 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:46.128654 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:46.128654 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:46.128654 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:08:46.128654 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:08:46.128654 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:08:46.128654 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:08:46.129840 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:08:46.129840 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:08:46.129840 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:08:46.129840 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:08:46.129840 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:46.129840 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:46.129840 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:46.129840 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:46.129840 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:46.129840 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:46.129840 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:46.129840 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:46.129840 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:46.129840 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:46.129840 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:46.129840 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:46.131351 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:46.131351 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:46.131351 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:46.131351 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:46.131351 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:08:46.131351 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:08:46.131351 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:08:46.131351 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:08:46.131351 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:08:46.131351 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:08:46.131351 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 20:08:46.131351 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:08:46.139339 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 249/498] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Jun 21 20:08:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:46.139339 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3c9833-1182-4752-a803-885df7c7f8f6 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:46.143547 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae0cf7-fea3-4366-a6eb-26cccc87e3d5 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:46.177165 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8fda2-46f5-4c89-90a4-42c96933dcaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:46.177777 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8fda2-46f5-4c89-90a4-42c96933dcaa None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:46.178063 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8fda2-46f5-4c89-90a4-42c96933dcaa None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:46.178343 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8fda2-46f5-4c89-90a4-42c96933dcaa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:46.198957 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:46.207334 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:46.237988 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3c9833-1182-4752-a803-885df7c7f8f6 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:46.247735 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8fda2-46f5-4c89-90a4-42c96933dcaa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:46.249240 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8fda2-46f5-4c89-90a4-42c96933dcaa None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:46.270829 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e661400-be35-4ac0-9667-1335bfbdbc7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:46.272080 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e661400-be35-4ac0-9667-1335bfbdbc7b None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:46.272371 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e661400-be35-4ac0-9667-1335bfbdbc7b None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:46.272655 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e661400-be35-4ac0-9667-1335bfbdbc7b None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:46.273382 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e661400-be35-4ac0-9667-1335bfbdbc7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:46.273697 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e661400-be35-4ac0-9667-1335bfbdbc7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:46.275066 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e661400-be35-4ac0-9667-1335bfbdbc7b None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:46.286510 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 250/499] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:08:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:46.287335 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e661400-be35-4ac0-9667-1335bfbdbc7b None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:46.349633 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 250/500] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:08:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 20:08:46.350990 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc742b-36aa-4d85-b816-ead56b8e89ce None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:46.351279 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc742b-36aa-4d85-b816-ead56b8e89ce None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:46.351559 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc742b-36aa-4d85-b816-ead56b8e89ce None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:46.352846 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 251/501] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:08:46.353529 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc742b-36aa-4d85-b816-ead56b8e89ce None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:46.389875 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e661400-be35-4ac0-9667-1335bfbdbc7b None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:46.412969 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:46.414848 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:46.425368 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a737915e-60d3-45e0-9672-8d19ece52ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:46.426198 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737915e-60d3-45e0-9672-8d19ece52ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:46.426630 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737915e-60d3-45e0-9672-8d19ece52ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:46.426916 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737915e-60d3-45e0-9672-8d19ece52ec1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:46.437961 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a737915e-60d3-45e0-9672-8d19ece52ec1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:08:46.446204 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-a737915e-60d3-45e0-9672-8d19ece52ec1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 20:08:46.446204 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:46.446204 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:46.446204 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:46.446204 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:46.446204 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:46.446204 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:46.446204 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:46.446204 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:46.446204 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:46.446204 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:46.446204 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:46.446204 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:08:46.446204 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:08:46.446204 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:08:46.446204 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:08:46.447161 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:08:46.447161 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:08:46.447161 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:08:46.447161 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:08:46.447161 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:46.447161 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:46.447161 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:46.447161 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:46.447161 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:46.447161 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:46.447161 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:46.447161 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:46.447161 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:46.447161 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:46.447161 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:46.447161 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:46.447989 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:46.447989 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:46.447989 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:46.447989 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:46.447989 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:08:46.447989 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:08:46.447989 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:08:46.447989 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:08:46.447989 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:08:46.447989 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:08:46.447989 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 20:08:46.447989 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:08:46.447989 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 251/502] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Jun 21 20:08:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:46.448674 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a737915e-60d3-45e0-9672-8d19ece52ec1 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:46.460435 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc742b-36aa-4d85-b816-ead56b8e89ce None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:46.493866 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c55f6b-fa84-4926-bd4a-d776f950bd46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:46.494536 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c55f6b-fa84-4926-bd4a-d776f950bd46 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:46.494824 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c55f6b-fa84-4926-bd4a-d776f950bd46 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:46.495107 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c55f6b-fa84-4926-bd4a-d776f950bd46 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:46.495860 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c55f6b-fa84-4926-bd4a-d776f950bd46 None admin] RBAC: Adding query filter params (name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:46.496205 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c55f6b-fa84-4926-bd4a-d776f950bd46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:46.497587 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c55f6b-fa84-4926-bd4a-d776f950bd46 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:46.505401 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 252/503] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Jun 21 20:08:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:46.506732 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c55f6b-fa84-4926-bd4a-d776f950bd46 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:46.551318 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a737915e-60d3-45e0-9672-8d19ece52ec1 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:46.585154 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3351177-8dfe-4f8d-a4a0-d6e170164c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:46.585956 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3351177-8dfe-4f8d-a4a0-d6e170164c93 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:46.586246 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3351177-8dfe-4f8d-a4a0-d6e170164c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:46.586530 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3351177-8dfe-4f8d-a4a0-d6e170164c93 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:46.594002 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3351177-8dfe-4f8d-a4a0-d6e170164c93 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:46.595447 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3351177-8dfe-4f8d-a4a0-d6e170164c93 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:46.602874 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c55f6b-fa84-4926-bd4a-d776f950bd46 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:46.610291 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-e3351177-8dfe-4f8d-a4a0-d6e170164c93 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 20:08:46.610291 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:46.610291 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:46.610291 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:46.610291 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:46.610291 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:46.610291 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:46.610291 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:46.610291 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:46.610291 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:46.610291 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:46.610291 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:46.610291 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 20:08:46.610291 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 20:08:46.610291 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 20:08:46.610291 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 20:08:46.611163 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:46.611163 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:46.611163 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 20:08:46.611163 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:08:46.611163 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 20:08:46.611163 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:08:46.611163 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:46.611163 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:46.611163 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:46.611163 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:46.611163 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:46.611163 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:46.611163 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:46.611163 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:46.611163 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:46.611163 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:46.611163 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:46.611163 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:46.612096 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:46.612096 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:46.612096 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 20:08:46.612096 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 20:08:46.612096 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 20:08:46.612096 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 20:08:46.612096 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 20:08:46.612096 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 20:08:46.612096 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 20:08:46.612096 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:08:46.612096 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 252/504] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:08:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:46.612788 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3730d99-c2cb-42bd-9562-0a141206959b None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:46.613073 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3730d99-c2cb-42bd-9562-0a141206959b None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:46.613347 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3730d99-c2cb-42bd-9562-0a141206959b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:46.629391 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:46.629879 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-d3730d99-c2cb-42bd-9562-0a141206959b None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:46.631668 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-d3730d99-c2cb-42bd-9562-0a141206959b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:46.641238 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd1bbd-b21b-496c-a94b-1e9c2bad605c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:46.642028 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd1bbd-b21b-496c-a94b-1e9c2bad605c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:46.642310 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd1bbd-b21b-496c-a94b-1e9c2bad605c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:46.642584 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd1bbd-b21b-496c-a94b-1e9c2bad605c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:46.652858 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cd1bbd-b21b-496c-a94b-1e9c2bad605c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:46.654296 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cd1bbd-b21b-496c-a94b-1e9c2bad605c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:46.670731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-54cd1bbd-b21b-496c-a94b-1e9c2bad605c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:08:46.670731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:46.670731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:46.670731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:46.670731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:46.670731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:46.670731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:46.670731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:46.670731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:46.670731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:46.670731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:46.670731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:46.670731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:08:46.670731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:08:46.670731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:08:46.671691 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:08:46.671691 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:46.671691 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:46.671691 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:46.671691 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:46.671691 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:46.671691 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:46.671691 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:46.671691 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:46.671691 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:46.671691 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:46.671691 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:46.671691 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:46.671691 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:46.671691 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:46.671691 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:46.671691 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:46.672782 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:08:46.672782 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:08:46.672782 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:08:46.672782 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:08:46.673001 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:46.673079 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 253/505] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:08:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:46.673146 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd1bbd-b21b-496c-a94b-1e9c2bad605c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:46.700870 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 253/506] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:08:46.701875 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3730d99-c2cb-42bd-9562-0a141206959b None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:46.775405 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd1bbd-b21b-496c-a94b-1e9c2bad605c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:46.798924 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3730d99-c2cb-42bd-9562-0a141206959b None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:46.812964 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc96daa-d3c1-4e98-a831-34a2177e1909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:46.813636 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc96daa-d3c1-4e98-a831-34a2177e1909 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:46.813925 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc96daa-d3c1-4e98-a831-34a2177e1909 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:46.814204 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc96daa-d3c1-4e98-a831-34a2177e1909 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:46.814953 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc96daa-d3c1-4e98-a831-34a2177e1909 None admin] RBAC: Adding query filter params (name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:46.815264 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc96daa-d3c1-4e98-a831-34a2177e1909 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:46.816675 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc96daa-d3c1-4e98-a831-34a2177e1909 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:46.825867 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 254/507] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Jun 21 20:08:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:46.827311 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc96daa-d3c1-4e98-a831-34a2177e1909 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:46.832501 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20868016-97e7-43fd-921d-97ac1d2309c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:46.833313 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20868016-97e7-43fd-921d-97ac1d2309c1 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:46.833756 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20868016-97e7-43fd-921d-97ac1d2309c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:46.834210 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20868016-97e7-43fd-921d-97ac1d2309c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:46.847109 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20868016-97e7-43fd-921d-97ac1d2309c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:46.848746 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20868016-97e7-43fd-921d-97ac1d2309c1 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:46.865728 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:46.867598 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-20868016-97e7-43fd-921d-97ac1d2309c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:08:46.867598 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:46.867598 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:46.867598 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:46.867598 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:46.867598 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:46.867598 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:46.867598 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:46.867598 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:46.867598 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:46.867598 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:46.867598 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:46.867598 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:08:46.867598 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:08:46.867598 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:08:46.868659 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:08:46.868659 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:46.868659 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:46.868659 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:46.868659 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:46.868659 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:46.868659 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:46.868659 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:46.868659 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:46.868659 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:46.868659 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:46.868659 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:46.868659 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:46.868659 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:46.868659 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:46.868659 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:46.868659 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:46.869514 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:08:46.869514 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:08:46.869514 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:08:46.869514 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:08:46.869514 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 254/508] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:08:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:46.869796 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20868016-97e7-43fd-921d-97ac1d2309c1 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:46.895995 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:46.933713 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc96daa-d3c1-4e98-a831-34a2177e1909 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:46.966564 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e50071-52d8-4165-8365-d8ef00a4fd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:46.966733 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20868016-97e7-43fd-921d-97ac1d2309c1 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:46.967178 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e50071-52d8-4165-8365-d8ef00a4fd95 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:46.967467 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e50071-52d8-4165-8365-d8ef00a4fd95 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:46.967752 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e50071-52d8-4165-8365-d8ef00a4fd95 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:46.968619 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e50071-52d8-4165-8365-d8ef00a4fd95 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:46.968940 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e50071-52d8-4165-8365-d8ef00a4fd95 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:46.970379 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e50071-52d8-4165-8365-d8ef00a4fd95 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:46.988818 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 255/509] 10.222.0.15 () {56 vars in 1137 bytes} [Tue Jun 21 20:08:46 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:46.989609 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e50071-52d8-4165-8365-d8ef00a4fd95 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:47.005383 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5c182-2665-4cfc-8441-3104333f5500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:47.006082 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5c182-2665-4cfc-8441-3104333f5500 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:47.006372 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5c182-2665-4cfc-8441-3104333f5500 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:47.006661 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5c182-2665-4cfc-8441-3104333f5500 None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:47.007394 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff5c182-2665-4cfc-8441-3104333f5500 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:47.007710 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff5c182-2665-4cfc-8441-3104333f5500 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:47.009108 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff5c182-2665-4cfc-8441-3104333f5500 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:47.020252 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 255/510] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:08:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:47.021026 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5c182-2665-4cfc-8441-3104333f5500 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:47.081760 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:47.089414 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e50071-52d8-4165-8365-d8ef00a4fd95 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:47.105410 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:47.120896 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5c182-2665-4cfc-8441-3104333f5500 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:47.123016 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162908fd-8ad5-4942-8223-20b80910dc7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:47.123810 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162908fd-8ad5-4942-8223-20b80910dc7d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:47.124145 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162908fd-8ad5-4942-8223-20b80910dc7d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:47.124432 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162908fd-8ad5-4942-8223-20b80910dc7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:47.134110 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162908fd-8ad5-4942-8223-20b80910dc7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:47.135547 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162908fd-8ad5-4942-8223-20b80910dc7d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:47.152822 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-162908fd-8ad5-4942-8223-20b80910dc7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:08:47.152822 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:47.152822 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:47.152822 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:47.152822 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:47.152822 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:47.152822 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:47.152822 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:47.152822 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:47.152822 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:47.152822 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:47.152822 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:47.152822 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:08:47.152822 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:08:47.152822 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:08:47.153827 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:08:47.153827 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:47.153827 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:47.153827 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:47.153827 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:47.153827 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:47.153827 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:47.153827 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:47.153827 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:47.153827 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:47.153827 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:47.153827 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:47.153827 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:47.153827 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:47.153827 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:47.153827 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:47.153827 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:47.154715 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:08:47.154715 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:08:47.154715 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:08:47.154715 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:08:47.154935 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f1b460-9405-4fa7-8829-b0157b298878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:47.155022 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 256/511] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:08:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:47.155099 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1b460-9405-4fa7-8829-b0157b298878 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:47.155167 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162908fd-8ad5-4942-8223-20b80910dc7d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:47.155233 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1b460-9405-4fa7-8829-b0157b298878 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:47.155233 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1b460-9405-4fa7-8829-b0157b298878 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:47.169678 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f1b460-9405-4fa7-8829-b0157b298878 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:47.171140 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f1b460-9405-4fa7-8829-b0157b298878 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:47.188007 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-70f1b460-9405-4fa7-8829-b0157b298878 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:08:47.188007 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:47.188007 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:47.188007 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:47.188007 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:47.188007 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:47.188007 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:47.188007 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:47.188007 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:47.188007 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:47.188007 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:47.188007 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:47.188007 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:08:47.188007 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:08:47.188007 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:08:47.189017 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:08:47.189017 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:47.189017 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:47.189017 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:47.189017 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:47.189017 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:47.189017 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:47.189017 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:47.189017 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:47.189017 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:47.189017 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:47.189017 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:47.189017 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:47.189017 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:47.189017 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:47.189017 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:47.189017 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:47.190047 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:08:47.190047 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:08:47.190047 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:08:47.190047 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:08:47.193570 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 256/512] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:08:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:47.194529 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f1b460-9405-4fa7-8829-b0157b298878 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:47.259859 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162908fd-8ad5-4942-8223-20b80910dc7d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:47.293858 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89ea56f-8888-48c1-8323-0f37eb18d334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:47.294524 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ea56f-8888-48c1-8323-0f37eb18d334 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:47.294808 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ea56f-8888-48c1-8323-0f37eb18d334 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:47.295087 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ea56f-8888-48c1-8323-0f37eb18d334 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:47.295803 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89ea56f-8888-48c1-8323-0f37eb18d334 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:47.296139 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89ea56f-8888-48c1-8323-0f37eb18d334 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:47.297502 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89ea56f-8888-48c1-8323-0f37eb18d334 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:47.299824 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f1b460-9405-4fa7-8829-b0157b298878 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:47.308458 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 257/513] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:08:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:47.309406 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89ea56f-8888-48c1-8323-0f37eb18d334 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:47.318259 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:47.337352 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d04402f-33eb-4203-926a-8b439706b9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:47.338013 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04402f-33eb-4203-926a-8b439706b9ca None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:47.338301 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04402f-33eb-4203-926a-8b439706b9ca None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:47.338587 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04402f-33eb-4203-926a-8b439706b9ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:47.347206 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:47.408861 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d04402f-33eb-4203-926a-8b439706b9ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:47.410452 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89ea56f-8888-48c1-8323-0f37eb18d334 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:47.410566 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d04402f-33eb-4203-926a-8b439706b9ca None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:47.445589 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce2239-f49f-45d8-b0c0-1bf801806699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:47.446397 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce2239-f49f-45d8-b0c0-1bf801806699 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:47.446688 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce2239-f49f-45d8-b0c0-1bf801806699 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:47.446973 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce2239-f49f-45d8-b0c0-1bf801806699 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:47.453534 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce2239-f49f-45d8-b0c0-1bf801806699 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:47.454964 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce2239-f49f-45d8-b0c0-1bf801806699 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:47.470861 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-76ce2239-f49f-45d8-b0c0-1bf801806699 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:08:47.470861 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:47.470861 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:47.470861 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:47.470861 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:47.470861 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:47.470861 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:47.470861 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:47.470861 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:47.470861 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:47.470861 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:47.470861 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:47.470861 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 20:08:47.470861 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 20:08:47.470861 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 20:08:47.471906 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 20:08:47.471906 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:47.471906 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:47.471906 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:47.471906 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:47.471906 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:47.471906 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:47.471906 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:47.471906 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:47.471906 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:47.471906 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:47.471906 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:47.471906 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:47.471906 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:47.471906 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:47.471906 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:47.471906 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:47.472842 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 20:08:47.472842 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 20:08:47.472842 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 20:08:47.472842 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 20:08:47.472842 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 20:08:47.472842 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 20:08:47.472842 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:08:47.472842 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:08:47.472842 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 258/514] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jun 21 20:08:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:47.473326 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce2239-f49f-45d8-b0c0-1bf801806699 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:47.516292 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 257/515] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:08:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 20:08:47.517055 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d04402f-33eb-4203-926a-8b439706b9ca None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:47.537668 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:47.557412 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:47.572978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce2239-f49f-45d8-b0c0-1bf801806699 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:47.610199 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35975a91-e40b-41db-9fb4-3d4a2a5e7285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:47.610868 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35975a91-e40b-41db-9fb4-3d4a2a5e7285 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:47.611155 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35975a91-e40b-41db-9fb4-3d4a2a5e7285 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:47.611434 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35975a91-e40b-41db-9fb4-3d4a2a5e7285 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:47.612186 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35975a91-e40b-41db-9fb4-3d4a2a5e7285 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:47.612498 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35975a91-e40b-41db-9fb4-3d4a2a5e7285 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:47.613871 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35975a91-e40b-41db-9fb4-3d4a2a5e7285 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:47.619030 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d04402f-33eb-4203-926a-8b439706b9ca None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:47.626360 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 259/516] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:08:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:47.626980 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35975a91-e40b-41db-9fb4-3d4a2a5e7285 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:47.655821 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ff9a7-a345-482f-93a9-11b4a49e9ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:47.656525 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ff9a7-a345-482f-93a9-11b4a49e9ffa None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:47.656815 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ff9a7-a345-482f-93a9-11b4a49e9ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:47.657098 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ff9a7-a345-482f-93a9-11b4a49e9ffa None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:47.657826 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904ff9a7-a345-482f-93a9-11b4a49e9ffa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:47.658139 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904ff9a7-a345-482f-93a9-11b4a49e9ffa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:47.659511 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904ff9a7-a345-482f-93a9-11b4a49e9ffa None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:47.672050 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 258/517] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:08:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:47.672856 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ff9a7-a345-482f-93a9-11b4a49e9ffa None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:47.729613 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35975a91-e40b-41db-9fb4-3d4a2a5e7285 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:47.754855 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:47.763890 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6755cfc5-f0c3-4b1d-9318-3998846a3e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:47.764720 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755cfc5-f0c3-4b1d-9318-3998846a3e8f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:47.765013 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755cfc5-f0c3-4b1d-9318-3998846a3e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:47.765294 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755cfc5-f0c3-4b1d-9318-3998846a3e8f None admin] PATH_INFO: `/v3/users/glance` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:47.770602 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:47.773319 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6755cfc5-f0c3-4b1d-9318-3998846a3e8f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:47.774751 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6755cfc5-f0c3-4b1d-9318-3998846a3e8f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:47.775072 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ff9a7-a345-482f-93a9-11b4a49e9ffa None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:47.790914 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-6755cfc5-f0c3-4b1d-9318-3998846a3e8f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 21 20:08:47.790914 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:47.790914 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:47.790914 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:47.790914 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:47.790914 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:47.790914 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:47.790914 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:47.790914 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:47.790914 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:47.790914 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:47.790914 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:47.790914 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 20:08:47.790914 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 20:08:47.790914 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 20:08:47.790914 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 20:08:47.791850 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:47.791850 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:47.791850 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 20:08:47.791850 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:08:47.791850 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 20:08:47.791850 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:08:47.791850 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:47.791850 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:47.791850 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:47.791850 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:47.791850 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:47.791850 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:47.791850 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:47.791850 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:47.791850 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:47.791850 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:47.791850 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:47.791850 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:47.792818 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:47.792818 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:47.792818 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 20:08:47.792818 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 20:08:47.792818 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 20:08:47.792818 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 20:08:47.792818 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 20:08:47.792818 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 20:08:47.792818 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 21 20:08:47.792818 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:08:47.792818 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 260/518] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:08:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:47.793371 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6755cfc5-f0c3-4b1d-9318-3998846a3e8f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:47.817099 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d8347c-8d50-4ccc-b65e-e2d7405ec078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:47.817772 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8347c-8d50-4ccc-b65e-e2d7405ec078 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:47.818096 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8347c-8d50-4ccc-b65e-e2d7405ec078 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:47.818379 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8347c-8d50-4ccc-b65e-e2d7405ec078 None admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:47.819183 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d8347c-8d50-4ccc-b65e-e2d7405ec078 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:47.819500 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d8347c-8d50-4ccc-b65e-e2d7405ec078 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:47.821128 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d8347c-8d50-4ccc-b65e-e2d7405ec078 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:47.839387 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 259/519] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jun 21 20:08:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:47.839387 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d8347c-8d50-4ccc-b65e-e2d7405ec078 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:47.899068 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6755cfc5-f0c3-4b1d-9318-3998846a3e8f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:47.932624 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32adf523-5b47-4051-89ee-8e149121c23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:47.933426 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32adf523-5b47-4051-89ee-8e149121c23b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:47.933716 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32adf523-5b47-4051-89ee-8e149121c23b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:47.934002 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32adf523-5b47-4051-89ee-8e149121c23b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:47.944606 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32adf523-5b47-4051-89ee-8e149121c23b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:47.946112 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d8347c-8d50-4ccc-b65e-e2d7405ec078 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:47.946936 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32adf523-5b47-4051-89ee-8e149121c23b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:47.964238 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-32adf523-5b47-4051-89ee-8e149121c23b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:08:47.964238 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:47.964238 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:47.964238 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:47.964238 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:47.964238 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:47.964238 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:47.964238 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:47.964238 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:47.964238 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:47.964238 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:47.964238 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:47.964238 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:08:47.964238 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:08:47.964238 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:08:47.965201 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:08:47.965201 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:47.965201 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:47.965201 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:47.965201 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:47.965201 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:47.965201 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:47.965201 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:47.965201 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:47.965201 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:47.965201 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:47.965201 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:47.965201 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:47.965201 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:47.965201 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:47.965201 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:47.965201 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:47.966029 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:08:47.966029 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:08:47.966029 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:08:47.966029 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:08:47.966029 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 261/520] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:08:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:47.966922 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32adf523-5b47-4051-89ee-8e149121c23b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:47.980145 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c6058-2661-4540-8579-b1d17ba68d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:47.980812 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c6058-2661-4540-8579-b1d17ba68d8b None admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:47.981096 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c6058-2661-4540-8579-b1d17ba68d8b None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:47.981375 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c6058-2661-4540-8579-b1d17ba68d8b None admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:47.982079 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46c6058-2661-4540-8579-b1d17ba68d8b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:47.983507 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46c6058-2661-4540-8579-b1d17ba68d8b None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:48.002731 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 260/521] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Jun 21 20:08:47 2022] POST /identity/v3/users => generated 247 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:08:48.003538 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c6058-2661-4540-8579-b1d17ba68d8b None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:48.019705 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:48.025432 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:48.089827 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32adf523-5b47-4051-89ee-8e149121c23b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:48.127190 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c6058-2661-4540-8579-b1d17ba68d8b None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:48.128815 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dddf0b-f34c-4169-a5a9-d697d0b27558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:48.129645 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dddf0b-f34c-4169-a5a9-d697d0b27558 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:48.129937 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dddf0b-f34c-4169-a5a9-d697d0b27558 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:48.130218 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dddf0b-f34c-4169-a5a9-d697d0b27558 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:48.140078 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dddf0b-f34c-4169-a5a9-d697d0b27558 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:48.141554 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dddf0b-f34c-4169-a5a9-d697d0b27558 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:48.158010 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-27dddf0b-f34c-4169-a5a9-d697d0b27558 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 21 20:08:48.158010 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:48.158010 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:48.158010 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:48.158010 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:48.158010 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:48.158010 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:48.158010 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:48.158010 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:48.158010 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:48.158010 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:48.158010 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:48.158010 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 20:08:48.158010 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 20:08:48.158010 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 20:08:48.158010 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 20:08:48.159154 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:48.159154 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:48.159154 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 20:08:48.159154 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:08:48.159154 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 20:08:48.159154 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:08:48.159154 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:48.159154 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:48.159154 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:48.159154 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:48.159154 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:48.159154 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:48.159154 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:48.159154 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:48.159154 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:48.159154 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:48.159154 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:48.159154 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:48.160126 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:48.160126 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:48.160126 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 20:08:48.160126 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 20:08:48.160126 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 20:08:48.160126 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 20:08:48.160126 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 20:08:48.160126 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 20:08:48.160126 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 21 20:08:48.160126 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:08:48.162582 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 262/522] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Jun 21 20:08:47 2022] GET /identity/v3/users/neutron => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:48.163498 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dddf0b-f34c-4169-a5a9-d697d0b27558 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:48.171547 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae467593-bc4a-4055-a6e0-e122e94d7451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:48.172260 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae467593-bc4a-4055-a6e0-e122e94d7451 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:48.172550 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae467593-bc4a-4055-a6e0-e122e94d7451 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:48.172827 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae467593-bc4a-4055-a6e0-e122e94d7451 None admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:48.173677 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae467593-bc4a-4055-a6e0-e122e94d7451 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:48.173990 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae467593-bc4a-4055-a6e0-e122e94d7451 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:48.175440 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae467593-bc4a-4055-a6e0-e122e94d7451 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:48.217832 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 261/523] 10.222.0.15 () {56 vars in 1137 bytes} [Tue Jun 21 20:08:48 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:48.218530 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae467593-bc4a-4055-a6e0-e122e94d7451 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:48.277419 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:48.281317 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dddf0b-f34c-4169-a5a9-d697d0b27558 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:48.297338 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:48.319200 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded6364-3fbf-4db4-b0f6-625d51809f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:48.319863 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded6364-3fbf-4db4-b0f6-625d51809f73 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:48.320202 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded6364-3fbf-4db4-b0f6-625d51809f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:48.320483 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded6364-3fbf-4db4-b0f6-625d51809f73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:48.321457 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ded6364-3fbf-4db4-b0f6-625d51809f73 None admin] RBAC: Adding query filter params (role.id=a4929ef60a294190b2d59e8d61e05063, scope.project.id=4dcb71ef7b6e49148edd61a1eb8da7bb, user.id=3918fe05c8634bc39f3e295374701465) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:48.321786 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ded6364-3fbf-4db4-b0f6-625d51809f73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:48.323225 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ded6364-3fbf-4db4-b0f6-625d51809f73 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:48.328561 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae467593-bc4a-4055-a6e0-e122e94d7451 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:48.335991 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 263/524] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jun 21 20:08:48 2022] GET /identity/v3/role_assignments?user.id=3918fe05c8634bc39f3e295374701465&scope.project.id=4dcb71ef7b6e49148edd61a1eb8da7bb&role.id=a4929ef60a294190b2d59e8d61e05063 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:48.335991 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded6364-3fbf-4db4-b0f6-625d51809f73 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:48.375389 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab2468e-754d-49f0-92a0-88599059f7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:48.376216 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2468e-754d-49f0-92a0-88599059f7a0 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:48.376572 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2468e-754d-49f0-92a0-88599059f7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:48.376925 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2468e-754d-49f0-92a0-88599059f7a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:48.377749 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab2468e-754d-49f0-92a0-88599059f7a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:48.378153 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab2468e-754d-49f0-92a0-88599059f7a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:48.379666 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab2468e-754d-49f0-92a0-88599059f7a0 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:48.394338 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 262/525] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:08:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:48.395637 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab2468e-754d-49f0-92a0-88599059f7a0 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:48.460480 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded6364-3fbf-4db4-b0f6-625d51809f73 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:48.503482 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f639475-aec8-4d12-aee4-c297ec0b56e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:48.504204 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f639475-aec8-4d12-aee4-c297ec0b56e8 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:48.504495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f639475-aec8-4d12-aee4-c297ec0b56e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:48.504779 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f639475-aec8-4d12-aee4-c297ec0b56e8 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:48.505974 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f639475-aec8-4d12-aee4-c297ec0b56e8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:48.505974 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f639475-aec8-4d12-aee4-c297ec0b56e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:48.507701 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f639475-aec8-4d12-aee4-c297ec0b56e8 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:48.530553 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab2468e-754d-49f0-92a0-88599059f7a0 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:48.531049 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 264/526] 10.222.0.15 () {56 vars in 1139 bytes} [Tue Jun 21 20:08:48 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:48.531837 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f639475-aec8-4d12-aee4-c297ec0b56e8 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:48.559296 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:48.571422 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7654c0b1-c8d7-4085-931f-7b07bfd0fe1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:48.572452 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654c0b1-c8d7-4085-931f-7b07bfd0fe1b None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:48.572946 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654c0b1-c8d7-4085-931f-7b07bfd0fe1b None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:48.573509 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654c0b1-c8d7-4085-931f-7b07bfd0fe1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:48.588275 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:48.659626 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7654c0b1-c8d7-4085-931f-7b07bfd0fe1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:48.661337 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7654c0b1-c8d7-4085-931f-7b07bfd0fe1b None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:48.668324 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f639475-aec8-4d12-aee4-c297ec0b56e8 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:48.711947 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb9ebf-07fd-4578-85da-b202cae5da91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:48.712864 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb9ebf-07fd-4578-85da-b202cae5da91 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:48.713242 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb9ebf-07fd-4578-85da-b202cae5da91 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:48.713597 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb9ebf-07fd-4578-85da-b202cae5da91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:48.720490 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbb9ebf-07fd-4578-85da-b202cae5da91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:48.722307 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbb9ebf-07fd-4578-85da-b202cae5da91 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:48.737227 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-3dbb9ebf-07fd-4578-85da-b202cae5da91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:08:48.737227 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:48.737227 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:48.737227 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:48.737227 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:48.737227 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:48.737227 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:48.737227 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:48.737227 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:48.737227 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:48.737227 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:48.737227 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:48.737227 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 20:08:48.737227 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 20:08:48.737227 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 20:08:48.738127 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 20:08:48.738127 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:48.738127 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:48.738127 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:48.738127 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:48.738127 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:48.738127 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:48.738127 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:48.738127 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:48.738127 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:48.738127 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:48.738127 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:48.738127 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:48.738127 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:48.738127 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:48.738127 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:48.738127 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:48.738975 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 20:08:48.738975 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 20:08:48.738975 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 20:08:48.738975 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 20:08:48.738975 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 20:08:48.738975 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 20:08:48.738975 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:08:48.738975 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:08:48.738975 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 265/527] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jun 21 20:08:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:48.740186 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb9ebf-07fd-4578-85da-b202cae5da91 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:48.784432 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 263/528] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:08:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 20:08:48.785269 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7654c0b1-c8d7-4085-931f-7b07bfd0fe1b None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:48.819378 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:48.851460 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:48.876370 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb9ebf-07fd-4578-85da-b202cae5da91 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:48.910808 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1628a186-12a0-4881-819b-6db9792b1911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:48.912406 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628a186-12a0-4881-819b-6db9792b1911 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:48.912942 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628a186-12a0-4881-819b-6db9792b1911 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:48.913614 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628a186-12a0-4881-819b-6db9792b1911 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:48.923518 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7654c0b1-c8d7-4085-931f-7b07bfd0fe1b None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:48.963046 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827cea49-121e-4923-8fd2-125e8df350a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:48.964128 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827cea49-121e-4923-8fd2-125e8df350a1 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:48.964610 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827cea49-121e-4923-8fd2-125e8df350a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:48.965169 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827cea49-121e-4923-8fd2-125e8df350a1 None admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:48.966148 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827cea49-121e-4923-8fd2-125e8df350a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:48.966650 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827cea49-121e-4923-8fd2-125e8df350a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:48.968642 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827cea49-121e-4923-8fd2-125e8df350a1 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:48.986715 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 264/529] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jun 21 20:08:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:48.987985 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827cea49-121e-4923-8fd2-125e8df350a1 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:48.994170 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1628a186-12a0-4881-819b-6db9792b1911 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:48.995654 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1628a186-12a0-4881-819b-6db9792b1911 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:49.095819 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:49.099402 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:49.112179 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827cea49-121e-4923-8fd2-125e8df350a1 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:49.123973 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 266/530] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:08:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 20:08:49.123973 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1628a186-12a0-4881-819b-6db9792b1911 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:49.149678 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd4882-826d-4b30-96f5-729f28ef1b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:49.150486 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd4882-826d-4b30-96f5-729f28ef1b8f None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:49.150775 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd4882-826d-4b30-96f5-729f28ef1b8f None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:49.151057 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd4882-826d-4b30-96f5-729f28ef1b8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:49.164180 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dd4882-826d-4b30-96f5-729f28ef1b8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:49.165691 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dd4882-826d-4b30-96f5-729f28ef1b8f None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:49.184028 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-23dd4882-826d-4b30-96f5-729f28ef1b8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:08:49.184028 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:49.184028 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:49.184028 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:49.184028 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:49.184028 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:49.184028 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:49.184028 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:49.184028 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:49.184028 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:49.184028 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:49.184028 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:49.184028 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:08:49.184028 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:08:49.184028 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:08:49.184942 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:08:49.184942 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:49.184942 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:49.184942 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:49.184942 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:49.184942 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:49.184942 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:49.184942 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:49.184942 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:49.184942 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:49.184942 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:49.184942 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:49.184942 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:49.184942 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:49.184942 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:49.184942 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:49.184942 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:49.185786 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:08:49.185786 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:08:49.185786 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:08:49.185786 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:08:49.189829 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 265/531] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:08:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:49.190668 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd4882-826d-4b30-96f5-729f28ef1b8f None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:49.231880 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1628a186-12a0-4881-819b-6db9792b1911 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:49.266435 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a105408a-e727-4421-b10b-cd01a6c7d8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:49.267093 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105408a-e727-4421-b10b-cd01a6c7d8cc None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:49.267383 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105408a-e727-4421-b10b-cd01a6c7d8cc None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:49.267652 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105408a-e727-4421-b10b-cd01a6c7d8cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:49.268509 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a105408a-e727-4421-b10b-cd01a6c7d8cc None admin] RBAC: Adding query filter params (role.id=a4929ef60a294190b2d59e8d61e05063, scope.project.id=4dcb71ef7b6e49148edd61a1eb8da7bb, user.id=d95478de171141ce85876e852d081149) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:49.268829 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a105408a-e727-4421-b10b-cd01a6c7d8cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:49.270254 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a105408a-e727-4421-b10b-cd01a6c7d8cc None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:49.276648 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 267/532] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jun 21 20:08:49 2022] GET /identity/v3/role_assignments?user.id=d95478de171141ce85876e852d081149&scope.project.id=4dcb71ef7b6e49148edd61a1eb8da7bb&role.id=a4929ef60a294190b2d59e8d61e05063 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:49.277350 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a105408a-e727-4421-b10b-cd01a6c7d8cc None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:49.297845 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd4882-826d-4b30-96f5-729f28ef1b8f None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:49.336366 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2292f-48a8-4d66-8982-04cdc03350a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:49.337228 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2292f-48a8-4d66-8982-04cdc03350a8 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:49.337521 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2292f-48a8-4d66-8982-04cdc03350a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:49.337808 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2292f-48a8-4d66-8982-04cdc03350a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:49.348365 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:49.349961 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd2292f-48a8-4d66-8982-04cdc03350a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:49.351496 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd2292f-48a8-4d66-8982-04cdc03350a8 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:49.363243 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:49.386382 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a105408a-e727-4421-b10b-cd01a6c7d8cc None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:49.396269 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-6fd2292f-48a8-4d66-8982-04cdc03350a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:08:49.396269 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:49.396269 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:49.396269 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:49.396269 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:49.396269 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:49.396269 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:49.396269 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:49.396269 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:49.396269 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:49.396269 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:49.396269 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:49.396269 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:08:49.396269 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:08:49.396269 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:08:49.397247 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:08:49.397247 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:49.397247 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:49.397247 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:49.397247 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:49.397247 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:49.397247 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:49.397247 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:49.397247 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:49.397247 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:49.397247 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:49.397247 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:49.397247 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:49.397247 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:49.397247 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:49.397247 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:49.397247 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:49.398093 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:08:49.398093 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:08:49.398093 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:08:49.398093 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:08:49.398093 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 266/533] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:08:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:49.413476 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2292f-48a8-4d66-8982-04cdc03350a8 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:49.433553 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba007aaa-2771-4f53-8e7c-38ec28ee5291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:49.434255 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba007aaa-2771-4f53-8e7c-38ec28ee5291 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:49.434542 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba007aaa-2771-4f53-8e7c-38ec28ee5291 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:49.434827 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba007aaa-2771-4f53-8e7c-38ec28ee5291 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:49.435574 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba007aaa-2771-4f53-8e7c-38ec28ee5291 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:49.435890 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba007aaa-2771-4f53-8e7c-38ec28ee5291 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:49.437326 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba007aaa-2771-4f53-8e7c-38ec28ee5291 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:49.474046 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 268/534] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:08:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:49.477633 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba007aaa-2771-4f53-8e7c-38ec28ee5291 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:49.595052 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba007aaa-2771-4f53-8e7c-38ec28ee5291 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:49.610967 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:49.613958 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2292f-48a8-4d66-8982-04cdc03350a8 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:49.638083 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8027c0-eaec-4e59-9cf4-6b76cc0a0317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:49.638899 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8027c0-eaec-4e59-9cf4-6b76cc0a0317 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:49.639191 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8027c0-eaec-4e59-9cf4-6b76cc0a0317 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:49.639476 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8027c0-eaec-4e59-9cf4-6b76cc0a0317 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:49.646765 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8027c0-eaec-4e59-9cf4-6b76cc0a0317 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:49.648486 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8027c0-eaec-4e59-9cf4-6b76cc0a0317 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:49.662855 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-aa8027c0-eaec-4e59-9cf4-6b76cc0a0317 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:08:49.662855 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:49.662855 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:49.662855 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:49.662855 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:49.662855 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:49.662855 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:49.662855 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:49.662855 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:49.662855 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:49.662855 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:49.662855 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:49.662855 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 20:08:49.662855 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 20:08:49.662855 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 20:08:49.663702 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 20:08:49.663702 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:49.663702 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:49.663702 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:49.663702 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:49.663702 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:49.663702 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:49.663702 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:49.663702 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:49.663702 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:49.663702 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:49.663702 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:49.663702 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:49.663702 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:49.663702 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:49.663702 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:49.663702 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:49.664570 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 20:08:49.664570 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 20:08:49.664570 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 20:08:49.664570 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 20:08:49.664570 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 20:08:49.664570 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 20:08:49.664570 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:08:49.664570 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:08:49.664570 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 269/535] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jun 21 20:08:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:49.674559 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8027c0-eaec-4e59-9cf4-6b76cc0a0317 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:49.700777 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e423c-b9c6-459b-a2ab-6ffa6737a276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:49.701500 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e423c-b9c6-459b-a2ab-6ffa6737a276 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:49.701793 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e423c-b9c6-459b-a2ab-6ffa6737a276 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:49.702074 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e423c-b9c6-459b-a2ab-6ffa6737a276 None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:49.702858 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7e423c-b9c6-459b-a2ab-6ffa6737a276 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:49.703177 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7e423c-b9c6-459b-a2ab-6ffa6737a276 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:49.705473 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7e423c-b9c6-459b-a2ab-6ffa6737a276 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:49.728787 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 267/536] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:08:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:08:49.735174 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e423c-b9c6-459b-a2ab-6ffa6737a276 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:49.835604 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8027c0-eaec-4e59-9cf4-6b76cc0a0317 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:49.842275 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:49.879215 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278156a9-e401-4905-9279-9f18a37e64a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:49.879894 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278156a9-e401-4905-9279-9f18a37e64a5 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:49.880238 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278156a9-e401-4905-9279-9f18a37e64a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:49.880540 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278156a9-e401-4905-9279-9f18a37e64a5 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:49.881328 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278156a9-e401-4905-9279-9f18a37e64a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:49.881636 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278156a9-e401-4905-9279-9f18a37e64a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:49.883072 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278156a9-e401-4905-9279-9f18a37e64a5 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:49.903546 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 270/537] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jun 21 20:08:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:49.909423 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278156a9-e401-4905-9279-9f18a37e64a5 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:49.942058 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e423c-b9c6-459b-a2ab-6ffa6737a276 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:49.966789 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:50.016454 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c5cd8c-6b6a-4206-a745-f82415bc2a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:50.017269 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5cd8c-6b6a-4206-a745-f82415bc2a61 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:50.017563 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5cd8c-6b6a-4206-a745-f82415bc2a61 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:50.017850 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5cd8c-6b6a-4206-a745-f82415bc2a61 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:50.033580 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c5cd8c-6b6a-4206-a745-f82415bc2a61 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:50.035133 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c5cd8c-6b6a-4206-a745-f82415bc2a61 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:50.053724 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278156a9-e401-4905-9279-9f18a37e64a5 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:50.068873 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-69c5cd8c-6b6a-4206-a745-f82415bc2a61 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:08:50.068873 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:50.068873 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:50.068873 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:50.068873 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:50.068873 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:50.068873 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:50.068873 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:50.068873 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:50.068873 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:50.068873 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:50.068873 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:50.068873 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 20:08:50.068873 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 20:08:50.068873 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 20:08:50.069814 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 20:08:50.069814 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:50.069814 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:50.069814 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:50.069814 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:50.069814 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:50.069814 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:50.069814 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:50.069814 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:50.069814 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:50.069814 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:50.069814 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:50.069814 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:50.069814 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:50.069814 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:50.069814 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:50.069814 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:50.070646 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 20:08:50.070646 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 20:08:50.070646 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 20:08:50.070646 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 20:08:50.070646 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 20:08:50.070646 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 20:08:50.070646 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:08:50.070646 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:08:50.070646 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 268/538] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jun 21 20:08:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:08:50.085582 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c5cd8c-6b6a-4206-a745-f82415bc2a61 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:50.093974 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c57a184-3e56-48c7-ae3a-509a75a55601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:50.094925 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57a184-3e56-48c7-ae3a-509a75a55601 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:50.095213 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57a184-3e56-48c7-ae3a-509a75a55601 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:50.095495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57a184-3e56-48c7-ae3a-509a75a55601 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:50.097300 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c57a184-3e56-48c7-ae3a-509a75a55601 None admin] RBAC: Adding query filter params (role.id=a4929ef60a294190b2d59e8d61e05063, scope.project.id=4dcb71ef7b6e49148edd61a1eb8da7bb, user.id=30400df887ee433086d1810331785891) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:50.097627 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c57a184-3e56-48c7-ae3a-509a75a55601 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:50.099075 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c57a184-3e56-48c7-ae3a-509a75a55601 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:50.106596 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 271/539] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jun 21 20:08:49 2022] GET /identity/v3/role_assignments?user.id=30400df887ee433086d1810331785891&scope.project.id=4dcb71ef7b6e49148edd61a1eb8da7bb&role.id=a4929ef60a294190b2d59e8d61e05063 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:50.249704 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c5cd8c-6b6a-4206-a745-f82415bc2a61 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:50.251944 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f92f0-0fb1-47d2-b0e3-bed985d677fc None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:50.252496 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f92f0-0fb1-47d2-b0e3-bed985d677fc None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:50.252792 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f92f0-0fb1-47d2-b0e3-bed985d677fc None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:50.256860 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 272/540] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:08:50.262697 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff84236-2291-40a6-ae40-6e54f1daa692 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:50.262996 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff84236-2291-40a6-ae40-6e54f1daa692 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:50.263250 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff84236-2291-40a6-ae40-6e54f1daa692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:50.272973 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:50.287475 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-aff84236-2291-40a6-ae40-6e54f1daa692 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:50.288731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-aff84236-2291-40a6-ae40-6e54f1daa692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:50.298180 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8897e7a6-f8ae-4ac7-bdf2-7bf890e5d293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:50.298859 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897e7a6-f8ae-4ac7-bdf2-7bf890e5d293 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:50.299148 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897e7a6-f8ae-4ac7-bdf2-7bf890e5d293 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:50.299705 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897e7a6-f8ae-4ac7-bdf2-7bf890e5d293 None admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:50.300258 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8897e7a6-f8ae-4ac7-bdf2-7bf890e5d293 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:50.300574 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8897e7a6-f8ae-4ac7-bdf2-7bf890e5d293 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:50.302029 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8897e7a6-f8ae-4ac7-bdf2-7bf890e5d293 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:50.320007 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 269/541] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jun 21 20:08:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:08:50.321376 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8897e7a6-f8ae-4ac7-bdf2-7bf890e5d293 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:50.369560 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 273/542] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 20:08:50.435621 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff84236-2291-40a6-ae40-6e54f1daa692 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:50.466461 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:50.470433 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8897e7a6-f8ae-4ac7-bdf2-7bf890e5d293 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:50.508606 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc966a9-877d-46e9-9436-81f920f5e55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:50.509141 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc966a9-877d-46e9-9436-81f920f5e55f None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:50.509400 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc966a9-877d-46e9-9436-81f920f5e55f None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:50.509680 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc966a9-877d-46e9-9436-81f920f5e55f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:50.510517 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc966a9-877d-46e9-9436-81f920f5e55f None admin] RBAC: Adding query filter params (role.id=a4929ef60a294190b2d59e8d61e05063, scope.project.id=4dcb71ef7b6e49148edd61a1eb8da7bb, user.id=1b01b53897d64bbaac6efb6f13d413a1) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:50.510831 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc966a9-877d-46e9-9436-81f920f5e55f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:50.512532 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc966a9-877d-46e9-9436-81f920f5e55f None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:50.524037 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 270/543] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jun 21 20:08:50 2022] GET /identity/v3/role_assignments?user.id=1b01b53897d64bbaac6efb6f13d413a1&scope.project.id=4dcb71ef7b6e49148edd61a1eb8da7bb&role.id=a4929ef60a294190b2d59e8d61e05063 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:08:50.525563 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15606772-cd52-4208-8c36-85f8ddbde226 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:50.525857 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15606772-cd52-4208-8c36-85f8ddbde226 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:50.526139 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15606772-cd52-4208-8c36-85f8ddbde226 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:50.531760 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 271/544] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:08:50.533433 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012a9ae-5a19-4563-b7dd-eb792ca7c943 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:50.533729 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012a9ae-5a19-4563-b7dd-eb792ca7c943 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:50.534013 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012a9ae-5a19-4563-b7dd-eb792ca7c943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:50.563276 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff84236-2291-40a6-ae40-6e54f1daa692 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:50.568404 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-e012a9ae-5a19-4563-b7dd-eb792ca7c943 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:50.569650 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-e012a9ae-5a19-4563-b7dd-eb792ca7c943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:50.619376 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568fb63-5936-4563-9fa8-b30d90ebb618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:50.621502 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568fb63-5936-4563-9fa8-b30d90ebb618 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:50.623182 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568fb63-5936-4563-9fa8-b30d90ebb618 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:50.623685 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568fb63-5936-4563-9fa8-b30d90ebb618 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:50.647155 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2568fb63-5936-4563-9fa8-b30d90ebb618 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:08:50.660300 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:50.667587 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-2568fb63-5936-4563-9fa8-b30d90ebb618 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 20:08:50.667587 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:50.667587 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:50.667587 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:50.667587 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:50.667587 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:50.667587 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:50.667587 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:50.667587 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:50.667587 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:50.667587 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:50.667587 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:50.667587 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:08:50.667587 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:08:50.667587 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:08:50.667587 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:08:50.668556 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:08:50.668556 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:08:50.668556 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:08:50.668556 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:08:50.668556 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:50.668556 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:50.668556 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:50.668556 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:50.668556 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:50.668556 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:50.668556 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:50.668556 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:50.668556 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:50.668556 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:50.668556 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:50.668556 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:50.669340 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:50.669340 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:50.669340 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:50.669340 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:50.669340 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:08:50.669340 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:08:50.669340 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:08:50.669340 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:08:50.669340 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:08:50.669340 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:08:50.669340 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 20:08:50.669340 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:08:50.671877 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 274/545] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Jun 21 20:08:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:08:50.680503 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568fb63-5936-4563-9fa8-b30d90ebb618 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:50.730958 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 272/546] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:08:50.774781 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e012a9ae-5a19-4563-b7dd-eb792ca7c943 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:50.785472 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:50.810301 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568fb63-5936-4563-9fa8-b30d90ebb618 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:50.859999 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da76298-5245-419b-85fc-55cbd95b63a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:50.861521 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da76298-5245-419b-85fc-55cbd95b63a3 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:50.862321 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da76298-5245-419b-85fc-55cbd95b63a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:50.863096 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da76298-5245-419b-85fc-55cbd95b63a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:50.864897 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da76298-5245-419b-85fc-55cbd95b63a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:50.865616 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da76298-5245-419b-85fc-55cbd95b63a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:50.867594 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da76298-5245-419b-85fc-55cbd95b63a3 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:50.876896 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 275/547] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Jun 21 20:08:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:08:50.883360 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da76298-5245-419b-85fc-55cbd95b63a3 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:50.997228 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da76298-5245-419b-85fc-55cbd95b63a3 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:51.016214 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e012a9ae-5a19-4563-b7dd-eb792ca7c943 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:51.042090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6cb5f-40ca-45fe-9b8a-e239ec03c4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:51.043189 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6cb5f-40ca-45fe-9b8a-e239ec03c4f4 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:51.043671 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6cb5f-40ca-45fe-9b8a-e239ec03c4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:51.044171 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6cb5f-40ca-45fe-9b8a-e239ec03c4f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:51.056549 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc6cb5f-40ca-45fe-9b8a-e239ec03c4f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:51.058392 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc6cb5f-40ca-45fe-9b8a-e239ec03c4f4 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:51.068348 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:51.077828 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97201c3c-ccfe-43c7-b957-311510582d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:51.078749 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97201c3c-ccfe-43c7-b957-311510582d9e None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:51.079039 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97201c3c-ccfe-43c7-b957-311510582d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:51.079371 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97201c3c-ccfe-43c7-b957-311510582d9e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:51.080755 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-9fc6cb5f-40ca-45fe-9b8a-e239ec03c4f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:08:51.080755 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:51.080755 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:51.080755 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:51.080755 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:51.080755 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:51.080755 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:51.080755 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:51.080755 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:51.080755 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:51.080755 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:51.080755 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:51.080755 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:08:51.080755 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:08:51.080755 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:08:51.082916 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:08:51.082916 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:51.082916 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:51.082916 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:51.082916 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:51.082916 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:51.082916 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:51.082916 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:51.082916 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:51.082916 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:51.082916 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:51.082916 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:51.082916 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:51.082916 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:51.082916 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:51.082916 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:51.082916 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:51.084324 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:08:51.084324 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:08:51.084324 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:08:51.084324 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:08:51.084324 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 276/548] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:08:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:08:51.091096 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6cb5f-40ca-45fe-9b8a-e239ec03c4f4 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:51.108814 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97201c3c-ccfe-43c7-b957-311510582d9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:08:51.122115 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-97201c3c-ccfe-43c7-b957-311510582d9e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 20:08:51.122115 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:51.122115 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:51.122115 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:51.122115 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:51.122115 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:51.122115 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:51.122115 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:51.122115 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:51.122115 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:51.122115 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:51.122115 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:51.122115 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:08:51.122115 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:08:51.122115 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:08:51.122115 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:08:51.123080 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:08:51.123080 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:08:51.123080 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:08:51.123080 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:08:51.123080 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:51.123080 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:51.123080 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:51.123080 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:51.123080 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:51.123080 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:51.123080 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:51.123080 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:51.123080 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:51.123080 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:51.123080 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:51.123080 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:51.124395 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:51.124395 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:51.124395 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:51.124395 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:51.124395 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:08:51.124395 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:08:51.124395 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:08:51.124395 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:08:51.124395 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:08:51.124395 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:08:51.124395 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 20:08:51.124395 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:08:51.129250 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 273/549] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Jun 21 20:08:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:08:51.132113 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97201c3c-ccfe-43c7-b957-311510582d9e None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:51.197192 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:51.230899 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6cb5f-40ca-45fe-9b8a-e239ec03c4f4 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:51.266123 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f6614-7adf-423e-a63a-4acaeb458152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:51.266797 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f6614-7adf-423e-a63a-4acaeb458152 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:51.267088 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f6614-7adf-423e-a63a-4acaeb458152 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:51.267373 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f6614-7adf-423e-a63a-4acaeb458152 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:51.268141 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521f6614-7adf-423e-a63a-4acaeb458152 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:51.268457 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521f6614-7adf-423e-a63a-4acaeb458152 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:51.269832 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521f6614-7adf-423e-a63a-4acaeb458152 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:51.283121 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 277/550] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:08:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:08:51.288463 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f6614-7adf-423e-a63a-4acaeb458152 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:51.327878 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97201c3c-ccfe-43c7-b957-311510582d9e None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:51.394278 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df9acb-e670-4255-8f4d-0c10136db39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:51.394955 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df9acb-e670-4255-8f4d-0c10136db39d None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:51.395241 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df9acb-e670-4255-8f4d-0c10136db39d None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:51.395518 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df9acb-e670-4255-8f4d-0c10136db39d None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:51.396913 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24df9acb-e670-4255-8f4d-0c10136db39d None admin] RBAC: Adding query filter params (name=service) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:51.397223 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24df9acb-e670-4255-8f4d-0c10136db39d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:51.398599 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24df9acb-e670-4255-8f4d-0c10136db39d None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:51.404389 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:51.423586 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 274/551] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Jun 21 20:08:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:51.428660 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df9acb-e670-4255-8f4d-0c10136db39d None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:51.515695 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f6614-7adf-423e-a63a-4acaeb458152 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:51.561524 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:51.579371 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c3f05-950c-4258-bc9c-b9307cdb7570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:51.580124 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c3f05-950c-4258-bc9c-b9307cdb7570 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:51.580406 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c3f05-950c-4258-bc9c-b9307cdb7570 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:51.580682 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c3f05-950c-4258-bc9c-b9307cdb7570 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:51.586120 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df9acb-e670-4255-8f4d-0c10136db39d None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:51.588733 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439c3f05-950c-4258-bc9c-b9307cdb7570 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:51.590177 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439c3f05-950c-4258-bc9c-b9307cdb7570 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:51.605995 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-439c3f05-950c-4258-bc9c-b9307cdb7570 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 21 20:08:51.605995 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:51.605995 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:51.605995 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:51.605995 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:51.605995 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:51.605995 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:51.605995 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:51.605995 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:51.605995 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:51.605995 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:51.605995 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:51.605995 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 20:08:51.605995 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 20:08:51.605995 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 20:08:51.605995 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 20:08:51.606991 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:51.606991 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:51.606991 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 20:08:51.606991 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:08:51.606991 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 20:08:51.606991 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:08:51.606991 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:51.606991 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:51.606991 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:51.606991 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:51.606991 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:51.606991 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:51.606991 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:51.606991 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:51.606991 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:51.606991 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:51.606991 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:51.606991 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:51.609321 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:51.609321 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:51.609321 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 20:08:51.609321 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 20:08:51.609321 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 20:08:51.609321 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 20:08:51.609321 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 20:08:51.609321 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 20:08:51.609321 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 21 20:08:51.609321 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:08:51.609321 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 278/552] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jun 21 20:08:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:51.614094 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c3f05-950c-4258-bc9c-b9307cdb7570 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:51.673532 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bfc8fe-e7e0-4797-83a8-982a93e6f581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:51.674350 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bfc8fe-e7e0-4797-83a8-982a93e6f581 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:51.674641 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bfc8fe-e7e0-4797-83a8-982a93e6f581 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:51.674924 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bfc8fe-e7e0-4797-83a8-982a93e6f581 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:51.704992 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bfc8fe-e7e0-4797-83a8-982a93e6f581 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:51.706477 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bfc8fe-e7e0-4797-83a8-982a93e6f581 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:51.720477 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c3f05-950c-4258-bc9c-b9307cdb7570 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:51.736245 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:51.741581 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-f9bfc8fe-e7e0-4797-83a8-982a93e6f581 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:08:51.741581 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:51.741581 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:51.741581 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:51.741581 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:51.741581 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:51.741581 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:51.741581 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:51.741581 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:51.741581 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:51.741581 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:51.741581 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:51.741581 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:08:51.741581 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:08:51.741581 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:08:51.743550 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:08:51.743550 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:51.743550 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:51.743550 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:51.743550 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:51.743550 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:51.743550 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:51.743550 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:51.743550 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:51.743550 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:51.743550 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:51.743550 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:51.743550 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:51.743550 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:51.743550 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:51.743550 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:51.743550 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:51.745760 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:08:51.745760 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:08:51.745760 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:08:51.745760 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:08:51.752794 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 275/553] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:08:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:51.757953 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54563f8-d120-4e70-adbc-701b6763a89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:51.758636 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54563f8-d120-4e70-adbc-701b6763a89a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:51.758925 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54563f8-d120-4e70-adbc-701b6763a89a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:51.759256 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54563f8-d120-4e70-adbc-701b6763a89a None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:51.760125 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54563f8-d120-4e70-adbc-701b6763a89a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:51.760438 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54563f8-d120-4e70-adbc-701b6763a89a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:51.760861 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bfc8fe-e7e0-4797-83a8-982a93e6f581 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:51.761977 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54563f8-d120-4e70-adbc-701b6763a89a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:51.780707 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 279/554] 10.222.0.15 () {56 vars in 1135 bytes} [Tue Jun 21 20:08:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:08:51.786116 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54563f8-d120-4e70-adbc-701b6763a89a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:51.903780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54563f8-d120-4e70-adbc-701b6763a89a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:51.939659 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f6d08-1171-4826-a270-b242983138e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:51.940467 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f6d08-1171-4826-a270-b242983138e1 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:51.940760 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f6d08-1171-4826-a270-b242983138e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:51.941040 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f6d08-1171-4826-a270-b242983138e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:51.984354 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:51.985506 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bfc8fe-e7e0-4797-83a8-982a93e6f581 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:52.013574 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90f6d08-1171-4826-a270-b242983138e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:52.015035 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90f6d08-1171-4826-a270-b242983138e1 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:52.032034 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fccca25-26e1-4f06-98e6-97ed39d53d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:52.032811 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccca25-26e1-4f06-98e6-97ed39d53d86 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:52.033205 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccca25-26e1-4f06-98e6-97ed39d53d86 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:52.033490 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccca25-26e1-4f06-98e6-97ed39d53d86 None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:52.034224 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fccca25-26e1-4f06-98e6-97ed39d53d86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:52.034536 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fccca25-26e1-4f06-98e6-97ed39d53d86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:52.036055 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fccca25-26e1-4f06-98e6-97ed39d53d86 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:52.049376 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 276/555] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:08:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:52.050664 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e9e8c-d441-4c84-a244-880654b9d4ab None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:52.050960 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e9e8c-d441-4c84-a244-880654b9d4ab None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:52.051251 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e9e8c-d441-4c84-a244-880654b9d4ab None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:52.056782 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 277/556] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:08:52.057578 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e9e8c-d441-4c84-a244-880654b9d4ab None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:52.061463 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:52.127407 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 280/557] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:08:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 21 20:08:52.133389 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84825b33-1435-4763-aa11-2e00971eb9eb None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:52.133834 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84825b33-1435-4763-aa11-2e00971eb9eb None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:52.134257 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84825b33-1435-4763-aa11-2e00971eb9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:52.152527 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-84825b33-1435-4763-aa11-2e00971eb9eb None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:52.154023 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-84825b33-1435-4763-aa11-2e00971eb9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:52.167734 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e9e8c-d441-4c84-a244-880654b9d4ab None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:52.204987 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ffd99f-971a-4045-9faf-41e07e19ec41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:52.205828 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ffd99f-971a-4045-9faf-41e07e19ec41 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:52.206366 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ffd99f-971a-4045-9faf-41e07e19ec41 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:52.206525 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ffd99f-971a-4045-9faf-41e07e19ec41 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:52.214772 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ffd99f-971a-4045-9faf-41e07e19ec41 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:52.216255 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ffd99f-971a-4045-9faf-41e07e19ec41 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:52.223980 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:52.231955 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 281/558] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:08:52.231955 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84825b33-1435-4763-aa11-2e00971eb9eb None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:52.243426 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-c9ffd99f-971a-4045-9faf-41e07e19ec41 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 20:08:52.243426 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:52.243426 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:52.243426 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:52.243426 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:52.243426 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:52.243426 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:52.243426 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:52.243426 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:52.243426 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:52.243426 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:52.243426 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:52.243426 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 20:08:52.243426 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 20:08:52.243426 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 20:08:52.243426 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 20:08:52.244855 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:52.244855 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:52.244855 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 20:08:52.244855 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:08:52.244855 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 20:08:52.244855 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:08:52.244855 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:52.244855 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:52.244855 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:52.244855 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:52.244855 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:52.244855 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:52.244855 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:52.244855 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:52.244855 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:52.244855 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:52.244855 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:52.244855 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:52.246112 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:52.246112 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:52.246112 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 20:08:52.246112 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 20:08:52.246112 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 20:08:52.246112 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 20:08:52.246112 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 20:08:52.246112 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 20:08:52.246112 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 20:08:52.246112 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:08:52.246112 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 278/559] 10.222.0.15 () {56 vars in 1093 bytes} [Tue Jun 21 20:08:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:52.252373 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ffd99f-971a-4045-9faf-41e07e19ec41 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:52.328214 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:52.345507 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84825b33-1435-4763-aa11-2e00971eb9eb None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:52.369376 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ffd99f-971a-4045-9faf-41e07e19ec41 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:52.383379 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85cd38-78c5-4fb7-86ad-5f85551cc031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:52.384246 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85cd38-78c5-4fb7-86ad-5f85551cc031 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:52.384579 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85cd38-78c5-4fb7-86ad-5f85551cc031 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:52.384881 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85cd38-78c5-4fb7-86ad-5f85551cc031 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:52.395984 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b85cd38-78c5-4fb7-86ad-5f85551cc031 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:52.397531 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b85cd38-78c5-4fb7-86ad-5f85551cc031 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:52.406224 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e349b6-415e-4140-b5e0-5387f1b5515b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:52.406907 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e349b6-415e-4140-b5e0-5387f1b5515b None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:52.407304 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e349b6-415e-4140-b5e0-5387f1b5515b None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:52.407593 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e349b6-415e-4140-b5e0-5387f1b5515b None admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:52.408474 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e349b6-415e-4140-b5e0-5387f1b5515b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:52.408790 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e349b6-415e-4140-b5e0-5387f1b5515b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:52.410229 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e349b6-415e-4140-b5e0-5387f1b5515b None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:52.417791 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-6b85cd38-78c5-4fb7-86ad-5f85551cc031 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:08:52.417791 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:52.417791 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:52.417791 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:52.417791 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:52.417791 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:52.417791 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:52.417791 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:52.417791 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:52.417791 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:52.417791 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:52.417791 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:52.417791 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:08:52.417791 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:08:52.417791 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:08:52.419818 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:08:52.419818 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:52.419818 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:52.419818 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:52.419818 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:52.419818 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:52.419818 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:52.419818 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:52.419818 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:52.419818 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:52.419818 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:52.419818 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:52.419818 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:52.419818 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:52.419818 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:52.419818 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:52.419818 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:52.422042 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:08:52.422042 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:08:52.422042 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:08:52.422042 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:08:52.425791 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 282/560] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:08:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:52.425791 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85cd38-78c5-4fb7-86ad-5f85551cc031 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:52.428842 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 279/561] 10.222.0.15 () {56 vars in 1133 bytes} [Tue Jun 21 20:08:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:08:52.432539 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e349b6-415e-4140-b5e0-5387f1b5515b None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:52.489181 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:52.535373 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e349b6-415e-4140-b5e0-5387f1b5515b None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:52.540276 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85cd38-78c5-4fb7-86ad-5f85551cc031 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:52.559415 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:52.572120 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb26e1-3cbd-4726-80f4-80c7914a2f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:52.572792 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb26e1-3cbd-4726-80f4-80c7914a2f9e None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:52.573081 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb26e1-3cbd-4726-80f4-80c7914a2f9e None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:52.573369 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb26e1-3cbd-4726-80f4-80c7914a2f9e None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:52.574092 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb26e1-3cbd-4726-80f4-80c7914a2f9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:52.574407 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb26e1-3cbd-4726-80f4-80c7914a2f9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:52.575775 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb26e1-3cbd-4726-80f4-80c7914a2f9e None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:52.578590 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d4f9b7-f0ef-485b-972c-8644a8d06dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:52.579573 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4f9b7-f0ef-485b-972c-8644a8d06dfe None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:52.580319 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4f9b7-f0ef-485b-972c-8644a8d06dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:52.580613 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4f9b7-f0ef-485b-972c-8644a8d06dfe None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:52.593596 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d4f9b7-f0ef-485b-972c-8644a8d06dfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:08:52.594175 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 280/562] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:08:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:52.595191 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb26e1-3cbd-4726-80f4-80c7914a2f9e None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:52.599253 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-03d4f9b7-f0ef-485b-972c-8644a8d06dfe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 20:08:52.599253 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:52.599253 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:52.599253 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:52.599253 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:52.599253 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:52.599253 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:52.599253 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:52.599253 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:52.599253 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:52.599253 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:52.599253 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:52.599253 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:08:52.599253 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:08:52.599253 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:08:52.599253 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:08:52.600224 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:08:52.600224 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:08:52.600224 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:08:52.600224 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:08:52.600224 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:52.600224 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:52.600224 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:52.600224 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:52.600224 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:52.600224 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:52.600224 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:52.600224 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:52.600224 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:52.600224 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:52.600224 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:52.600224 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:52.601244 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:52.601244 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:52.601244 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:52.601244 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:52.601244 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:08:52.601244 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:08:52.601244 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:08:52.601244 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:08:52.601244 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:08:52.601244 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:08:52.601244 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 20:08:52.601244 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:08:52.605425 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 283/563] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Jun 21 20:08:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:52.606756 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882b418-a8f0-4653-94cb-33063203e9b3 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:52.607069 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882b418-a8f0-4653-94cb-33063203e9b3 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:52.607415 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882b418-a8f0-4653-94cb-33063203e9b3 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:52.608698 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 284/564] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:08:52.609395 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6882b418-a8f0-4653-94cb-33063203e9b3 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:52.710622 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb26e1-3cbd-4726-80f4-80c7914a2f9e None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:52.720175 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6882b418-a8f0-4653-94cb-33063203e9b3 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:52.737258 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:52.748257 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b729279d-7c77-472b-af89-126484daa83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:52.749059 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729279d-7c77-472b-af89-126484daa83c None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:52.749345 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729279d-7c77-472b-af89-126484daa83c None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:52.749622 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729279d-7c77-472b-af89-126484daa83c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:52.761913 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b729279d-7c77-472b-af89-126484daa83c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:52.762694 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec5f8e-b0f3-431f-9eca-d8b6d18d0b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:52.763384 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b729279d-7c77-472b-af89-126484daa83c None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:52.763836 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec5f8e-b0f3-431f-9eca-d8b6d18d0b97 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:52.764305 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec5f8e-b0f3-431f-9eca-d8b6d18d0b97 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:52.764726 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec5f8e-b0f3-431f-9eca-d8b6d18d0b97 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:52.771637 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec5f8e-b0f3-431f-9eca-d8b6d18d0b97 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:52.773089 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec5f8e-b0f3-431f-9eca-d8b6d18d0b97 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:52.781032 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-b729279d-7c77-472b-af89-126484daa83c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:08:52.781032 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:52.781032 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:52.781032 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:52.781032 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:52.781032 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:52.781032 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:52.781032 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:52.781032 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:52.781032 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:52.781032 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:52.781032 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:52.781032 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:08:52.781032 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:08:52.781032 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:08:52.781925 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:08:52.781925 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:52.781925 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:52.781925 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:52.781925 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:52.781925 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:52.781925 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:52.781925 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:52.781925 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:52.781925 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:52.781925 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:52.781925 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:52.781925 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:52.781925 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:52.781925 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:52.781925 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:52.781925 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:52.783178 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:08:52.783178 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:08:52.783178 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:08:52.783178 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:08:52.783178 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 281/565] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:08:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:52.783178 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b729279d-7c77-472b-af89-126484daa83c None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:52.787654 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-07ec5f8e-b0f3-431f-9eca-d8b6d18d0b97 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:08:52.787654 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:52.787654 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:52.787654 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:52.787654 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:52.787654 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:52.787654 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:52.787654 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:52.787654 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:52.787654 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:52.787654 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:52.787654 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:52.787654 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 20:08:52.787654 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 20:08:52.787654 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 20:08:52.788586 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 20:08:52.788586 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:52.788586 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:52.788586 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:52.788586 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:52.788586 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:52.788586 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:52.788586 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:52.788586 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:52.788586 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:52.788586 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:52.788586 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:52.788586 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:52.788586 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:52.788586 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:52.788586 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:52.788586 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:52.789488 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 20:08:52.789488 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 20:08:52.789488 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 20:08:52.789488 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 20:08:52.789488 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 20:08:52.789488 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 20:08:52.789488 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:08:52.789488 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:08:52.789488 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 285/566] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jun 21 20:08:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:52.790380 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f34ca-9edf-402f-b24a-a59d4a58ff6e None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:52.790380 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f34ca-9edf-402f-b24a-a59d4a58ff6e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:52.790629 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f34ca-9edf-402f-b24a-a59d4a58ff6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:52.807186 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-616f34ca-9edf-402f-b24a-a59d4a58ff6e None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:52.808390 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-616f34ca-9edf-402f-b24a-a59d4a58ff6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:52.818789 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:52.877936 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 286/567] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:08:52.879323 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26174d1-2add-481a-99b8-2ff0604d830f None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:52.879612 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26174d1-2add-481a-99b8-2ff0604d830f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:52.879901 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26174d1-2add-481a-99b8-2ff0604d830f None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:52.884064 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 287/568] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:08:52.884064 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26174d1-2add-481a-99b8-2ff0604d830f None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:52.892521 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b729279d-7c77-472b-af89-126484daa83c None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:52.926570 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50b517-81e6-4276-bdf6-26897bd1c4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:52.927292 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50b517-81e6-4276-bdf6-26897bd1c4db None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:52.928096 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50b517-81e6-4276-bdf6-26897bd1c4db None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:52.928373 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50b517-81e6-4276-bdf6-26897bd1c4db None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:52.929121 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da50b517-81e6-4276-bdf6-26897bd1c4db None admin] RBAC: Adding query filter params (name=service) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:52.929430 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da50b517-81e6-4276-bdf6-26897bd1c4db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:52.930808 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da50b517-81e6-4276-bdf6-26897bd1c4db None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:52.938534 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 282/569] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Jun 21 20:08:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:52.939302 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50b517-81e6-4276-bdf6-26897bd1c4db None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:52.983134 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26174d1-2add-481a-99b8-2ff0604d830f None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:52.985613 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:53.017980 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a177506-4564-4fd1-ad0e-a7827b258e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:53.018638 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a177506-4564-4fd1-ad0e-a7827b258e24 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:53.018925 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a177506-4564-4fd1-ad0e-a7827b258e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:53.019198 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a177506-4564-4fd1-ad0e-a7827b258e24 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:53.019908 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a177506-4564-4fd1-ad0e-a7827b258e24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:53.020245 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a177506-4564-4fd1-ad0e-a7827b258e24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:53.021892 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a177506-4564-4fd1-ad0e-a7827b258e24 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:53.031002 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:53.034227 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 288/570] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:08:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:53.035427 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e9ec4-7a48-4242-8ee0-001bef6c1410 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:53.035714 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e9ec4-7a48-4242-8ee0-001bef6c1410 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:53.036020 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e9ec4-7a48-4242-8ee0-001bef6c1410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:53.038297 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50b517-81e6-4276-bdf6-26897bd1c4db None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:53.051894 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-8d6e9ec4-7a48-4242-8ee0-001bef6c1410 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:53.053640 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8d6e9ec4-7a48-4242-8ee0-001bef6c1410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:53.074152 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d8fc9-122c-4de5-9fc8-78c7a895926e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:53.074982 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d8fc9-122c-4de5-9fc8-78c7a895926e None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:53.075266 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d8fc9-122c-4de5-9fc8-78c7a895926e None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:53.075545 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d8fc9-122c-4de5-9fc8-78c7a895926e None admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:53.076382 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968d8fc9-122c-4de5-9fc8-78c7a895926e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:53.076692 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968d8fc9-122c-4de5-9fc8-78c7a895926e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:53.078092 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968d8fc9-122c-4de5-9fc8-78c7a895926e None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:53.090930 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 283/571] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jun 21 20:08:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:53.091697 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d8fc9-122c-4de5-9fc8-78c7a895926e None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:53.119882 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 289/572] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:08:53.120701 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e9ec4-7a48-4242-8ee0-001bef6c1410 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:53.194586 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d8fc9-122c-4de5-9fc8-78c7a895926e None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:53.208276 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:53.218241 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e9ec4-7a48-4242-8ee0-001bef6c1410 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:53.229709 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8cc60-e116-4b18-8a1e-d6d2b578bacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:53.230511 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8cc60-e116-4b18-8a1e-d6d2b578bacc None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:53.230795 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8cc60-e116-4b18-8a1e-d6d2b578bacc None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:53.231096 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8cc60-e116-4b18-8a1e-d6d2b578bacc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:53.241339 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de8cc60-e116-4b18-8a1e-d6d2b578bacc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:08:53.248932 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-7de8cc60-e116-4b18-8a1e-d6d2b578bacc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 20:08:53.248932 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:53.248932 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:53.248932 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:53.248932 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:53.248932 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:53.248932 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:53.248932 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:53.248932 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:53.248932 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:53.248932 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:53.248932 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:53.248932 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:08:53.248932 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:08:53.248932 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:08:53.248932 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:08:53.250028 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:08:53.250028 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:08:53.250028 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:08:53.250028 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:08:53.250028 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:53.250028 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:53.250028 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:53.250028 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:53.250028 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:53.250028 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:53.250028 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:53.250028 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:53.250028 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:53.250028 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:53.250028 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:53.250028 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:53.250877 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:53.250877 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:53.250877 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:53.250877 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:53.250877 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:08:53.250877 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:08:53.250877 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:08:53.250877 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:08:53.250877 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:08:53.250877 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:08:53.250877 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 20:08:53.250877 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:08:53.250877 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 284/573] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Jun 21 20:08:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:53.250877 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8cc60-e116-4b18-8a1e-d6d2b578bacc None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:53.254331 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e481f7-2c06-4b66-b946-916310fa28e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:53.255124 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e481f7-2c06-4b66-b946-916310fa28e1 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:53.255441 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e481f7-2c06-4b66-b946-916310fa28e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:53.255717 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e481f7-2c06-4b66-b946-916310fa28e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:53.265837 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e481f7-2c06-4b66-b946-916310fa28e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:53.267276 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e481f7-2c06-4b66-b946-916310fa28e1 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:53.271560 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:53.285786 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-d2e481f7-2c06-4b66-b946-916310fa28e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:08:53.285786 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:53.285786 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:53.285786 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:53.285786 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:53.285786 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:53.285786 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:53.285786 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:53.285786 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:53.285786 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:53.285786 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:53.285786 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:53.285786 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:08:53.285786 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:08:53.285786 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:08:53.287396 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:08:53.287396 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:53.287396 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:53.287396 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:53.287396 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:53.287396 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:53.287396 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:53.287396 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:53.287396 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:53.287396 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:53.287396 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:53.287396 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:53.287396 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:53.287396 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:53.287396 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:53.287396 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:53.287396 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:53.288534 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:08:53.288534 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:08:53.288534 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:08:53.288534 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:08:53.292297 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 290/574] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:08:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:53.293120 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e481f7-2c06-4b66-b946-916310fa28e1 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:53.353492 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8cc60-e116-4b18-8a1e-d6d2b578bacc None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:53.385730 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a2e03-78ec-4ad8-911d-2d25339a909d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:53.386520 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a2e03-78ec-4ad8-911d-2d25339a909d None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:53.386807 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a2e03-78ec-4ad8-911d-2d25339a909d None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:53.387083 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a2e03-78ec-4ad8-911d-2d25339a909d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:53.390019 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e481f7-2c06-4b66-b946-916310fa28e1 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:53.393572 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0a2e03-78ec-4ad8-911d-2d25339a909d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:53.395002 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0a2e03-78ec-4ad8-911d-2d25339a909d None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:53.409298 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-1f0a2e03-78ec-4ad8-911d-2d25339a909d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:08:53.409298 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:53.409298 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:53.409298 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:53.409298 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:53.409298 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:53.409298 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:53.409298 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:53.409298 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:53.409298 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:53.409298 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:53.409298 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:53.409298 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 20:08:53.409298 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 20:08:53.409298 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 20:08:53.410327 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 20:08:53.410327 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:53.410327 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:53.410327 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:53.410327 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:53.410327 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:53.410327 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:53.410327 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:53.410327 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:53.410327 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:53.410327 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:53.410327 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:53.410327 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:53.410327 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:53.410327 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:53.410327 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:53.410327 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:53.411411 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 20:08:53.411411 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 20:08:53.411411 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 20:08:53.411411 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 20:08:53.411411 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 20:08:53.411411 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 20:08:53.411411 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:08:53.411411 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:08:53.411411 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 285/575] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jun 21 20:08:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:53.411411 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a2e03-78ec-4ad8-911d-2d25339a909d None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:53.426787 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c1f8c-651c-4194-8140-644ff888ebcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:53.427521 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c1f8c-651c-4194-8140-644ff888ebcc None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:53.427811 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c1f8c-651c-4194-8140-644ff888ebcc None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:53.428121 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c1f8c-651c-4194-8140-644ff888ebcc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:53.428949 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309c1f8c-651c-4194-8140-644ff888ebcc None admin] RBAC: Adding query filter params (role.id=a4929ef60a294190b2d59e8d61e05063, scope.project.id=4dcb71ef7b6e49148edd61a1eb8da7bb, user.id=038537bd12174154ba259e097b97b8bd) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:53.429263 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309c1f8c-651c-4194-8140-644ff888ebcc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:53.430669 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309c1f8c-651c-4194-8140-644ff888ebcc None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:53.436014 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 291/576] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jun 21 20:08:53 2022] GET /identity/v3/role_assignments?user.id=038537bd12174154ba259e097b97b8bd&scope.project.id=4dcb71ef7b6e49148edd61a1eb8da7bb&role.id=a4929ef60a294190b2d59e8d61e05063 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:53.436777 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c1f8c-651c-4194-8140-644ff888ebcc None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:53.454720 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:53.494349 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:53.520432 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a2e03-78ec-4ad8-911d-2d25339a909d None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:53.558777 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c1f8c-651c-4194-8140-644ff888ebcc None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:53.559895 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba41ac9-732e-423e-bf92-239905c70ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:53.560742 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba41ac9-732e-423e-bf92-239905c70ad1 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:53.561024 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba41ac9-732e-423e-bf92-239905c70ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:53.561304 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba41ac9-732e-423e-bf92-239905c70ad1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:53.573274 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba41ac9-732e-423e-bf92-239905c70ad1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:08:53.580969 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-bba41ac9-732e-423e-bf92-239905c70ad1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 20:08:53.580969 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:53.580969 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:53.580969 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:53.580969 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:53.580969 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:53.580969 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:53.580969 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:53.580969 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:53.580969 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:53.580969 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:53.580969 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:53.580969 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:08:53.580969 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:08:53.580969 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:08:53.580969 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:08:53.581954 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:08:53.581954 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:08:53.581954 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:08:53.581954 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:08:53.581954 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:53.581954 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:53.581954 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:53.581954 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:53.581954 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:53.581954 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:53.581954 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:53.581954 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:53.581954 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:53.581954 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:53.581954 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:53.581954 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:53.582779 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:53.582779 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:53.582779 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:53.582779 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:53.582779 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:08:53.582779 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:08:53.582779 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:08:53.582779 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:08:53.582779 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:08:53.582779 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:08:53.582779 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 20:08:53.582779 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:08:53.582779 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 286/577] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Jun 21 20:08:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:53.584754 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba41ac9-732e-423e-bf92-239905c70ad1 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:53.605965 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b936b2-5978-48b8-b563-90d8ba863651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:53.606648 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b936b2-5978-48b8-b563-90d8ba863651 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:53.606936 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b936b2-5978-48b8-b563-90d8ba863651 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:53.607216 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b936b2-5978-48b8-b563-90d8ba863651 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:53.608007 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b936b2-5978-48b8-b563-90d8ba863651 None admin] RBAC: Adding query filter params (name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:53.608377 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b936b2-5978-48b8-b563-90d8ba863651 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:53.609999 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b936b2-5978-48b8-b563-90d8ba863651 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:53.622381 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 292/578] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Jun 21 20:08:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:53.622381 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b936b2-5978-48b8-b563-90d8ba863651 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:53.695081 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:53.700643 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba41ac9-732e-423e-bf92-239905c70ad1 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:53.727985 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b936b2-5978-48b8-b563-90d8ba863651 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:53.735812 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1dab89-ee8a-4511-8b1e-6f3b0f4410c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:53.736499 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1dab89-ee8a-4511-8b1e-6f3b0f4410c1 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:53.736784 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1dab89-ee8a-4511-8b1e-6f3b0f4410c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:53.737069 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1dab89-ee8a-4511-8b1e-6f3b0f4410c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:53.737787 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1dab89-ee8a-4511-8b1e-6f3b0f4410c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:53.738095 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1dab89-ee8a-4511-8b1e-6f3b0f4410c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:53.739465 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1dab89-ee8a-4511-8b1e-6f3b0f4410c1 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:53.741879 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:53.757332 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 287/579] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:08:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:53.757332 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1dab89-ee8a-4511-8b1e-6f3b0f4410c1 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:53.768311 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed6193a-0587-4654-b852-4d5760b5a60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:53.769026 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6193a-0587-4654-b852-4d5760b5a60a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:53.769424 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6193a-0587-4654-b852-4d5760b5a60a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:53.769749 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6193a-0587-4654-b852-4d5760b5a60a None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:53.770701 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed6193a-0587-4654-b852-4d5760b5a60a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:53.771566 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed6193a-0587-4654-b852-4d5760b5a60a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:53.773190 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed6193a-0587-4654-b852-4d5760b5a60a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:53.791323 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 293/580] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jun 21 20:08:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:53.792229 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed6193a-0587-4654-b852-4d5760b5a60a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:53.863782 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1dab89-ee8a-4511-8b1e-6f3b0f4410c1 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:53.900049 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b3e4c-745c-410e-bb5b-e311a5cf5869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:53.900722 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b3e4c-745c-410e-bb5b-e311a5cf5869 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:53.901006 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b3e4c-745c-410e-bb5b-e311a5cf5869 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:53.901282 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b3e4c-745c-410e-bb5b-e311a5cf5869 None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:53.901846 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed6193a-0587-4654-b852-4d5760b5a60a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:53.902027 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3b3e4c-745c-410e-bb5b-e311a5cf5869 None admin] RBAC: Adding query filter params (name=service) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:53.902337 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3b3e4c-745c-410e-bb5b-e311a5cf5869 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:53.903698 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3b3e4c-745c-410e-bb5b-e311a5cf5869 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:53.911645 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 288/581] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Jun 21 20:08:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:53.912474 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b3e4c-745c-410e-bb5b-e311a5cf5869 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:53.937194 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:53.944746 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f70496-1a6d-48f2-9a5c-f56ffa8821e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:53.945555 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f70496-1a6d-48f2-9a5c-f56ffa8821e6 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:53.945834 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f70496-1a6d-48f2-9a5c-f56ffa8821e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:53.946115 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f70496-1a6d-48f2-9a5c-f56ffa8821e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:53.956176 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f70496-1a6d-48f2-9a5c-f56ffa8821e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:53.957700 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f70496-1a6d-48f2-9a5c-f56ffa8821e6 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:53.974401 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:53.975438 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-34f70496-1a6d-48f2-9a5c-f56ffa8821e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:08:53.975438 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:53.975438 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:53.975438 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:53.975438 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:53.975438 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:53.975438 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:53.975438 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:53.975438 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:53.975438 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:53.975438 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:53.975438 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:53.975438 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:08:53.975438 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:08:53.975438 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:08:53.976451 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:08:53.976451 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:53.976451 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:53.976451 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:53.976451 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:53.976451 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:53.976451 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:53.976451 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:53.976451 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:53.976451 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:53.976451 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:53.976451 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:53.976451 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:53.976451 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:53.976451 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:53.976451 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:53.976451 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:53.980767 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:08:53.980767 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:08:53.980767 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:08:53.980767 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:08:53.980767 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 294/582] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:08:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:53.980767 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f70496-1a6d-48f2-9a5c-f56ffa8821e6 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:54.026321 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b3e4c-745c-410e-bb5b-e311a5cf5869 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:54.062411 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4254cbf-d110-40ee-8e4f-7d5a1a0bd104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:54.063319 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4254cbf-d110-40ee-8e4f-7d5a1a0bd104 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:54.063603 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4254cbf-d110-40ee-8e4f-7d5a1a0bd104 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:54.063876 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4254cbf-d110-40ee-8e4f-7d5a1a0bd104 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:54.072834 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4254cbf-d110-40ee-8e4f-7d5a1a0bd104 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:54.074271 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4254cbf-d110-40ee-8e4f-7d5a1a0bd104 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:54.078182 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f70496-1a6d-48f2-9a5c-f56ffa8821e6 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:54.089407 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-a4254cbf-d110-40ee-8e4f-7d5a1a0bd104 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 20:08:54.089407 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:54.089407 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:54.089407 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:54.089407 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:54.089407 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:54.089407 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:54.089407 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:54.089407 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:54.089407 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:54.089407 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:54.089407 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:54.089407 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 20:08:54.089407 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 20:08:54.089407 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 20:08:54.089407 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 20:08:54.090334 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:54.090334 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:54.090334 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 20:08:54.090334 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:08:54.090334 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 20:08:54.090334 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:08:54.090334 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:54.090334 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:54.090334 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:54.090334 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:54.090334 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:54.090334 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:54.090334 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:54.090334 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:54.090334 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:54.090334 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:54.090334 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:54.090334 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:54.091264 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:54.091264 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:54.091264 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 20:08:54.091264 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 20:08:54.091264 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 20:08:54.091264 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 20:08:54.091264 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 20:08:54.091264 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 20:08:54.091264 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 20:08:54.091264 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:08:54.091264 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 289/583] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:08:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:54.091846 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4254cbf-d110-40ee-8e4f-7d5a1a0bd104 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:54.117660 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71141514-aeb8-4160-b0d2-feeee4b351d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:54.118550 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71141514-aeb8-4160-b0d2-feeee4b351d4 None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:54.118837 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71141514-aeb8-4160-b0d2-feeee4b351d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:54.119115 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71141514-aeb8-4160-b0d2-feeee4b351d4 None admin] PATH_INFO: `/v3/projects/4dcb71ef7b6e49148edd61a1eb8da7bb/users/3918fe05c8634bc39f3e295374701465/roles/a4929ef60a294190b2d59e8d61e05063` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:54.134187 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71141514-aeb8-4160-b0d2-feeee4b351d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=4dcb71ef7b6e49148edd61a1eb8da7bb, user_id=3918fe05c8634bc39f3e295374701465, role_id=a4929ef60a294190b2d59e8d61e05063)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:54.135627 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71141514-aeb8-4160-b0d2-feeee4b351d4 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:54.149309 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 295/584] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Jun 21 20:08:53 2022] PUT /identity/v3/projects/4dcb71ef7b6e49148edd61a1eb8da7bb/users/3918fe05c8634bc39f3e295374701465/roles/a4929ef60a294190b2d59e8d61e05063 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:08:54.150114 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71141514-aeb8-4160-b0d2-feeee4b351d4 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:54.192380 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:54.219270 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4254cbf-d110-40ee-8e4f-7d5a1a0bd104 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:54.241171 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:54.262746 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d516ce5-8efc-45d8-9b2b-89035a41c3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:54.263592 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d516ce5-8efc-45d8-9b2b-89035a41c3ea None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:54.263877 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d516ce5-8efc-45d8-9b2b-89035a41c3ea None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:54.264183 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d516ce5-8efc-45d8-9b2b-89035a41c3ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:54.276543 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d516ce5-8efc-45d8-9b2b-89035a41c3ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:54.277941 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d516ce5-8efc-45d8-9b2b-89035a41c3ea None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:54.296147 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71141514-aeb8-4160-b0d2-feeee4b351d4 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:54.297506 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-7d516ce5-8efc-45d8-9b2b-89035a41c3ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:08:54.297506 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:54.297506 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:54.297506 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:54.297506 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:54.297506 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:54.297506 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:54.297506 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:54.297506 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:54.297506 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:54.297506 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:54.297506 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:54.297506 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:08:54.297506 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:08:54.297506 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:08:54.298395 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:08:54.298395 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:54.298395 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:54.298395 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:54.298395 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:54.298395 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:54.298395 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:54.298395 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:54.298395 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:54.298395 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:54.298395 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:54.298395 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:54.298395 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:54.298395 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:54.298395 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:54.298395 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:54.298395 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:54.299302 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:08:54.299302 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:08:54.299302 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:08:54.299302 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:08:54.304058 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 290/585] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:08:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:54.305017 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d516ce5-8efc-45d8-9b2b-89035a41c3ea None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:54.341026 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1258f5-93a3-4f62-85dd-3bba1789252a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:54.341694 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1258f5-93a3-4f62-85dd-3bba1789252a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:54.341979 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1258f5-93a3-4f62-85dd-3bba1789252a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:54.342259 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1258f5-93a3-4f62-85dd-3bba1789252a None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:54.342977 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1258f5-93a3-4f62-85dd-3bba1789252a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:54.343285 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1258f5-93a3-4f62-85dd-3bba1789252a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:54.344737 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1258f5-93a3-4f62-85dd-3bba1789252a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:54.363246 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 296/586] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:08:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:54.363246 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1258f5-93a3-4f62-85dd-3bba1789252a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:54.433949 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d516ce5-8efc-45d8-9b2b-89035a41c3ea None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:54.463110 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:54.473651 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1258f5-93a3-4f62-85dd-3bba1789252a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:54.476182 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f22b3-8dbf-454d-b010-e246c6c33a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:54.477826 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f22b3-8dbf-454d-b010-e246c6c33a06 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:54.478266 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f22b3-8dbf-454d-b010-e246c6c33a06 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:54.478688 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f22b3-8dbf-454d-b010-e246c6c33a06 None admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:54.479701 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6f22b3-8dbf-454d-b010-e246c6c33a06 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:54.480181 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6f22b3-8dbf-454d-b010-e246c6c33a06 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:54.481763 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6f22b3-8dbf-454d-b010-e246c6c33a06 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:54.502264 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 291/587] 10.222.0.15 () {56 vars in 1137 bytes} [Tue Jun 21 20:08:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:54.503427 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f22b3-8dbf-454d-b010-e246c6c33a06 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:54.517338 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4202dbbf-58cc-49de-810f-c2067986aa04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:54.518240 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202dbbf-58cc-49de-810f-c2067986aa04 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:54.518628 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202dbbf-58cc-49de-810f-c2067986aa04 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:54.519289 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202dbbf-58cc-49de-810f-c2067986aa04 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:54.520624 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4202dbbf-58cc-49de-810f-c2067986aa04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:54.521140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4202dbbf-58cc-49de-810f-c2067986aa04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:54.523268 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4202dbbf-58cc-49de-810f-c2067986aa04 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:54.534647 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:54.543795 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 297/588] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:08:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:54.545910 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4202dbbf-58cc-49de-810f-c2067986aa04 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:54.615222 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f22b3-8dbf-454d-b010-e246c6c33a06 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:54.652920 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f376005-d240-4f6a-b280-ed2b2561c164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:54.653990 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f376005-d240-4f6a-b280-ed2b2561c164 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:54.654418 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f376005-d240-4f6a-b280-ed2b2561c164 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:54.654877 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f376005-d240-4f6a-b280-ed2b2561c164 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:54.663769 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f376005-d240-4f6a-b280-ed2b2561c164 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:54.665432 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f376005-d240-4f6a-b280-ed2b2561c164 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:54.679869 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-1f376005-d240-4f6a-b280-ed2b2561c164 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 21 20:08:54.679869 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:54.679869 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:54.679869 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:54.679869 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:54.679869 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:54.679869 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:54.679869 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:54.679869 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:54.679869 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:54.679869 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:54.679869 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:54.679869 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 20:08:54.679869 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 20:08:54.679869 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 20:08:54.679869 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 20:08:54.681083 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:54.681083 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:54.681083 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 20:08:54.681083 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:08:54.681083 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 20:08:54.681083 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:08:54.681083 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:54.681083 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:54.681083 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:54.681083 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:54.681083 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:54.681083 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:54.681083 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:54.681083 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:54.681083 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:54.681083 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:54.681083 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:54.681083 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:54.682258 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:54.682258 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:54.682258 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 20:08:54.682258 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 20:08:54.682258 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 20:08:54.682258 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 20:08:54.682258 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 20:08:54.682258 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 20:08:54.682258 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 21 20:08:54.682258 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:08:54.683735 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 292/589] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:08:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:54.688032 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f376005-d240-4f6a-b280-ed2b2561c164 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:54.688829 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4202dbbf-58cc-49de-810f-c2067986aa04 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:54.730556 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d05f72a-2be2-4d62-a3b8-728330de43a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:54.731363 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05f72a-2be2-4d62-a3b8-728330de43a9 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:54.731633 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05f72a-2be2-4d62-a3b8-728330de43a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:54.731906 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05f72a-2be2-4d62-a3b8-728330de43a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:54.742838 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d05f72a-2be2-4d62-a3b8-728330de43a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:54.744301 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d05f72a-2be2-4d62-a3b8-728330de43a9 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:54.762731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-0d05f72a-2be2-4d62-a3b8-728330de43a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:08:54.762731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:54.762731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:54.762731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:54.762731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:54.762731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:54.762731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:54.762731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:54.762731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:54.762731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:54.762731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:54.762731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:54.762731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:08:54.762731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:08:54.762731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:08:54.763718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:08:54.763718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:54.763718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:54.763718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:54.763718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:54.763718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:54.763718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:54.763718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:54.763718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:54.763718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:54.763718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:54.763718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:54.763718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:54.763718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:54.763718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:54.763718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:54.763718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:54.764679 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:08:54.764679 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:08:54.764679 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:08:54.764679 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:08:54.764679 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 298/590] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:08:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:54.765400 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d05f72a-2be2-4d62-a3b8-728330de43a9 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:54.768660 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:54.794183 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:54.807436 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f376005-d240-4f6a-b280-ed2b2561c164 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:54.847641 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e6a6cd-006d-498d-8c65-2092347fcafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:54.848781 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6a6cd-006d-498d-8c65-2092347fcafb None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:54.849712 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6a6cd-006d-498d-8c65-2092347fcafb None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:54.850104 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6a6cd-006d-498d-8c65-2092347fcafb None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:54.858472 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e6a6cd-006d-498d-8c65-2092347fcafb None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:54.860447 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e6a6cd-006d-498d-8c65-2092347fcafb None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:54.876746 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d05f72a-2be2-4d62-a3b8-728330de43a9 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:54.877159 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-26e6a6cd-006d-498d-8c65-2092347fcafb None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 21 20:08:54.877159 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:54.877159 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:54.877159 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:54.877159 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:54.877159 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:54.877159 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:54.877159 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:54.877159 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:54.877159 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:54.877159 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:54.877159 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:54.877159 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 20:08:54.877159 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 20:08:54.877159 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 20:08:54.877159 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 20:08:54.878278 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:54.878278 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:54.878278 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 20:08:54.878278 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:08:54.878278 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 20:08:54.878278 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:08:54.878278 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:54.878278 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:54.878278 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:54.878278 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:54.878278 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:54.878278 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:54.878278 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:54.878278 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:54.878278 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:54.878278 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:54.878278 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:54.878278 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:54.879430 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:54.879430 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:54.879430 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 20:08:54.879430 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 20:08:54.879430 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 20:08:54.879430 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 20:08:54.879430 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 20:08:54.879430 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 20:08:54.879430 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 21 20:08:54.879430 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:08:54.881324 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 293/591] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Jun 21 20:08:54 2022] GET /identity/v3/users/neutron => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:54.882299 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e6a6cd-006d-498d-8c65-2092347fcafb None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:54.917437 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f082a3-ab34-40c2-a85c-4857242b53c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:54.918463 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f082a3-ab34-40c2-a85c-4857242b53c5 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:54.918933 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f082a3-ab34-40c2-a85c-4857242b53c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:54.919412 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f082a3-ab34-40c2-a85c-4857242b53c5 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:54.920449 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f082a3-ab34-40c2-a85c-4857242b53c5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:54.920936 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f082a3-ab34-40c2-a85c-4857242b53c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:54.922706 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f082a3-ab34-40c2-a85c-4857242b53c5 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:54.941392 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 299/592] 10.222.0.15 () {56 vars in 1137 bytes} [Tue Jun 21 20:08:54 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:54.942525 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f082a3-ab34-40c2-a85c-4857242b53c5 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:54.998877 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e6a6cd-006d-498d-8c65-2092347fcafb None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:55.008043 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:55.038863 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c0ce2f-6553-4223-81b2-76ffbe5493cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:55.039636 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0ce2f-6553-4223-81b2-76ffbe5493cb None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:55.040027 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0ce2f-6553-4223-81b2-76ffbe5493cb None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:55.040398 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0ce2f-6553-4223-81b2-76ffbe5493cb None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:55.041362 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c0ce2f-6553-4223-81b2-76ffbe5493cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:55.041936 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c0ce2f-6553-4223-81b2-76ffbe5493cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:55.043272 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c0ce2f-6553-4223-81b2-76ffbe5493cb None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:55.051145 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f082a3-ab34-40c2-a85c-4857242b53c5 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:55.056135 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 294/593] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:08:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:55.057023 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c0ce2f-6553-4223-81b2-76ffbe5493cb None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:55.069464 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:55.090586 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d7153-2f86-4e57-91a7-ec8c4675710d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:55.091694 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d7153-2f86-4e57-91a7-ec8c4675710d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:55.092308 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d7153-2f86-4e57-91a7-ec8c4675710d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:55.092786 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d7153-2f86-4e57-91a7-ec8c4675710d None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:55.093817 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352d7153-2f86-4e57-91a7-ec8c4675710d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:55.094325 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352d7153-2f86-4e57-91a7-ec8c4675710d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:55.096173 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352d7153-2f86-4e57-91a7-ec8c4675710d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:55.115080 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 300/594] 10.222.0.15 () {56 vars in 1139 bytes} [Tue Jun 21 20:08:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:55.116271 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d7153-2f86-4e57-91a7-ec8c4675710d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:55.168901 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c0ce2f-6553-4223-81b2-76ffbe5493cb None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:55.206122 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49006141-58b9-48a3-9a1f-a1442c475837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:55.206814 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49006141-58b9-48a3-9a1f-a1442c475837 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:55.207108 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49006141-58b9-48a3-9a1f-a1442c475837 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:55.207440 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49006141-58b9-48a3-9a1f-a1442c475837 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:55.219958 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49006141-58b9-48a3-9a1f-a1442c475837 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:55.221457 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49006141-58b9-48a3-9a1f-a1442c475837 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:55.223187 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d7153-2f86-4e57-91a7-ec8c4675710d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:55.240309 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-49006141-58b9-48a3-9a1f-a1442c475837 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:08:55.240309 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:55.240309 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:55.240309 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:55.240309 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:55.240309 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:55.240309 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:55.240309 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:55.240309 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:55.240309 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:55.240309 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:55.240309 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:55.240309 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:08:55.240309 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:08:55.240309 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:08:55.241227 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:08:55.241227 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:55.241227 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:55.241227 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:55.241227 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:55.241227 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:55.241227 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:55.241227 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:55.241227 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:55.241227 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:55.241227 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:55.241227 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:55.241227 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:55.241227 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:55.241227 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:55.241227 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:55.241227 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:55.242105 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:08:55.242105 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:08:55.242105 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:08:55.242105 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:08:55.242105 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 295/595] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:08:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:55.242508 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49006141-58b9-48a3-9a1f-a1442c475837 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:55.247695 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:55.260564 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd69088e-0c2c-410d-9f19-66cbe224aa92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:55.261446 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69088e-0c2c-410d-9f19-66cbe224aa92 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:55.261813 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69088e-0c2c-410d-9f19-66cbe224aa92 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:55.262154 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69088e-0c2c-410d-9f19-66cbe224aa92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:55.269499 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd69088e-0c2c-410d-9f19-66cbe224aa92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:55.271750 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd69088e-0c2c-410d-9f19-66cbe224aa92 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:55.286128 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-cd69088e-0c2c-410d-9f19-66cbe224aa92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:08:55.286128 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:55.286128 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:55.286128 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:55.286128 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:55.286128 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:55.286128 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:55.286128 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:55.286128 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:55.286128 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:55.286128 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:55.286128 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:55.286128 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 20:08:55.286128 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 20:08:55.286128 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 20:08:55.287285 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 20:08:55.287285 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:55.287285 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:55.287285 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:55.287285 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:55.287285 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:55.287285 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:55.287285 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:55.287285 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:55.287285 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:55.287285 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:55.287285 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:55.287285 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:55.287285 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:55.287285 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:55.287285 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:55.287285 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:55.288434 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 20:08:55.288434 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 20:08:55.288434 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 20:08:55.288434 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 20:08:55.288434 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 20:08:55.288434 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 20:08:55.288434 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:08:55.288434 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:08:55.289479 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 301/596] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jun 21 20:08:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:55.290325 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd69088e-0c2c-410d-9f19-66cbe224aa92 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:55.317658 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:55.365777 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49006141-58b9-48a3-9a1f-a1442c475837 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:55.404451 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd69088e-0c2c-410d-9f19-66cbe224aa92 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:55.410223 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417679bd-90fd-4b86-a172-25790e0b9adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:55.411255 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417679bd-90fd-4b86-a172-25790e0b9adc None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:55.411765 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417679bd-90fd-4b86-a172-25790e0b9adc None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:55.412251 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417679bd-90fd-4b86-a172-25790e0b9adc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:55.428249 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417679bd-90fd-4b86-a172-25790e0b9adc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:55.430624 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417679bd-90fd-4b86-a172-25790e0b9adc None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:55.444614 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06d79fb-04c5-44b1-b562-8c7ac863e8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:55.445360 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d79fb-04c5-44b1-b562-8c7ac863e8cb None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:55.445714 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d79fb-04c5-44b1-b562-8c7ac863e8cb None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:55.446076 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d79fb-04c5-44b1-b562-8c7ac863e8cb None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:55.446907 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06d79fb-04c5-44b1-b562-8c7ac863e8cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:55.447282 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06d79fb-04c5-44b1-b562-8c7ac863e8cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:55.448730 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06d79fb-04c5-44b1-b562-8c7ac863e8cb None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:55.454541 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-417679bd-90fd-4b86-a172-25790e0b9adc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:08:55.454541 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:55.454541 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:55.454541 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:55.454541 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:55.454541 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:55.454541 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:55.454541 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:55.454541 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:55.454541 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:55.454541 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:55.454541 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:55.454541 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:08:55.454541 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:08:55.454541 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:08:55.455424 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:08:55.455424 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:55.455424 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:55.455424 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:55.455424 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:55.455424 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:55.455424 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:55.455424 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:55.455424 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:55.455424 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:55.455424 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:55.455424 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:55.455424 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:55.455424 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:55.455424 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:55.455424 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:55.455424 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:55.456447 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:08:55.456447 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:08:55.456447 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:08:55.456447 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:08:55.458257 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 296/597] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:08:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:55.459329 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417679bd-90fd-4b86-a172-25790e0b9adc None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:55.466467 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 302/598] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:08:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:55.466467 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06d79fb-04c5-44b1-b562-8c7ac863e8cb None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:55.509555 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:55.572182 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417679bd-90fd-4b86-a172-25790e0b9adc None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:55.574445 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06d79fb-04c5-44b1-b562-8c7ac863e8cb None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:55.586101 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:55.608982 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ef27b-7c9e-4634-bf0a-d86d4dd5566b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:55.609282 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db09f90-765c-4433-895a-be44f1ef5b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:55.609904 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ef27b-7c9e-4634-bf0a-d86d4dd5566b None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:55.610193 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ef27b-7c9e-4634-bf0a-d86d4dd5566b None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:55.610289 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db09f90-765c-4433-895a-be44f1ef5b24 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:55.610475 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ef27b-7c9e-4634-bf0a-d86d4dd5566b None admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:55.610570 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db09f90-765c-4433-895a-be44f1ef5b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:55.610778 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db09f90-765c-4433-895a-be44f1ef5b24 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:55.611265 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103ef27b-7c9e-4634-bf0a-d86d4dd5566b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:55.611504 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db09f90-765c-4433-895a-be44f1ef5b24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:55.611597 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103ef27b-7c9e-4634-bf0a-d86d4dd5566b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:55.611818 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db09f90-765c-4433-895a-be44f1ef5b24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:55.613018 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103ef27b-7c9e-4634-bf0a-d86d4dd5566b None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:55.613197 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db09f90-765c-4433-895a-be44f1ef5b24 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:55.630097 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 297/599] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jun 21 20:08:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:55.630097 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ef27b-7c9e-4634-bf0a-d86d4dd5566b None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:55.630977 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 303/600] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:08:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:55.631911 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f21081-6561-4991-9958-4788b4e4b162 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:55.632231 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f21081-6561-4991-9958-4788b4e4b162 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:55.632520 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f21081-6561-4991-9958-4788b4e4b162 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:55.634243 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 304/601] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:08:55.634976 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f21081-6561-4991-9958-4788b4e4b162 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:55.731119 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ef27b-7c9e-4634-bf0a-d86d4dd5566b None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:55.739331 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:55.745272 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f21081-6561-4991-9958-4788b4e4b162 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:55.766543 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb43dea8-2064-4f0a-84f1-4054612dbdb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:55.767436 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43dea8-2064-4f0a-84f1-4054612dbdb2 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:55.767788 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43dea8-2064-4f0a-84f1-4054612dbdb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:55.768163 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43dea8-2064-4f0a-84f1-4054612dbdb2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:55.774939 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb43dea8-2064-4f0a-84f1-4054612dbdb2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:55.776494 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb43dea8-2064-4f0a-84f1-4054612dbdb2 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:55.781589 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f066484-a30c-4390-ae5b-f85acc345fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:55.782459 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f066484-a30c-4390-ae5b-f85acc345fa7 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:55.782812 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f066484-a30c-4390-ae5b-f85acc345fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:55.783155 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f066484-a30c-4390-ae5b-f85acc345fa7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:55.790587 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f066484-a30c-4390-ae5b-f85acc345fa7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:55.790887 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-fb43dea8-2064-4f0a-84f1-4054612dbdb2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:08:55.790887 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:55.790887 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:55.790887 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:55.790887 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:55.790887 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:55.790887 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:55.790887 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:55.790887 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:55.790887 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:55.790887 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:55.790887 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:55.790887 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 20:08:55.790887 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 20:08:55.790887 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 20:08:55.791949 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 20:08:55.791949 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:55.791949 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:55.791949 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:55.791949 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:55.791949 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:55.791949 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:55.791949 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:55.791949 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:55.791949 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:55.791949 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:55.791949 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:55.791949 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:55.791949 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:55.791949 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:55.791949 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:55.791949 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:55.798249 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 20:08:55.798249 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 20:08:55.798249 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 20:08:55.798249 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 20:08:55.798249 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 20:08:55.798249 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 20:08:55.798249 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:08:55.798249 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:08:55.798249 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 298/602] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jun 21 20:08:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:55.798249 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb43dea8-2064-4f0a-84f1-4054612dbdb2 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:55.798906 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f066484-a30c-4390-ae5b-f85acc345fa7 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:55.817130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-3f066484-a30c-4390-ae5b-f85acc345fa7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:08:55.817130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:55.817130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:55.817130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:55.817130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:55.817130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:55.817130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:55.817130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:55.817130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:55.817130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:55.817130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:55.817130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:55.817130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 20:08:55.817130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 20:08:55.817130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 20:08:55.818230 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 20:08:55.818230 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:55.818230 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:55.818230 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:55.818230 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:55.818230 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:55.818230 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:55.818230 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:55.818230 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:55.818230 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:55.818230 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:55.818230 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:55.818230 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:55.818230 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:55.818230 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:55.818230 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:55.818230 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:55.819261 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 20:08:55.819261 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 20:08:55.819261 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 20:08:55.819261 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 20:08:55.819261 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 20:08:55.819261 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 20:08:55.819261 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:08:55.819261 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:08:55.824652 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 305/603] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jun 21 20:08:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:55.824652 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949cdb3b-e44c-4002-be80-c155b1ab1abf None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:55.824652 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949cdb3b-e44c-4002-be80-c155b1ab1abf None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:55.824652 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949cdb3b-e44c-4002-be80-c155b1ab1abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:55.827876 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:55.847670 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-949cdb3b-e44c-4002-be80-c155b1ab1abf None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:55.848902 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-949cdb3b-e44c-4002-be80-c155b1ab1abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:55.896919 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb43dea8-2064-4f0a-84f1-4054612dbdb2 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:55.932675 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2599ad74-b884-4ad8-a2bc-96db029e59f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:55.940535 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599ad74-b884-4ad8-a2bc-96db029e59f0 None admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:55.940660 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 306/604] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:08:55.940741 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599ad74-b884-4ad8-a2bc-96db029e59f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:55.940741 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599ad74-b884-4ad8-a2bc-96db029e59f0 None admin] PATH_INFO: `/v3/projects/4dcb71ef7b6e49148edd61a1eb8da7bb/users/d95478de171141ce85876e852d081149/roles/a4929ef60a294190b2d59e8d61e05063` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:55.940899 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949cdb3b-e44c-4002-be80-c155b1ab1abf None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:55.961236 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2599ad74-b884-4ad8-a2bc-96db029e59f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=4dcb71ef7b6e49148edd61a1eb8da7bb, user_id=d95478de171141ce85876e852d081149, role_id=a4929ef60a294190b2d59e8d61e05063)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:55.962819 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2599ad74-b884-4ad8-a2bc-96db029e59f0 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:55.983953 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 299/605] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Jun 21 20:08:55 2022] PUT /identity/v3/projects/4dcb71ef7b6e49148edd61a1eb8da7bb/users/d95478de171141ce85876e852d081149/roles/a4929ef60a294190b2d59e8d61e05063 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:08:55.983953 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2599ad74-b884-4ad8-a2bc-96db029e59f0 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:56.051645 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:56.065486 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949cdb3b-e44c-4002-be80-c155b1ab1abf None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:56.104497 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:56.108282 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf7fc6-edc0-473e-8e1f-d8ab3f184b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:56.109389 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf7fc6-edc0-473e-8e1f-d8ab3f184b7a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:56.110008 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf7fc6-edc0-473e-8e1f-d8ab3f184b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:56.110367 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf7fc6-edc0-473e-8e1f-d8ab3f184b7a None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:56.111405 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaf7fc6-edc0-473e-8e1f-d8ab3f184b7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:56.111797 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaf7fc6-edc0-473e-8e1f-d8ab3f184b7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:56.114107 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaf7fc6-edc0-473e-8e1f-d8ab3f184b7a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:56.115595 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2599ad74-b884-4ad8-a2bc-96db029e59f0 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:56.130797 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 307/606] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jun 21 20:08:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:56.131784 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf7fc6-edc0-473e-8e1f-d8ab3f184b7a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:56.156684 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b0654-2c4f-4325-958f-a60b37fe4efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:56.157354 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b0654-2c4f-4325-958f-a60b37fe4efc None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:56.157635 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b0654-2c4f-4325-958f-a60b37fe4efc None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:56.157907 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b0654-2c4f-4325-958f-a60b37fe4efc None admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:56.158699 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33b0654-2c4f-4325-958f-a60b37fe4efc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:56.159026 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33b0654-2c4f-4325-958f-a60b37fe4efc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:56.160501 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33b0654-2c4f-4325-958f-a60b37fe4efc None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:56.174651 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 300/607] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jun 21 20:08:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:56.175293 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b0654-2c4f-4325-958f-a60b37fe4efc None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:56.269363 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf7fc6-edc0-473e-8e1f-d8ab3f184b7a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:56.292811 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b0654-2c4f-4325-958f-a60b37fe4efc None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:56.305977 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a1324-549a-4a5c-bae2-7ca187668780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:56.306787 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a1324-549a-4a5c-bae2-7ca187668780 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:56.307075 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a1324-549a-4a5c-bae2-7ca187668780 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:56.307359 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a1324-549a-4a5c-bae2-7ca187668780 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:56.318065 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a1324-549a-4a5c-bae2-7ca187668780 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:08:56.326200 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-d00a1324-549a-4a5c-bae2-7ca187668780 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 20:08:56.326200 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:56.326200 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:56.326200 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:56.326200 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:56.326200 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:56.326200 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:56.326200 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:56.326200 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:56.326200 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:56.326200 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:56.326200 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:56.326200 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:08:56.326200 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:08:56.326200 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:08:56.326200 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:08:56.327274 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:08:56.327274 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:08:56.327274 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:08:56.327274 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:08:56.327274 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:56.327274 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:56.327274 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:56.327274 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:56.327274 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:56.327274 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:56.327274 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:56.327274 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:56.327274 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:56.327274 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:56.327274 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:56.327274 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:56.328431 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:56.328431 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:56.328431 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:56.328431 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:56.328431 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:08:56.328431 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:08:56.328431 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:08:56.328431 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:08:56.328431 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:08:56.328431 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:08:56.328431 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 20:08:56.328431 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:08:56.329286 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd27b32-d25d-4a8b-b979-d1612afbfedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:56.329286 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd27b32-d25d-4a8b-b979-d1612afbfedc None admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:56.329286 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd27b32-d25d-4a8b-b979-d1612afbfedc None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:56.329542 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd27b32-d25d-4a8b-b979-d1612afbfedc None admin] PATH_INFO: `/v3/projects/4dcb71ef7b6e49148edd61a1eb8da7bb/users/30400df887ee433086d1810331785891/roles/a4929ef60a294190b2d59e8d61e05063` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:56.336433 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 308/608] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Jun 21 20:08:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:56.337093 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a1324-549a-4a5c-bae2-7ca187668780 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:56.342454 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:56.347009 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd27b32-d25d-4a8b-b979-d1612afbfedc None admin] RBAC: Authorizing `identity:create_grant(project_id=4dcb71ef7b6e49148edd61a1eb8da7bb, user_id=30400df887ee433086d1810331785891, role_id=a4929ef60a294190b2d59e8d61e05063)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:56.348513 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd27b32-d25d-4a8b-b979-d1612afbfedc None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:56.351950 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:56.364039 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 301/609] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Jun 21 20:08:56 2022] PUT /identity/v3/projects/4dcb71ef7b6e49148edd61a1eb8da7bb/users/30400df887ee433086d1810331785891/roles/a4929ef60a294190b2d59e8d61e05063 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:08:56.370316 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80957d-0b12-425c-a2cf-f1ac5c42c89a None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:56.371012 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80957d-0b12-425c-a2cf-f1ac5c42c89a None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:56.371703 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80957d-0b12-425c-a2cf-f1ac5c42c89a None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:56.378636 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 302/610] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:56 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:08:56.378636 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca80957d-0b12-425c-a2cf-f1ac5c42c89a None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:56.461689 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a1324-549a-4a5c-bae2-7ca187668780 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:56.498523 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a36873a-1977-4acd-8f1a-08027cfbcbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:56.499445 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36873a-1977-4acd-8f1a-08027cfbcbcf None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:56.499732 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36873a-1977-4acd-8f1a-08027cfbcbcf None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:56.500043 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36873a-1977-4acd-8f1a-08027cfbcbcf None admin] PATH_INFO: `/v3/projects/4dcb71ef7b6e49148edd61a1eb8da7bb/users/1b01b53897d64bbaac6efb6f13d413a1/roles/a4929ef60a294190b2d59e8d61e05063` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:56.510452 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca80957d-0b12-425c-a2cf-f1ac5c42c89a None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:56.517623 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a36873a-1977-4acd-8f1a-08027cfbcbcf None admin] RBAC: Authorizing `identity:create_grant(project_id=4dcb71ef7b6e49148edd61a1eb8da7bb, user_id=1b01b53897d64bbaac6efb6f13d413a1, role_id=a4929ef60a294190b2d59e8d61e05063)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:56.519103 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a36873a-1977-4acd-8f1a-08027cfbcbcf None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:56.538540 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 309/611] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Jun 21 20:08:56 2022] PUT /identity/v3/projects/4dcb71ef7b6e49148edd61a1eb8da7bb/users/1b01b53897d64bbaac6efb6f13d413a1/roles/a4929ef60a294190b2d59e8d61e05063 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:08:56.540310 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32586dbf-d7ed-4baa-a0a7-b20027dde0cc None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:56.540596 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32586dbf-d7ed-4baa-a0a7-b20027dde0cc None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:56.540879 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32586dbf-d7ed-4baa-a0a7-b20027dde0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:56.555605 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb64787-f03d-4638-9900-ade017ed99c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:56.556748 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb64787-f03d-4638-9900-ade017ed99c8 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:56.557231 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb64787-f03d-4638-9900-ade017ed99c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:56.557752 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb64787-f03d-4638-9900-ade017ed99c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:56.558725 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb64787-f03d-4638-9900-ade017ed99c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:56.559342 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb64787-f03d-4638-9900-ade017ed99c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:56.560629 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-32586dbf-d7ed-4baa-a0a7-b20027dde0cc None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:56.561355 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb64787-f03d-4638-9900-ade017ed99c8 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:56.561859 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-32586dbf-d7ed-4baa-a0a7-b20027dde0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:56.572836 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 303/612] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Jun 21 20:08:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:56.586141 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb64787-f03d-4638-9900-ade017ed99c8 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:56.671147 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:56.686685 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:56.699716 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 310/613] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:08:56.735005 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32586dbf-d7ed-4baa-a0a7-b20027dde0cc None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:56.756344 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb64787-f03d-4638-9900-ade017ed99c8 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:56.798930 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b02ac1c-f453-4951-a303-25d0b731e450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:56.799794 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b02ac1c-f453-4951-a303-25d0b731e450 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:56.800110 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b02ac1c-f453-4951-a303-25d0b731e450 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:56.800440 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b02ac1c-f453-4951-a303-25d0b731e450 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:56.814438 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b02ac1c-f453-4951-a303-25d0b731e450 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:56.816464 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b02ac1c-f453-4951-a303-25d0b731e450 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:56.838513 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-4b02ac1c-f453-4951-a303-25d0b731e450 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:08:56.838513 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:56.838513 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:56.838513 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:56.838513 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:56.838513 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:56.838513 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:56.838513 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:56.838513 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:56.838513 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:56.838513 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:56.838513 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:56.838513 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:08:56.838513 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:08:56.838513 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:08:56.839436 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:08:56.839436 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:56.839436 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:56.839436 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:56.839436 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:56.839436 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:56.839436 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:56.839436 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:56.839436 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:56.839436 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:56.839436 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:56.839436 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:56.839436 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:56.839436 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:56.839436 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:56.839436 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:56.839436 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:56.840356 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:08:56.840356 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:08:56.840356 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:08:56.840356 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:08:56.842636 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 304/614] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:08:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:56.851085 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b02ac1c-f453-4951-a303-25d0b731e450 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:56.871513 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32586dbf-d7ed-4baa-a0a7-b20027dde0cc None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:56.940041 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb58e13b-a313-444b-9e5e-832ad077b602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:56.941743 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58e13b-a313-444b-9e5e-832ad077b602 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:56.942024 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58e13b-a313-444b-9e5e-832ad077b602 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:56.942299 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58e13b-a313-444b-9e5e-832ad077b602 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:56.962155 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb58e13b-a313-444b-9e5e-832ad077b602 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:08:56.973547 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-eb58e13b-a313-444b-9e5e-832ad077b602 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 20:08:56.973547 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:56.973547 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:56.973547 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:56.973547 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:56.973547 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:56.973547 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:56.973547 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:56.973547 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:56.973547 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:56.973547 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:56.973547 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:56.973547 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:08:56.973547 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:08:56.973547 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:08:56.973547 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:08:56.974751 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:08:56.974751 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:08:56.974751 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:08:56.974751 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:08:56.974751 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:56.974751 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:56.974751 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:56.974751 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:56.974751 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:56.974751 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:56.974751 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:56.974751 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:56.974751 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:56.974751 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:56.974751 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:56.974751 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:56.975786 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:56.975786 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:56.975786 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:56.975786 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:56.975786 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:08:56.975786 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:08:56.975786 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:08:56.975786 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:08:56.975786 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:08:56.975786 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:08:56.975786 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 20:08:56.975786 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:08:56.975786 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 311/615] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Jun 21 20:08:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:08:56.981261 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb58e13b-a313-444b-9e5e-832ad077b602 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:57.058267 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b02ac1c-f453-4951-a303-25d0b731e450 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:57.071052 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:57.080303 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:57.143845 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb58e13b-a313-444b-9e5e-832ad077b602 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:57.148464 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929039f-0b49-4a75-a5d8-2e0db12fdf09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:57.149334 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929039f-0b49-4a75-a5d8-2e0db12fdf09 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:57.149764 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929039f-0b49-4a75-a5d8-2e0db12fdf09 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:57.150169 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929039f-0b49-4a75-a5d8-2e0db12fdf09 None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:57.151025 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6929039f-0b49-4a75-a5d8-2e0db12fdf09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:57.151479 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6929039f-0b49-4a75-a5d8-2e0db12fdf09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:57.153204 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6929039f-0b49-4a75-a5d8-2e0db12fdf09 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:57.175980 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 305/616] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:08:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:57.181135 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22257add-1ee8-4670-99bf-7c87ab243be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:57.181786 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929039f-0b49-4a75-a5d8-2e0db12fdf09 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:57.182019 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22257add-1ee8-4670-99bf-7c87ab243be2 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:57.182398 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22257add-1ee8-4670-99bf-7c87ab243be2 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:57.182771 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22257add-1ee8-4670-99bf-7c87ab243be2 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:57.183616 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22257add-1ee8-4670-99bf-7c87ab243be2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:57.184050 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22257add-1ee8-4670-99bf-7c87ab243be2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:57.185501 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22257add-1ee8-4670-99bf-7c87ab243be2 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:57.198973 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 312/617] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Jun 21 20:08:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:57.205390 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22257add-1ee8-4670-99bf-7c87ab243be2 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:57.316079 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22257add-1ee8-4670-99bf-7c87ab243be2 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:57.327425 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929039f-0b49-4a75-a5d8-2e0db12fdf09 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:57.334593 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:57.364248 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99297609-ff36-4be2-90f2-c2819bbf4a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:57.365756 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99297609-ff36-4be2-90f2-c2819bbf4a14 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:57.366137 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99297609-ff36-4be2-90f2-c2819bbf4a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:57.366515 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99297609-ff36-4be2-90f2-c2819bbf4a14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:57.386295 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99297609-ff36-4be2-90f2-c2819bbf4a14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:57.388567 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99297609-ff36-4be2-90f2-c2819bbf4a14 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:57.413929 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f2f9d-71e8-42d9-a5c6-c6764a274d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:57.414893 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f2f9d-71e8-42d9-a5c6-c6764a274d0e None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:57.415272 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f2f9d-71e8-42d9-a5c6-c6764a274d0e None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:57.415642 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f2f9d-71e8-42d9-a5c6-c6764a274d0e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:57.423179 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-99297609-ff36-4be2-90f2-c2819bbf4a14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:08:57.423179 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:57.423179 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:57.423179 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:57.423179 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:57.423179 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:57.423179 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:57.423179 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:57.423179 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:57.423179 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:57.423179 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:57.423179 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:57.423179 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:08:57.423179 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:08:57.423179 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:08:57.424261 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:08:57.424261 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:57.424261 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:57.424261 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:57.424261 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:57.424261 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:57.424261 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:57.424261 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:57.424261 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:57.424261 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:57.424261 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:57.424261 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:57.424261 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:57.424261 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:57.424261 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:57.424261 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:57.424261 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:57.425391 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:08:57.425391 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:08:57.425391 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:08:57.425391 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:08:57.426138 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f2f9d-71e8-42d9-a5c6-c6764a274d0e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:57.428258 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f2f9d-71e8-42d9-a5c6-c6764a274d0e None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:57.429910 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 313/618] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:08:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:57.436088 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99297609-ff36-4be2-90f2-c2819bbf4a14 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:57.467235 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-407f2f9d-71e8-42d9-a5c6-c6764a274d0e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 21 20:08:57.467235 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:57.467235 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:57.467235 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:57.467235 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:57.467235 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:57.467235 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:57.467235 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:57.467235 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:57.467235 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:57.467235 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:57.467235 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:57.467235 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 20:08:57.467235 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 20:08:57.467235 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 20:08:57.467235 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 20:08:57.468479 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:57.468479 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:57.468479 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 20:08:57.468479 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:08:57.468479 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 20:08:57.468479 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:08:57.468479 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:57.468479 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:57.468479 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:57.468479 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:57.468479 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:57.468479 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:57.468479 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:57.468479 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:57.468479 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:57.468479 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:57.468479 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:57.468479 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:57.469617 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:57.469617 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:57.469617 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 20:08:57.469617 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 20:08:57.469617 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 20:08:57.469617 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 20:08:57.469617 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 20:08:57.469617 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 20:08:57.469617 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 21 20:08:57.469617 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:08:57.480179 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 306/619] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jun 21 20:08:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:08:57.488859 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f2f9d-71e8-42d9-a5c6-c6764a274d0e None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:57.545676 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:57.637688 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99297609-ff36-4be2-90f2-c2819bbf4a14 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:57.690008 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f2f9d-71e8-42d9-a5c6-c6764a274d0e None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:57.703381 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a94ee75-f2b1-4cf9-8ef1-abfae8d1465f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:57.704084 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94ee75-f2b1-4cf9-8ef1-abfae8d1465f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:57.704374 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94ee75-f2b1-4cf9-8ef1-abfae8d1465f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:57.704655 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94ee75-f2b1-4cf9-8ef1-abfae8d1465f None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:57.705385 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a94ee75-f2b1-4cf9-8ef1-abfae8d1465f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:57.705696 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a94ee75-f2b1-4cf9-8ef1-abfae8d1465f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:57.707052 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a94ee75-f2b1-4cf9-8ef1-abfae8d1465f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:57.731184 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 314/620] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:08:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:08:57.735085 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a94ee75-f2b1-4cf9-8ef1-abfae8d1465f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:57.764316 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:57.764699 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a6958b-2103-4ba5-bfa8-43cd431e9940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:57.765415 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a6958b-2103-4ba5-bfa8-43cd431e9940 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:57.765705 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a6958b-2103-4ba5-bfa8-43cd431e9940 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:57.765998 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a6958b-2103-4ba5-bfa8-43cd431e9940 None admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:57.766856 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a6958b-2103-4ba5-bfa8-43cd431e9940 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:57.767175 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a6958b-2103-4ba5-bfa8-43cd431e9940 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:57.768846 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a6958b-2103-4ba5-bfa8-43cd431e9940 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:57.807666 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 307/621] 10.222.0.15 () {56 vars in 1135 bytes} [Tue Jun 21 20:08:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:57.812934 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a6958b-2103-4ba5-bfa8-43cd431e9940 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:57.847053 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a94ee75-f2b1-4cf9-8ef1-abfae8d1465f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:57.885403 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fafdf38-0b08-4598-ae86-22eb6323a131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:57.886226 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fafdf38-0b08-4598-ae86-22eb6323a131 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:57.886740 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fafdf38-0b08-4598-ae86-22eb6323a131 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:57.887113 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fafdf38-0b08-4598-ae86-22eb6323a131 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:57.894700 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fafdf38-0b08-4598-ae86-22eb6323a131 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:57.896875 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fafdf38-0b08-4598-ae86-22eb6323a131 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:57.912385 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-4fafdf38-0b08-4598-ae86-22eb6323a131 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 20:08:57.912385 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:57.912385 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:57.912385 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:57.912385 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:57.912385 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:57.912385 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:57.912385 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:57.912385 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:57.912385 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:57.912385 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:57.912385 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:57.912385 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 20:08:57.912385 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 20:08:57.912385 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 20:08:57.912385 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 20:08:57.913547 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:57.913547 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:57.913547 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 20:08:57.913547 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:08:57.913547 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 20:08:57.913547 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:08:57.913547 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:57.913547 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:57.913547 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:57.913547 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:57.913547 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:57.913547 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:57.913547 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:57.913547 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:57.913547 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:57.913547 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:57.913547 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:57.913547 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:57.914725 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:57.914725 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:57.914725 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 20:08:57.914725 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 20:08:57.914725 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 20:08:57.914725 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 20:08:57.914725 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 20:08:57.914725 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 20:08:57.914725 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 20:08:57.914725 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:08:57.916717 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 315/622] 10.222.0.15 () {56 vars in 1093 bytes} [Tue Jun 21 20:08:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:57.926963 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fafdf38-0b08-4598-ae86-22eb6323a131 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:58.022487 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:58.031651 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fafdf38-0b08-4598-ae86-22eb6323a131 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:58.052273 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:58.066977 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b8edc0-1149-4357-a46c-bb69496d2553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:58.068531 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8edc0-1149-4357-a46c-bb69496d2553 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:58.068938 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8edc0-1149-4357-a46c-bb69496d2553 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:58.069337 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8edc0-1149-4357-a46c-bb69496d2553 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:58.070034 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a6958b-2103-4ba5-bfa8-43cd431e9940 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:58.070376 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b8edc0-1149-4357-a46c-bb69496d2553 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:58.070790 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b8edc0-1149-4357-a46c-bb69496d2553 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:58.072518 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b8edc0-1149-4357-a46c-bb69496d2553 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:58.102858 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 316/623] 10.222.0.15 () {56 vars in 1133 bytes} [Tue Jun 21 20:08:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:58.105512 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b8edc0-1149-4357-a46c-bb69496d2553 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:58.169211 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523f09c-7c8f-4f6d-b92c-67f7c6d4b65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:58.170035 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523f09c-7c8f-4f6d-b92c-67f7c6d4b65b None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:58.170324 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523f09c-7c8f-4f6d-b92c-67f7c6d4b65b None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:58.170604 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523f09c-7c8f-4f6d-b92c-67f7c6d4b65b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:58.209355 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6523f09c-7c8f-4f6d-b92c-67f7c6d4b65b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:58.210835 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6523f09c-7c8f-4f6d-b92c-67f7c6d4b65b None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:58.219378 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b8edc0-1149-4357-a46c-bb69496d2553 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:58.256587 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9c6949-eaf2-4d79-a9d3-fff8fb6d6a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:58.257242 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c6949-eaf2-4d79-a9d3-fff8fb6d6a10 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:58.257530 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c6949-eaf2-4d79-a9d3-fff8fb6d6a10 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:58.257811 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c6949-eaf2-4d79-a9d3-fff8fb6d6a10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:58.264583 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-6523f09c-7c8f-4f6d-b92c-67f7c6d4b65b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:08:58.264583 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:58.264583 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:58.264583 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:58.264583 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:58.264583 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:58.264583 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:58.264583 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:58.264583 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:58.264583 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:58.264583 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:58.264583 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:58.264583 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:08:58.264583 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:08:58.264583 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:08:58.265478 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:08:58.265478 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:58.265478 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:58.265478 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:58.265478 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:58.265478 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:58.265478 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:58.265478 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:58.265478 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:58.265478 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:58.265478 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:58.265478 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:58.265478 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:58.265478 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:58.265478 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:58.265478 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:58.265478 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:58.266362 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:08:58.266362 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:08:58.266362 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:08:58.266362 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:08:58.266362 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 308/624] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:08:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 453 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:58.272917 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523f09c-7c8f-4f6d-b92c-67f7c6d4b65b None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:58.308314 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:58.332629 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9c6949-eaf2-4d79-a9d3-fff8fb6d6a10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:58.334063 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9c6949-eaf2-4d79-a9d3-fff8fb6d6a10 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:58.453382 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 317/625] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:08:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 20:08:58.455215 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bbe0c2-87b3-4b20-a0e3-3cb966ff032f None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:58.455650 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bbe0c2-87b3-4b20-a0e3-3cb966ff032f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:58.456111 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bbe0c2-87b3-4b20-a0e3-3cb966ff032f None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:58.457654 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 318/626] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:08:58.460154 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bbe0c2-87b3-4b20-a0e3-3cb966ff032f None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:58.462294 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523f09c-7c8f-4f6d-b92c-67f7c6d4b65b None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:58.499617 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b66b1fe-ec4a-428c-a799-1d18f37d76c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:58.500332 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66b1fe-ec4a-428c-a799-1d18f37d76c8 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:58.500620 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66b1fe-ec4a-428c-a799-1d18f37d76c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:58.500897 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66b1fe-ec4a-428c-a799-1d18f37d76c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:58.501699 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b66b1fe-ec4a-428c-a799-1d18f37d76c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:58.502007 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b66b1fe-ec4a-428c-a799-1d18f37d76c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:58.503386 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b66b1fe-ec4a-428c-a799-1d18f37d76c8 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:58.506785 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:58.518772 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 309/627] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:08:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:58.520507 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb15b6-3753-4007-98c1-f1b128f047c3 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:58.520837 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb15b6-3753-4007-98c1-f1b128f047c3 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:58.521121 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb15b6-3753-4007-98c1-f1b128f047c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:58.522212 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:58.541813 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-e3eb15b6-3753-4007-98c1-f1b128f047c3 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:58.543253 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-e3eb15b6-3753-4007-98c1-f1b128f047c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:58.589928 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bbe0c2-87b3-4b20-a0e3-3cb966ff032f None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:58.631854 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 310/628] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:08:58.631854 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb15b6-3753-4007-98c1-f1b128f047c3 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:58.656049 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4227f2e5-11fd-4020-99db-68991ecd2044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:58.657257 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227f2e5-11fd-4020-99db-68991ecd2044 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:58.657747 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227f2e5-11fd-4020-99db-68991ecd2044 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:58.658243 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227f2e5-11fd-4020-99db-68991ecd2044 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:58.669424 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4227f2e5-11fd-4020-99db-68991ecd2044 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:58.671156 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4227f2e5-11fd-4020-99db-68991ecd2044 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:58.689685 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-4227f2e5-11fd-4020-99db-68991ecd2044 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:08:58.689685 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:58.689685 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:58.689685 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:58.689685 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:58.689685 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:58.689685 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:58.689685 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:58.689685 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:58.689685 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:58.689685 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:58.689685 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:58.689685 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:08:58.689685 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:08:58.689685 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:08:58.690628 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:08:58.690628 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:58.690628 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:58.690628 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:58.690628 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:58.690628 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:58.690628 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:58.690628 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:58.690628 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:58.690628 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:58.690628 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:58.690628 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:58.690628 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:58.690628 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:58.690628 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:58.690628 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:58.690628 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:58.691631 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:08:58.691631 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:08:58.691631 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:08:58.691631 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:08:58.694437 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 319/629] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:08:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:58.695541 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4227f2e5-11fd-4020-99db-68991ecd2044 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:58.744901 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb15b6-3753-4007-98c1-f1b128f047c3 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:58.780324 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:58.792656 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733eaa65-6523-4b6a-8dfd-ca24efc3e3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:58.793348 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733eaa65-6523-4b6a-8dfd-ca24efc3e3af None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:58.793629 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733eaa65-6523-4b6a-8dfd-ca24efc3e3af None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:58.793906 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733eaa65-6523-4b6a-8dfd-ca24efc3e3af None admin] PATH_INFO: `/v3/projects/service` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:58.804569 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733eaa65-6523-4b6a-8dfd-ca24efc3e3af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:58.806113 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:58.807119 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733eaa65-6523-4b6a-8dfd-ca24efc3e3af None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:58.813975 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4227f2e5-11fd-4020-99db-68991ecd2044 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:58.821748 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-733eaa65-6523-4b6a-8dfd-ca24efc3e3af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:08:58.821748 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:58.821748 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:58.821748 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:58.821748 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:58.821748 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:58.821748 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:58.821748 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:58.821748 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:58.821748 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:58.821748 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:58.821748 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:58.821748 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 20:08:58.821748 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 20:08:58.821748 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 20:08:58.823147 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 20:08:58.823147 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:58.823147 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:58.823147 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:58.823147 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:58.823147 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:58.823147 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:58.823147 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:58.823147 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:58.823147 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:58.823147 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:58.823147 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:58.823147 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:58.823147 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:58.823147 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:58.823147 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:58.823147 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:58.824407 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 20:08:58.824407 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 20:08:58.824407 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 20:08:58.824407 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 20:08:58.824407 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 20:08:58.824407 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 20:08:58.824407 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:08:58.824407 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:08:58.824407 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 311/630] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jun 21 20:08:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:58.824407 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733eaa65-6523-4b6a-8dfd-ca24efc3e3af None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:58.856880 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a5274-2e9f-4348-805b-1627d108dccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:58.857666 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a5274-2e9f-4348-805b-1627d108dccf None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:58.857949 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a5274-2e9f-4348-805b-1627d108dccf None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:58.858223 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a5274-2e9f-4348-805b-1627d108dccf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:58.868995 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a5274-2e9f-4348-805b-1627d108dccf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:08:58.876729 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-878a5274-2e9f-4348-805b-1627d108dccf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 20:08:58.876729 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:58.876729 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:58.876729 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:58.876729 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:58.876729 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:58.876729 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:58.876729 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:58.876729 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:58.876729 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:58.876729 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:58.876729 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:58.876729 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:08:58.876729 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:08:58.876729 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:08:58.876729 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:08:58.877776 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:08:58.877776 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:08:58.877776 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:08:58.877776 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:08:58.877776 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:58.877776 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:58.877776 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:58.877776 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:58.877776 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:58.877776 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:58.877776 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:58.877776 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:58.877776 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:58.877776 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:58.877776 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:58.877776 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:58.878632 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:58.878632 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:58.878632 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:58.878632 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:58.878632 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:08:58.878632 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:08:58.878632 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:08:58.878632 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:08:58.878632 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:08:58.878632 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:08:58.878632 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 20:08:58.878632 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:08:58.878632 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 320/631] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Jun 21 20:08:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:58.879397 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017eb5e4-e1d1-4819-ae7d-6f9b276f33d1 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:58.879680 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017eb5e4-e1d1-4819-ae7d-6f9b276f33d1 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:58.879977 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017eb5e4-e1d1-4819-ae7d-6f9b276f33d1 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:58.881267 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 321/632] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:08:58.881934 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017eb5e4-e1d1-4819-ae7d-6f9b276f33d1 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:58.931282 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733eaa65-6523-4b6a-8dfd-ca24efc3e3af None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:58.963144 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180c12e1-f887-45e1-a6a5-6e37416daac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:58.963808 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c12e1-f887-45e1-a6a5-6e37416daac0 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:58.964121 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c12e1-f887-45e1-a6a5-6e37416daac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:58.964405 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c12e1-f887-45e1-a6a5-6e37416daac0 None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:58.965126 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180c12e1-f887-45e1-a6a5-6e37416daac0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:58.965437 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180c12e1-f887-45e1-a6a5-6e37416daac0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:58.966794 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180c12e1-f887-45e1-a6a5-6e37416daac0 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:58.979111 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 312/633] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:08:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:58.981243 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ea91c-6612-4d05-b266-852ced3a9dc0 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:58.981529 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ea91c-6612-4d05-b266-852ced3a9dc0 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:58.981807 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ea91c-6612-4d05-b266-852ced3a9dc0 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:58.983045 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 313/634] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:08:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:08:58.983731 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8ea91c-6612-4d05-b266-852ced3a9dc0 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:58.988547 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017eb5e4-e1d1-4819-ae7d-6f9b276f33d1 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:59.021543 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e97f31-6bf7-4bed-b272-c80cb9141d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:59.022206 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e97f31-6bf7-4bed-b272-c80cb9141d06 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:59.022492 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e97f31-6bf7-4bed-b272-c80cb9141d06 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:59.022770 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e97f31-6bf7-4bed-b272-c80cb9141d06 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:59.023554 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e97f31-6bf7-4bed-b272-c80cb9141d06 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:59.023866 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e97f31-6bf7-4bed-b272-c80cb9141d06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:59.025307 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e97f31-6bf7-4bed-b272-c80cb9141d06 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:59.029606 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:59.037427 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 322/635] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jun 21 20:08:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:59.038695 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada9b0c-0346-4adf-896c-21fe4c5a820c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:59.039039 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada9b0c-0346-4adf-896c-21fe4c5a820c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:59.039267 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada9b0c-0346-4adf-896c-21fe4c5a820c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:59.055353 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-3ada9b0c-0346-4adf-896c-21fe4c5a820c None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:59.056511 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3ada9b0c-0346-4adf-896c-21fe4c5a820c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:59.065510 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:59.084735 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8ea91c-6612-4d05-b266-852ced3a9dc0 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:59.118294 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155e976-8565-4352-9d48-77fc6d8fcedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:59.118953 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155e976-8565-4352-9d48-77fc6d8fcedb None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:59.119238 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155e976-8565-4352-9d48-77fc6d8fcedb None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:59.119509 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155e976-8565-4352-9d48-77fc6d8fcedb None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:59.120309 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8155e976-8565-4352-9d48-77fc6d8fcedb None admin] RBAC: Adding query filter params (name=service) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:59.120612 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8155e976-8565-4352-9d48-77fc6d8fcedb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:59.121961 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8155e976-8565-4352-9d48-77fc6d8fcedb None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:59.122926 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 323/636] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:08:59.123728 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada9b0c-0346-4adf-896c-21fe4c5a820c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:59.143593 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 314/637] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Jun 21 20:08:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:59.144867 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0bf035-4cc0-4a72-bcb0-6d279037fa5f None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:59.145162 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0bf035-4cc0-4a72-bcb0-6d279037fa5f None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:59.145431 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0bf035-4cc0-4a72-bcb0-6d279037fa5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:59.162314 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-4b0bf035-4cc0-4a72-bcb0-6d279037fa5f None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:08:59.163826 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-4b0bf035-4cc0-4a72-bcb0-6d279037fa5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:08:59.224777 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada9b0c-0346-4adf-896c-21fe4c5a820c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:59.228873 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 315/638] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:08:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:08:59.229670 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0bf035-4cc0-4a72-bcb0-6d279037fa5f None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:59.259327 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c62b9a-b5e3-4dd8-9d7a-e90d54e3b1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:59.260158 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c62b9a-b5e3-4dd8-9d7a-e90d54e3b1d5 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:59.260442 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c62b9a-b5e3-4dd8-9d7a-e90d54e3b1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:59.260718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c62b9a-b5e3-4dd8-9d7a-e90d54e3b1d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:59.267211 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c62b9a-b5e3-4dd8-9d7a-e90d54e3b1d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:59.268670 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c62b9a-b5e3-4dd8-9d7a-e90d54e3b1d5 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:59.281017 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:59.282435 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-b1c62b9a-b5e3-4dd8-9d7a-e90d54e3b1d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:08:59.282435 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:59.282435 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:59.282435 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:59.282435 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:59.282435 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:59.282435 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:59.282435 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:59.282435 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:59.282435 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:59.282435 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:59.282435 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:59.282435 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 20:08:59.282435 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 20:08:59.282435 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 20:08:59.283495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 20:08:59.283495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:59.283495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:59.283495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:59.283495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:59.283495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:59.283495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:59.283495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:59.283495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:59.283495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:59.283495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:59.283495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:59.283495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:59.283495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:59.283495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:59.283495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:59.283495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:59.284718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 20:08:59.284718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 20:08:59.284718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 20:08:59.284718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 20:08:59.284718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 20:08:59.284718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 20:08:59.284718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:08:59.284718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:08:59.284718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 324/639] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jun 21 20:08:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:59.284718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c62b9a-b5e3-4dd8-9d7a-e90d54e3b1d5 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:59.289096 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:59.344341 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0bf035-4cc0-4a72-bcb0-6d279037fa5f None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:59.377991 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948427f-e201-4b2b-aea1-9a9e57c06d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:59.378880 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948427f-e201-4b2b-aea1-9a9e57c06d9b None admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:59.379169 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948427f-e201-4b2b-aea1-9a9e57c06d9b None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:59.379451 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948427f-e201-4b2b-aea1-9a9e57c06d9b None admin] PATH_INFO: `/v3/projects/4dcb71ef7b6e49148edd61a1eb8da7bb/users/038537bd12174154ba259e097b97b8bd/roles/a4929ef60a294190b2d59e8d61e05063` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:59.382803 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c62b9a-b5e3-4dd8-9d7a-e90d54e3b1d5 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:59.397027 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3948427f-e201-4b2b-aea1-9a9e57c06d9b None admin] RBAC: Authorizing `identity:create_grant(project_id=4dcb71ef7b6e49148edd61a1eb8da7bb, user_id=038537bd12174154ba259e097b97b8bd, role_id=a4929ef60a294190b2d59e8d61e05063)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:59.398464 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3948427f-e201-4b2b-aea1-9a9e57c06d9b None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:59.410356 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 316/640] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Jun 21 20:08:59 2022] PUT /identity/v3/projects/4dcb71ef7b6e49148edd61a1eb8da7bb/users/038537bd12174154ba259e097b97b8bd/roles/a4929ef60a294190b2d59e8d61e05063 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:08:59.418326 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948427f-e201-4b2b-aea1-9a9e57c06d9b None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:59.425306 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b93e8a-1694-427f-a2f9-691eaa7976b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:59.426616 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b93e8a-1694-427f-a2f9-691eaa7976b8 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:59.427076 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b93e8a-1694-427f-a2f9-691eaa7976b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:59.427622 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b93e8a-1694-427f-a2f9-691eaa7976b8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:59.440454 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b93e8a-1694-427f-a2f9-691eaa7976b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:08:59.449852 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-80b93e8a-1694-427f-a2f9-691eaa7976b8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 20:08:59.449852 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:59.449852 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:59.449852 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:59.449852 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:59.449852 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:59.449852 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:59.449852 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:59.449852 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:59.449852 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:59.449852 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:59.449852 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:59.449852 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:08:59.449852 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:08:59.449852 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:08:59.449852 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:08:59.451064 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:08:59.451064 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:08:59.451064 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:08:59.451064 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:08:59.451064 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:59.451064 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:59.451064 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:59.451064 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:59.451064 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:59.451064 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:59.451064 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:59.451064 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:59.451064 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:59.451064 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:59.451064 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:59.451064 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:59.452156 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:59.452156 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:59.452156 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:59.452156 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:59.452156 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:08:59.452156 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:08:59.452156 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:08:59.452156 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:08:59.452156 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:08:59.452156 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:08:59.452156 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 20:08:59.452156 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:08:59.460287 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 325/641] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Jun 21 20:08:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:59.461648 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b93e8a-1694-427f-a2f9-691eaa7976b8 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:59.506272 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:59.521813 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948427f-e201-4b2b-aea1-9a9e57c06d9b None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:59.534657 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:59.562598 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affc4322-a3c8-4dd6-9e27-657aad54b11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:59.563411 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc4322-a3c8-4dd6-9e27-657aad54b11d None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:59.563702 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc4322-a3c8-4dd6-9e27-657aad54b11d None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:59.564130 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc4322-a3c8-4dd6-9e27-657aad54b11d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:59.577699 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affc4322-a3c8-4dd6-9e27-657aad54b11d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:59.578872 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affc4322-a3c8-4dd6-9e27-657aad54b11d None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:59.582483 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b93e8a-1694-427f-a2f9-691eaa7976b8 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:59.597318 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-affc4322-a3c8-4dd6-9e27-657aad54b11d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:08:59.597318 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:59.597318 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:59.597318 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:59.597318 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:59.597318 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:59.597318 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:59.597318 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:59.597318 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:59.597318 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:59.597318 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:59.597318 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:59.597318 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:08:59.597318 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:08:59.597318 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:08:59.598274 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:08:59.598274 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:59.598274 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:59.598274 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:59.598274 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:59.598274 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:59.598274 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:59.598274 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:59.598274 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:59.598274 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:59.598274 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:59.598274 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:59.598274 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:59.598274 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:59.598274 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:59.598274 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:59.598274 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:59.599212 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:08:59.599212 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:08:59.599212 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:08:59.599212 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:08:59.599962 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 317/642] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:08:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:59.601178 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affc4322-a3c8-4dd6-9e27-657aad54b11d None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:59.622980 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd82a6-aeb2-454c-81ce-bc3e6563d9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:59.623787 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd82a6-aeb2-454c-81ce-bc3e6563d9fc None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:59.624120 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd82a6-aeb2-454c-81ce-bc3e6563d9fc None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:59.624400 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd82a6-aeb2-454c-81ce-bc3e6563d9fc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:59.635949 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dd82a6-aeb2-454c-81ce-bc3e6563d9fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:08:59.643566 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-34dd82a6-aeb2-454c-81ce-bc3e6563d9fc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 20:08:59.643566 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:08:59.643566 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:08:59.643566 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:08:59.643566 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:08:59.643566 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:08:59.643566 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:08:59.643566 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:08:59.643566 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:08:59.643566 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:08:59.643566 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:08:59.643566 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:08:59.643566 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:08:59.643566 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:08:59.643566 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:08:59.643566 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:08:59.644574 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:08:59.644574 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:08:59.644574 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:08:59.644574 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:08:59.644574 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:08:59.644574 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:08:59.644574 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:08:59.644574 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:08:59.644574 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:08:59.644574 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:08:59.644574 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:08:59.644574 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:08:59.644574 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:08:59.644574 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:08:59.644574 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:08:59.644574 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:08:59.645460 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:08:59.645460 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:08:59.645460 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:08:59.645460 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:08:59.645460 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:08:59.645460 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:08:59.645460 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:08:59.645460 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:08:59.645460 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:08:59.645460 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:08:59.645460 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 20:08:59.645460 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:08:59.645460 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 326/643] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Jun 21 20:08:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:08:59.647767 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd82a6-aeb2-454c-81ce-bc3e6563d9fc None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:59.714662 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affc4322-a3c8-4dd6-9e27-657aad54b11d None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:59.749573 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd82a6-aeb2-454c-81ce-bc3e6563d9fc None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:59.749766 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feefc323-a0bc-4e17-913a-7e31d92cc72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:59.750233 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feefc323-a0bc-4e17-913a-7e31d92cc72e None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:59.750519 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feefc323-a0bc-4e17-913a-7e31d92cc72e None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:59.750802 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feefc323-a0bc-4e17-913a-7e31d92cc72e None admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:59.751588 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feefc323-a0bc-4e17-913a-7e31d92cc72e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:59.751928 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feefc323-a0bc-4e17-913a-7e31d92cc72e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:59.756958 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feefc323-a0bc-4e17-913a-7e31d92cc72e None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:59.768041 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:59.776591 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 318/644] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jun 21 20:08:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:59.777319 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feefc323-a0bc-4e17-913a-7e31d92cc72e None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:59.785300 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:08:59.797849 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9567df-a8b9-42e6-bc6c-59a4c0cb988b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:59.798522 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9567df-a8b9-42e6-bc6c-59a4c0cb988b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:59.798807 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9567df-a8b9-42e6-bc6c-59a4c0cb988b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:59.799084 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9567df-a8b9-42e6-bc6c-59a4c0cb988b None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:59.799824 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9567df-a8b9-42e6-bc6c-59a4c0cb988b None admin] RBAC: Adding query filter params (name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:59.800207 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9567df-a8b9-42e6-bc6c-59a4c0cb988b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:59.801559 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9567df-a8b9-42e6-bc6c-59a4c0cb988b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:59.810425 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 327/645] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Jun 21 20:08:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:59.815363 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9567df-a8b9-42e6-bc6c-59a4c0cb988b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:59.891985 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feefc323-a0bc-4e17-913a-7e31d92cc72e None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:59.926138 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9567df-a8b9-42e6-bc6c-59a4c0cb988b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:08:59.926467 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5593cd6c-2e64-4cef-894d-f1cf130abfa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:59.927653 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593cd6c-2e64-4cef-894d-f1cf130abfa6 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:59.927968 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593cd6c-2e64-4cef-894d-f1cf130abfa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:59.928246 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593cd6c-2e64-4cef-894d-f1cf130abfa6 None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:59.928968 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5593cd6c-2e64-4cef-894d-f1cf130abfa6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:59.929279 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5593cd6c-2e64-4cef-894d-f1cf130abfa6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:59.930641 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5593cd6c-2e64-4cef-894d-f1cf130abfa6 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:59.947228 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 319/646] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:08:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:59.947228 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5593cd6c-2e64-4cef-894d-f1cf130abfa6 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:08:59.968676 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a841f-bf88-4586-b50d-cd2b5bea05bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:08:59.969431 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a841f-bf88-4586-b50d-cd2b5bea05bd None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:08:59.969788 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a841f-bf88-4586-b50d-cd2b5bea05bd None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:08:59.970132 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a841f-bf88-4586-b50d-cd2b5bea05bd None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:08:59.970959 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501a841f-bf88-4586-b50d-cd2b5bea05bd None admin] RBAC: Adding query filter params (name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:08:59.971332 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501a841f-bf88-4586-b50d-cd2b5bea05bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:08:59.972798 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501a841f-bf88-4586-b50d-cd2b5bea05bd None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:08:59.980882 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 328/647] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Jun 21 20:08:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:08:59.981619 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a841f-bf88-4586-b50d-cd2b5bea05bd None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:00.009720 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:00.031615 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:00.056030 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5593cd6c-2e64-4cef-894d-f1cf130abfa6 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:00.087410 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a841f-bf88-4586-b50d-cd2b5bea05bd None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:00.094214 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92e0ce-a4b0-4ee7-bc80-0a92e3d15495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:00.094896 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92e0ce-a4b0-4ee7-bc80-0a92e3d15495 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:00.095163 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92e0ce-a4b0-4ee7-bc80-0a92e3d15495 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:00.095441 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92e0ce-a4b0-4ee7-bc80-0a92e3d15495 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:00.096300 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a92e0ce-a4b0-4ee7-bc80-0a92e3d15495 None admin] RBAC: Adding query filter params (role.id=a4929ef60a294190b2d59e8d61e05063, scope.project.id=4dcb71ef7b6e49148edd61a1eb8da7bb, user.id=3918fe05c8634bc39f3e295374701465) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:00.096805 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a92e0ce-a4b0-4ee7-bc80-0a92e3d15495 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:00.098040 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a92e0ce-a4b0-4ee7-bc80-0a92e3d15495 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:00.104561 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 320/648] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jun 21 20:08:59 2022] GET /identity/v3/role_assignments?user.id=3918fe05c8634bc39f3e295374701465&scope.project.id=4dcb71ef7b6e49148edd61a1eb8da7bb&role.id=a4929ef60a294190b2d59e8d61e05063 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:00.105266 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92e0ce-a4b0-4ee7-bc80-0a92e3d15495 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:00.137932 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5673012b-d7b4-42cd-b20a-5687424304f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:00.139264 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673012b-d7b4-42cd-b20a-5687424304f4 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:00.139774 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673012b-d7b4-42cd-b20a-5687424304f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:00.140283 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673012b-d7b4-42cd-b20a-5687424304f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:00.153468 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5673012b-d7b4-42cd-b20a-5687424304f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:00.155326 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5673012b-d7b4-42cd-b20a-5687424304f4 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:00.175377 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-5673012b-d7b4-42cd-b20a-5687424304f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:00.175377 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:00.175377 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:00.175377 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:00.175377 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:00.175377 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:00.175377 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:00.175377 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:00.175377 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:00.175377 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:00.175377 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:00.175377 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:00.175377 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:09:00.175377 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:09:00.175377 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:09:00.176461 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:09:00.176461 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:00.176461 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:00.176461 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:00.176461 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:00.176461 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:00.176461 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:00.176461 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:00.176461 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:00.176461 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:00.176461 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:00.176461 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:00.176461 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:00.176461 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:00.176461 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:00.176461 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:00.176461 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:00.177994 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:09:00.177994 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:09:00.177994 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:00.177994 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:00.180377 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 329/649] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:08:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:00.181658 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5673012b-d7b4-42cd-b20a-5687424304f4 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:00.257889 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92e0ce-a4b0-4ee7-bc80-0a92e3d15495 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:00.283749 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:00.297212 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede7c7f4-57fc-4914-9fbb-f4bbc154d519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:00.298023 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7c7f4-57fc-4914-9fbb-f4bbc154d519 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:00.298313 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7c7f4-57fc-4914-9fbb-f4bbc154d519 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:00.298592 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7c7f4-57fc-4914-9fbb-f4bbc154d519 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:00.300155 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:00.304474 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5673012b-d7b4-42cd-b20a-5687424304f4 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:00.307871 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede7c7f4-57fc-4914-9fbb-f4bbc154d519 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:00.308889 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede7c7f4-57fc-4914-9fbb-f4bbc154d519 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:00.326886 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-ede7c7f4-57fc-4914-9fbb-f4bbc154d519 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 20:09:00.326886 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:00.326886 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:00.326886 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:00.326886 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:00.326886 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:00.326886 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:00.326886 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:00.326886 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:00.326886 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:00.326886 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:00.326886 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:00.326886 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 20:09:00.326886 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 20:09:00.326886 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 20:09:00.326886 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 20:09:00.327939 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:00.327939 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:00.327939 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 20:09:00.327939 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:09:00.327939 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 20:09:00.327939 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:09:00.327939 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:00.327939 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:00.327939 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:00.327939 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:00.327939 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:00.327939 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:00.327939 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:00.327939 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:00.327939 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:00.327939 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:00.327939 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:00.327939 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:00.328922 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:00.328922 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:00.328922 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 20:09:00.328922 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 20:09:00.328922 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 20:09:00.328922 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 20:09:00.328922 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 20:09:00.328922 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 20:09:00.328922 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 20:09:00.328922 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:00.329480 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 321/650] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:09:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:00.330360 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede7c7f4-57fc-4914-9fbb-f4bbc154d519 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:00.365871 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe7c60-49e7-42bc-a8d7-99d92dcdec79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:00.366534 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe7c60-49e7-42bc-a8d7-99d92dcdec79 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:00.368991 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe7c60-49e7-42bc-a8d7-99d92dcdec79 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:00.368991 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe7c60-49e7-42bc-a8d7-99d92dcdec79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:00.384443 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfe7c60-49e7-42bc-a8d7-99d92dcdec79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:00.387068 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfe7c60-49e7-42bc-a8d7-99d92dcdec79 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:00.409554 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-7cfe7c60-49e7-42bc-a8d7-99d92dcdec79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:00.409554 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:00.409554 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:00.409554 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:00.409554 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:00.409554 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:00.409554 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:00.409554 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:00.409554 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:00.409554 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:00.409554 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:00.409554 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:00.409554 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:09:00.409554 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:09:00.409554 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:09:00.410685 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:09:00.410685 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:00.410685 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:00.410685 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:00.410685 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:00.410685 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:00.410685 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:00.410685 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:00.410685 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:00.410685 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:00.410685 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:00.410685 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:00.410685 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:00.410685 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:00.410685 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:00.410685 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:00.410685 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:00.412350 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:09:00.412350 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:09:00.412350 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:00.412350 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:00.414790 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 330/651] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:09:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:00.415749 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe7c60-49e7-42bc-a8d7-99d92dcdec79 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:00.475428 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede7c7f4-57fc-4914-9fbb-f4bbc154d519 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:00.518941 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580b410-eb04-43a3-8aca-ee86655a9a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:00.519617 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580b410-eb04-43a3-8aca-ee86655a9a6c None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:00.519905 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580b410-eb04-43a3-8aca-ee86655a9a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:00.520213 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580b410-eb04-43a3-8aca-ee86655a9a6c None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:00.521019 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8580b410-eb04-43a3-8aca-ee86655a9a6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:00.521292 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8580b410-eb04-43a3-8aca-ee86655a9a6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:00.522660 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8580b410-eb04-43a3-8aca-ee86655a9a6c None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:00.538024 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 322/652] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:09:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:00.539506 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580b410-eb04-43a3-8aca-ee86655a9a6c None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:00.578383 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe7c60-49e7-42bc-a8d7-99d92dcdec79 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:00.619150 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d1c781-4643-4e19-85e2-deb2919bd820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:00.621094 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1c781-4643-4e19-85e2-deb2919bd820 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:00.623130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1c781-4643-4e19-85e2-deb2919bd820 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:00.623130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1c781-4643-4e19-85e2-deb2919bd820 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:00.623130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d1c781-4643-4e19-85e2-deb2919bd820 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:00.623130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d1c781-4643-4e19-85e2-deb2919bd820 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:00.624892 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d1c781-4643-4e19-85e2-deb2919bd820 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:00.645285 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:00.652679 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 331/653] 10.222.0.15 () {56 vars in 1137 bytes} [Tue Jun 21 20:09:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:00.654013 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d1c781-4643-4e19-85e2-deb2919bd820 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:00.672353 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:00.763342 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580b410-eb04-43a3-8aca-ee86655a9a6c None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:00.781536 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d1c781-4643-4e19-85e2-deb2919bd820 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:00.812600 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6fdb2-cf37-4301-b8e1-8b47f8f50ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:00.813269 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6fdb2-cf37-4301-b8e1-8b47f8f50ca8 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:00.813555 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6fdb2-cf37-4301-b8e1-8b47f8f50ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:00.813821 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6fdb2-cf37-4301-b8e1-8b47f8f50ca8 None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:00.814563 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb6fdb2-cf37-4301-b8e1-8b47f8f50ca8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:00.815020 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb6fdb2-cf37-4301-b8e1-8b47f8f50ca8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:00.816264 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb6fdb2-cf37-4301-b8e1-8b47f8f50ca8 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:00.828174 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819f34f-b056-4737-9c4e-d64f4bdb9079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:00.828953 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 323/654] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:09:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:00.829559 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819f34f-b056-4737-9c4e-d64f4bdb9079 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:00.829843 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6fdb2-cf37-4301-b8e1-8b47f8f50ca8 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:00.830380 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819f34f-b056-4737-9c4e-d64f4bdb9079 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:00.830869 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819f34f-b056-4737-9c4e-d64f4bdb9079 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:00.840962 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6819f34f-b056-4737-9c4e-d64f4bdb9079 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:00.842694 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6819f34f-b056-4737-9c4e-d64f4bdb9079 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:00.863788 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-6819f34f-b056-4737-9c4e-d64f4bdb9079 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 21 20:09:00.863788 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:00.863788 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:00.863788 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:00.863788 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:00.863788 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:00.863788 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:00.863788 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:00.863788 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:00.863788 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:00.863788 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:00.863788 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:00.863788 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 20:09:00.863788 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 20:09:00.863788 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 20:09:00.863788 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 20:09:00.864978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:00.864978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:00.864978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 20:09:00.864978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:09:00.864978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 20:09:00.864978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:09:00.864978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:00.864978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:00.864978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:00.864978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:00.864978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:00.864978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:00.864978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:00.864978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:00.864978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:00.864978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:00.864978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:00.864978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:00.865929 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:00.865929 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:00.865929 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 20:09:00.865929 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 20:09:00.865929 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 20:09:00.865929 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 20:09:00.865929 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 20:09:00.865929 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 20:09:00.865929 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 21 20:09:00.865929 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:00.865929 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 332/655] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:09:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:00.867034 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819f34f-b056-4737-9c4e-d64f4bdb9079 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:00.946727 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:00.979852 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819f34f-b056-4737-9c4e-d64f4bdb9079 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:00.980896 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6fdb2-cf37-4301-b8e1-8b47f8f50ca8 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:00.985220 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:01.019068 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f5631-1986-4e45-839a-6fdc4549287b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:01.020048 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f5631-1986-4e45-839a-6fdc4549287b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:01.020429 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f5631-1986-4e45-839a-6fdc4549287b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:01.021361 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f5631-1986-4e45-839a-6fdc4549287b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:01.029353 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c6b4c-6cec-4691-9411-8ded36d61977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:01.029804 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1f5631-1986-4e45-839a-6fdc4549287b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:01.030438 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c6b4c-6cec-4691-9411-8ded36d61977 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:01.030882 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c6b4c-6cec-4691-9411-8ded36d61977 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:01.031319 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c6b4c-6cec-4691-9411-8ded36d61977 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:01.031610 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1f5631-1986-4e45-839a-6fdc4549287b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:01.047583 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-3b1f5631-1986-4e45-839a-6fdc4549287b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 21 20:09:01.047583 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:01.047583 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:01.047583 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:01.047583 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:01.047583 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:01.047583 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:01.047583 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:01.047583 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:01.047583 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:01.047583 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:01.047583 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:01.047583 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 20:09:01.047583 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 20:09:01.047583 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 20:09:01.047583 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 20:09:01.049151 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:01.049151 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:01.049151 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 20:09:01.049151 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:09:01.049151 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 20:09:01.049151 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:09:01.049151 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:01.049151 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:01.049151 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:01.049151 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:01.049151 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:01.049151 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:01.049151 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:01.049151 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:01.049151 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:01.049151 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:01.049151 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:01.049151 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:01.050130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:01.050130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:01.050130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 20:09:01.050130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 20:09:01.050130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 20:09:01.050130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 20:09:01.050130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 20:09:01.050130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 20:09:01.050130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 21 20:09:01.050130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:01.050130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 333/656] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Jun 21 20:09:00 2022] GET /identity/v3/users/neutron => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:01.050765 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f5631-1986-4e45-839a-6fdc4549287b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:01.110540 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81c6b4c-6cec-4691-9411-8ded36d61977 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:01.112215 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81c6b4c-6cec-4691-9411-8ded36d61977 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:01.179408 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f5631-1986-4e45-839a-6fdc4549287b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:01.209921 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:01.217070 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b5b513-8e24-41f3-ae1a-4f706840dc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:01.217978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5b513-8e24-41f3-ae1a-4f706840dc61 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:01.218575 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5b513-8e24-41f3-ae1a-4f706840dc61 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:01.218944 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5b513-8e24-41f3-ae1a-4f706840dc61 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:01.219948 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b5b513-8e24-41f3-ae1a-4f706840dc61 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:01.220450 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b5b513-8e24-41f3-ae1a-4f706840dc61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:01.221922 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b5b513-8e24-41f3-ae1a-4f706840dc61 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:01.238242 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 324/657] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:09:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 20:09:01.238242 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c6b4c-6cec-4691-9411-8ded36d61977 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:01.242343 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:01.248462 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 334/658] 10.222.0.15 () {56 vars in 1137 bytes} [Tue Jun 21 20:09:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:01.249653 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b5b513-8e24-41f3-ae1a-4f706840dc61 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:01.356413 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c6b4c-6cec-4691-9411-8ded36d61977 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:01.357448 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b5b513-8e24-41f3-ae1a-4f706840dc61 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:01.394765 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3187366-5ba5-48fc-9bf2-1ec28cf4b2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:01.395378 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d5a66f-e8e5-47cd-9b18-6b7b88db27ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:01.395872 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3187366-5ba5-48fc-9bf2-1ec28cf4b2da None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:01.396281 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3187366-5ba5-48fc-9bf2-1ec28cf4b2da None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:01.396630 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5a66f-e8e5-47cd-9b18-6b7b88db27ed None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:01.396743 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3187366-5ba5-48fc-9bf2-1ec28cf4b2da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:01.397174 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5a66f-e8e5-47cd-9b18-6b7b88db27ed None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:01.397783 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5a66f-e8e5-47cd-9b18-6b7b88db27ed None admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:01.398925 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d5a66f-e8e5-47cd-9b18-6b7b88db27ed None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:01.399393 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d5a66f-e8e5-47cd-9b18-6b7b88db27ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:01.401113 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d5a66f-e8e5-47cd-9b18-6b7b88db27ed None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:01.407911 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3187366-5ba5-48fc-9bf2-1ec28cf4b2da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:01.409510 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3187366-5ba5-48fc-9bf2-1ec28cf4b2da None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:01.420930 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 325/659] 10.222.0.15 () {56 vars in 1139 bytes} [Tue Jun 21 20:09:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:01.422069 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d5a66f-e8e5-47cd-9b18-6b7b88db27ed None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:01.429009 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-f3187366-5ba5-48fc-9bf2-1ec28cf4b2da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:01.429009 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:01.429009 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:01.429009 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:01.429009 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:01.429009 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:01.429009 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:01.429009 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:01.429009 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:01.429009 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:01.429009 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:01.429009 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:01.429009 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:09:01.429009 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:09:01.429009 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:09:01.430140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:09:01.430140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:01.430140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:01.430140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:01.430140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:01.430140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:01.430140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:01.430140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:01.430140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:01.430140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:01.430140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:01.430140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:01.430140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:01.430140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:01.430140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:01.430140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:01.430140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:01.431254 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:09:01.431254 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:09:01.431254 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:01.431254 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:01.436998 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 335/660] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:09:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:01.436998 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3187366-5ba5-48fc-9bf2-1ec28cf4b2da None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:01.491320 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:01.509176 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:01.548658 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d5a66f-e8e5-47cd-9b18-6b7b88db27ed None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:01.554962 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3187366-5ba5-48fc-9bf2-1ec28cf4b2da None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:01.585731 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a9bdea-8c33-42be-a2f2-78e508d7740f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:01.586375 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9bdea-8c33-42be-a2f2-78e508d7740f None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:01.586662 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9bdea-8c33-42be-a2f2-78e508d7740f None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:01.586933 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9bdea-8c33-42be-a2f2-78e508d7740f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:01.592713 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64181751-8a08-4451-bb11-fa2ea8a6d34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:01.593373 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64181751-8a08-4451-bb11-fa2ea8a6d34f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:01.593663 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64181751-8a08-4451-bb11-fa2ea8a6d34f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:01.593943 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64181751-8a08-4451-bb11-fa2ea8a6d34f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:01.656846 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a9bdea-8c33-42be-a2f2-78e508d7740f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:01.658257 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a9bdea-8c33-42be-a2f2-78e508d7740f None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:01.666455 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64181751-8a08-4451-bb11-fa2ea8a6d34f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:01.667890 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64181751-8a08-4451-bb11-fa2ea8a6d34f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:01.709925 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:01.722384 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:01.770443 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 326/661] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:09:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 20:09:01.770443 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a9bdea-8c33-42be-a2f2-78e508d7740f None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:01.779756 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 336/662] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:09:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 20:09:01.784134 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62f422-d704-4604-9d2f-a4487057bbdc None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:01.784134 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62f422-d704-4604-9d2f-a4487057bbdc None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:01.784134 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62f422-d704-4604-9d2f-a4487057bbdc None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:01.784134 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 337/663] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:09:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:09:01.784134 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b62f422-d704-4604-9d2f-a4487057bbdc None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:01.879418 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a9bdea-8c33-42be-a2f2-78e508d7740f None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:01.897414 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b62f422-d704-4604-9d2f-a4487057bbdc None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:01.915421 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22daf024-6559-4adb-a03e-ce90e618dcff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:01.916119 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22daf024-6559-4adb-a03e-ce90e618dcff None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:01.916409 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22daf024-6559-4adb-a03e-ce90e618dcff None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:01.916690 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22daf024-6559-4adb-a03e-ce90e618dcff None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:01.917419 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22daf024-6559-4adb-a03e-ce90e618dcff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:01.917855 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22daf024-6559-4adb-a03e-ce90e618dcff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:01.919235 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22daf024-6559-4adb-a03e-ce90e618dcff None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:01.931845 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b7c35-5d5e-453b-b82e-6d61cf8d818b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:01.936430 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 327/664] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:09:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:01.936557 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b7c35-5d5e-453b-b82e-6d61cf8d818b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:01.936557 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b7c35-5d5e-453b-b82e-6d61cf8d818b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:01.936736 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22daf024-6559-4adb-a03e-ce90e618dcff None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:01.936822 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b7c35-5d5e-453b-b82e-6d61cf8d818b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:01.945380 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:01.947948 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5b7c35-5d5e-453b-b82e-6d61cf8d818b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:01.949721 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5b7c35-5d5e-453b-b82e-6d61cf8d818b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:01.964191 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:01.967289 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-da5b7c35-5d5e-453b-b82e-6d61cf8d818b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:01.967289 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:01.967289 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:01.967289 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:01.967289 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:01.967289 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:01.967289 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:01.967289 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:01.967289 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:01.967289 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:01.967289 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:01.967289 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:01.967289 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:09:01.967289 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:09:01.967289 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:09:01.968229 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:09:01.968229 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:01.968229 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:01.968229 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:01.968229 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:01.968229 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:01.968229 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:01.968229 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:01.968229 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:01.968229 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:01.968229 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:01.968229 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:01.968229 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:01.968229 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:01.968229 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:01.968229 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:01.968229 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:01.969127 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:09:01.969127 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:09:01.969127 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:01.969127 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:01.969127 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 338/665] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:09:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:01.969990 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2dc63d-d392-4fcd-8f39-a3677daef059 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:01.970419 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2dc63d-d392-4fcd-8f39-a3677daef059 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:01.970704 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2dc63d-d392-4fcd-8f39-a3677daef059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:01.988906 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-fa2dc63d-d392-4fcd-8f39-a3677daef059 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:09:01.990717 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-fa2dc63d-d392-4fcd-8f39-a3677daef059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:09:02.054731 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22daf024-6559-4adb-a03e-ce90e618dcff None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:02.057082 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 339/666] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:09:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:09:02.057462 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2dc63d-d392-4fcd-8f39-a3677daef059 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:02.096055 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa04d3ed-7588-4385-8d50-cbc5f36e9be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:02.096854 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04d3ed-7588-4385-8d50-cbc5f36e9be7 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:02.097317 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04d3ed-7588-4385-8d50-cbc5f36e9be7 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:02.097429 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04d3ed-7588-4385-8d50-cbc5f36e9be7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:02.108849 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa04d3ed-7588-4385-8d50-cbc5f36e9be7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:02.110530 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa04d3ed-7588-4385-8d50-cbc5f36e9be7 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:02.128766 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-fa04d3ed-7588-4385-8d50-cbc5f36e9be7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:02.128766 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:02.128766 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:02.128766 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:02.128766 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:02.128766 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:02.128766 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:02.128766 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:02.128766 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:02.128766 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:02.128766 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:02.128766 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:02.128766 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:09:02.128766 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:09:02.128766 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:09:02.129679 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:09:02.129679 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:02.129679 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:02.129679 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:02.129679 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:02.129679 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:02.129679 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:02.129679 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:02.129679 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:02.129679 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:02.129679 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:02.129679 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:02.129679 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:02.129679 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:02.129679 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:02.129679 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:02.129679 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:02.130640 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:09:02.130640 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:09:02.130640 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:02.130640 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:02.130640 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 328/667] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:09:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:02.130921 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa04d3ed-7588-4385-8d50-cbc5f36e9be7 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:02.173531 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2dc63d-d392-4fcd-8f39-a3677daef059 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:02.196836 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:02.209811 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d715d4-1b87-4daf-bd12-1f4b5f45de10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:02.210622 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d715d4-1b87-4daf-bd12-1f4b5f45de10 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:02.210912 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d715d4-1b87-4daf-bd12-1f4b5f45de10 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:02.211194 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d715d4-1b87-4daf-bd12-1f4b5f45de10 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:02.218127 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d715d4-1b87-4daf-bd12-1f4b5f45de10 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:02.219080 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:02.219561 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d715d4-1b87-4daf-bd12-1f4b5f45de10 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:02.234263 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-88d715d4-1b87-4daf-bd12-1f4b5f45de10 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:09:02.234263 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:02.234263 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:02.234263 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:02.234263 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:02.234263 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:02.234263 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:02.234263 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:02.234263 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:02.234263 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:02.234263 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:02.234263 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:02.234263 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 20:09:02.234263 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 20:09:02.234263 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 20:09:02.235648 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 20:09:02.235648 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:02.235648 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:02.235648 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:02.235648 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:02.235648 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:02.235648 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:02.235648 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:02.235648 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:02.235648 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:02.235648 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:02.235648 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:02.235648 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:02.235648 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:02.235648 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:02.235648 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:02.235648 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:02.236796 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 20:09:02.236796 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 20:09:02.236796 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 20:09:02.236796 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 20:09:02.236796 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 20:09:02.236796 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 20:09:02.236796 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:09:02.236796 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:02.240471 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 340/668] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jun 21 20:09:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:02.241300 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d715d4-1b87-4daf-bd12-1f4b5f45de10 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:02.251579 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa04d3ed-7588-4385-8d50-cbc5f36e9be7 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:02.295025 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde52ade-9b10-4714-a9f0-05d386e6c418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:02.295694 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde52ade-9b10-4714-a9f0-05d386e6c418 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:02.296011 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde52ade-9b10-4714-a9f0-05d386e6c418 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:02.296299 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde52ade-9b10-4714-a9f0-05d386e6c418 None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:02.297027 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde52ade-9b10-4714-a9f0-05d386e6c418 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:02.297350 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde52ade-9b10-4714-a9f0-05d386e6c418 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:02.298719 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde52ade-9b10-4714-a9f0-05d386e6c418 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:02.315272 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 329/669] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:09:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:02.315272 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde52ade-9b10-4714-a9f0-05d386e6c418 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:02.351008 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d715d4-1b87-4daf-bd12-1f4b5f45de10 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:02.385848 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34755b12-ff4e-4d4d-a62a-95ef8de12fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:02.386649 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34755b12-ff4e-4d4d-a62a-95ef8de12fe7 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:02.386931 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34755b12-ff4e-4d4d-a62a-95ef8de12fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:02.387205 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34755b12-ff4e-4d4d-a62a-95ef8de12fe7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:02.397505 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34755b12-ff4e-4d4d-a62a-95ef8de12fe7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:09:02.405085 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-34755b12-ff4e-4d4d-a62a-95ef8de12fe7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 20:09:02.405085 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:02.405085 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:02.405085 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:02.405085 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:02.405085 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:02.405085 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:02.405085 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:02.405085 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:02.405085 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:02.405085 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:02.405085 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:02.405085 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:09:02.405085 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:09:02.405085 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:09:02.405085 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:09:02.406236 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:09:02.406236 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:09:02.406236 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:09:02.406236 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:09:02.406236 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:02.406236 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:02.406236 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:02.406236 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:02.406236 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:02.406236 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:02.406236 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:02.406236 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:02.406236 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:02.406236 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:02.406236 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:02.406236 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:02.407294 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:02.407294 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:02.407294 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:02.407294 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:02.407294 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:09:02.407294 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:09:02.407294 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:09:02.407294 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:09:02.407294 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:09:02.407294 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:09:02.407294 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 20:09:02.407294 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:02.407294 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 341/670] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Jun 21 20:09:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:02.407294 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34755b12-ff4e-4d4d-a62a-95ef8de12fe7 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:02.424033 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde52ade-9b10-4714-a9f0-05d386e6c418 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:02.451147 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:02.457844 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b04563-f799-4286-a796-b936c40a6852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:02.459065 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b04563-f799-4286-a796-b936c40a6852 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:02.459348 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b04563-f799-4286-a796-b936c40a6852 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:02.459624 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b04563-f799-4286-a796-b936c40a6852 None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:02.460377 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b04563-f799-4286-a796-b936c40a6852 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:02.460685 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b04563-f799-4286-a796-b936c40a6852 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:02.462051 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b04563-f799-4286-a796-b936c40a6852 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:02.463459 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:02.474881 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 330/671] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:09:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:02.474881 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b04563-f799-4286-a796-b936c40a6852 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:02.508449 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34755b12-ff4e-4d4d-a62a-95ef8de12fe7 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:02.541130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9d19bb-5dde-491c-868d-97beaf4fcfb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:02.541790 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d19bb-5dde-491c-868d-97beaf4fcfb3 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:02.542077 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d19bb-5dde-491c-868d-97beaf4fcfb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:02.542358 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d19bb-5dde-491c-868d-97beaf4fcfb3 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:02.543148 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9d19bb-5dde-491c-868d-97beaf4fcfb3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:02.543464 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9d19bb-5dde-491c-868d-97beaf4fcfb3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:02.544915 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9d19bb-5dde-491c-868d-97beaf4fcfb3 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:02.556595 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 342/672] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jun 21 20:09:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:02.557821 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc8d95-c257-4c55-9ade-5da32715be81 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:02.558112 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc8d95-c257-4c55-9ade-5da32715be81 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:02.558404 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc8d95-c257-4c55-9ade-5da32715be81 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:02.559687 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 343/673] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:09:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:09:02.560296 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc8d95-c257-4c55-9ade-5da32715be81 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:02.575859 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b04563-f799-4286-a796-b936c40a6852 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:02.609064 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034716c9-e4cd-41ed-8525-4d3ae54c8bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:02.610200 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034716c9-e4cd-41ed-8525-4d3ae54c8bd2 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:02.610489 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034716c9-e4cd-41ed-8525-4d3ae54c8bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:02.610763 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034716c9-e4cd-41ed-8525-4d3ae54c8bd2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:02.617587 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034716c9-e4cd-41ed-8525-4d3ae54c8bd2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:02.619175 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034716c9-e4cd-41ed-8525-4d3ae54c8bd2 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:02.633507 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-034716c9-e4cd-41ed-8525-4d3ae54c8bd2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:09:02.633507 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:02.633507 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:02.633507 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:02.633507 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:02.633507 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:02.633507 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:02.633507 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:02.633507 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:02.633507 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:02.633507 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:02.633507 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:02.633507 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 20:09:02.633507 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 20:09:02.633507 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 20:09:02.634508 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 20:09:02.634508 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:02.634508 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:02.634508 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:02.634508 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:02.634508 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:02.634508 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:02.634508 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:02.634508 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:02.634508 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:02.634508 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:02.634508 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:02.634508 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:02.634508 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:02.634508 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:02.634508 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:02.634508 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:02.635385 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 20:09:02.635385 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 20:09:02.635385 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 20:09:02.635385 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 20:09:02.635385 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 20:09:02.635385 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 20:09:02.635385 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:09:02.635385 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:02.635385 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 331/674] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jun 21 20:09:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:02.636356 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034716c9-e4cd-41ed-8525-4d3ae54c8bd2 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:02.665377 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc8d95-c257-4c55-9ade-5da32715be81 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:02.666903 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:02.693555 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:02.700792 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b40c8d-6ce6-4d93-9f11-6c78337753ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:02.701464 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b40c8d-6ce6-4d93-9f11-6c78337753ea None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:02.701751 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b40c8d-6ce6-4d93-9f11-6c78337753ea None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:02.702032 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b40c8d-6ce6-4d93-9f11-6c78337753ea None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:02.702786 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b40c8d-6ce6-4d93-9f11-6c78337753ea None admin] RBAC: Adding query filter params (name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:02.703100 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b40c8d-6ce6-4d93-9f11-6c78337753ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:02.704493 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b40c8d-6ce6-4d93-9f11-6c78337753ea None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:02.713302 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 344/675] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Jun 21 20:09:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:02.714166 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b40c8d-6ce6-4d93-9f11-6c78337753ea None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:02.740514 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034716c9-e4cd-41ed-8525-4d3ae54c8bd2 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:02.775118 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4d83ca-a6e5-492d-9ae6-d0146dcf5658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:02.775909 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d83ca-a6e5-492d-9ae6-d0146dcf5658 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:02.776232 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d83ca-a6e5-492d-9ae6-d0146dcf5658 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:02.776519 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d83ca-a6e5-492d-9ae6-d0146dcf5658 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:02.783069 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4d83ca-a6e5-492d-9ae6-d0146dcf5658 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:02.784551 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4d83ca-a6e5-492d-9ae6-d0146dcf5658 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:02.797992 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-5c4d83ca-a6e5-492d-9ae6-d0146dcf5658 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:09:02.797992 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:02.797992 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:02.797992 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:02.797992 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:02.797992 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:02.797992 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:02.797992 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:02.797992 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:02.797992 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:02.797992 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:02.797992 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:02.797992 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 20:09:02.797992 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 20:09:02.797992 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 20:09:02.798893 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 20:09:02.798893 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:02.798893 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:02.798893 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:02.798893 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:02.798893 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:02.798893 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:02.798893 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:02.798893 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:02.798893 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:02.798893 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:02.798893 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:02.798893 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:02.798893 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:02.798893 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:02.798893 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:02.798893 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:02.799784 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 20:09:02.799784 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 20:09:02.799784 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 20:09:02.799784 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 20:09:02.799784 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 20:09:02.799784 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 20:09:02.799784 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:09:02.799784 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:02.799784 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 332/676] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jun 21 20:09:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:02.800324 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935cdbfd-4e3d-4d12-bedf-d02ada026b7c None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:02.800650 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935cdbfd-4e3d-4d12-bedf-d02ada026b7c None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:02.800892 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935cdbfd-4e3d-4d12-bedf-d02ada026b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:02.815017 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b40c8d-6ce6-4d93-9f11-6c78337753ea None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:02.817058 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-935cdbfd-4e3d-4d12-bedf-d02ada026b7c None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:09:02.818847 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-935cdbfd-4e3d-4d12-bedf-d02ada026b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:09:02.850599 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d50e96-d43d-4ba3-8428-ba0456bc0b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:02.851193 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d50e96-d43d-4ba3-8428-ba0456bc0b85 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:02.851483 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d50e96-d43d-4ba3-8428-ba0456bc0b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:02.851766 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d50e96-d43d-4ba3-8428-ba0456bc0b85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:02.852634 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d50e96-d43d-4ba3-8428-ba0456bc0b85 None admin] RBAC: Adding query filter params (role.id=a4929ef60a294190b2d59e8d61e05063, scope.project.id=4dcb71ef7b6e49148edd61a1eb8da7bb, user.id=d95478de171141ce85876e852d081149) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:02.852950 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d50e96-d43d-4ba3-8428-ba0456bc0b85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:02.854383 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d50e96-d43d-4ba3-8428-ba0456bc0b85 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:02.860774 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 345/677] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jun 21 20:09:02 2022] GET /identity/v3/role_assignments?user.id=d95478de171141ce85876e852d081149&scope.project.id=4dcb71ef7b6e49148edd61a1eb8da7bb&role.id=a4929ef60a294190b2d59e8d61e05063 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:02.861567 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d50e96-d43d-4ba3-8428-ba0456bc0b85 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:02.899947 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 333/678] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:09:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:09:02.899947 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935cdbfd-4e3d-4d12-bedf-d02ada026b7c None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:02.909280 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:02.958058 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:02.998634 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d50e96-d43d-4ba3-8428-ba0456bc0b85 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:03.022794 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935cdbfd-4e3d-4d12-bedf-d02ada026b7c None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:03.041875 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388530f-91ff-4bfe-b3f2-b4cb7c6e9e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:03.042548 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388530f-91ff-4bfe-b3f2-b4cb7c6e9e99 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:03.042842 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388530f-91ff-4bfe-b3f2-b4cb7c6e9e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:03.043124 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388530f-91ff-4bfe-b3f2-b4cb7c6e9e99 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:03.043969 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388530f-91ff-4bfe-b3f2-b4cb7c6e9e99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:03.044284 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388530f-91ff-4bfe-b3f2-b4cb7c6e9e99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:03.045720 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388530f-91ff-4bfe-b3f2-b4cb7c6e9e99 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:03.059332 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 346/679] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jun 21 20:09:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:03.060307 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388530f-91ff-4bfe-b3f2-b4cb7c6e9e99 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:03.070406 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6e507-fc86-4161-bb1a-b95b7362e5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:03.071219 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6e507-fc86-4161-bb1a-b95b7362e5b1 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:03.071872 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6e507-fc86-4161-bb1a-b95b7362e5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:03.072351 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6e507-fc86-4161-bb1a-b95b7362e5b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:03.083852 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee6e507-fc86-4161-bb1a-b95b7362e5b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:03.085364 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee6e507-fc86-4161-bb1a-b95b7362e5b1 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:03.103169 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-3ee6e507-fc86-4161-bb1a-b95b7362e5b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:03.103169 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:03.103169 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:03.103169 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:03.103169 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:03.103169 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:03.103169 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:03.103169 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:03.103169 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:03.103169 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:03.103169 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:03.103169 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:03.103169 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:09:03.103169 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:09:03.103169 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:09:03.104113 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:09:03.104113 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:03.104113 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:03.104113 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:03.104113 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:03.104113 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:03.104113 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:03.104113 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:03.104113 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:03.104113 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:03.104113 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:03.104113 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:03.104113 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:03.104113 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:03.104113 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:03.104113 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:03.104113 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:03.104999 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:09:03.104999 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:09:03.104999 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:03.104999 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:03.104999 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 334/680] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:09:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:03.105631 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6e507-fc86-4161-bb1a-b95b7362e5b1 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:03.161821 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:03.175340 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388530f-91ff-4bfe-b3f2-b4cb7c6e9e99 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:03.209733 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:03.210444 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f75cff-6ec2-4e6e-8aec-1638d20b50d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:03.211183 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f75cff-6ec2-4e6e-8aec-1638d20b50d4 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:03.211519 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f75cff-6ec2-4e6e-8aec-1638d20b50d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:03.212121 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f75cff-6ec2-4e6e-8aec-1638d20b50d4 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:03.213109 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f75cff-6ec2-4e6e-8aec-1638d20b50d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:03.213421 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f75cff-6ec2-4e6e-8aec-1638d20b50d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:03.214831 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f75cff-6ec2-4e6e-8aec-1638d20b50d4 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:03.218458 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6e507-fc86-4161-bb1a-b95b7362e5b1 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:03.227250 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 347/681] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jun 21 20:09:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:03.228099 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f75cff-6ec2-4e6e-8aec-1638d20b50d4 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:03.262275 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d441f1-7518-477e-a21a-fecc822fb56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:03.263499 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d441f1-7518-477e-a21a-fecc822fb56e None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:03.264112 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d441f1-7518-477e-a21a-fecc822fb56e None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:03.264609 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d441f1-7518-477e-a21a-fecc822fb56e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:03.275766 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d441f1-7518-477e-a21a-fecc822fb56e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:09:03.284211 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-09d441f1-7518-477e-a21a-fecc822fb56e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 20:09:03.284211 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:03.284211 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:03.284211 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:03.284211 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:03.284211 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:03.284211 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:03.284211 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:03.284211 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:03.284211 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:03.284211 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:03.284211 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:03.284211 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:09:03.284211 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:09:03.284211 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:09:03.284211 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:09:03.285393 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:09:03.285393 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:09:03.285393 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:09:03.285393 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:09:03.285393 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:03.285393 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:03.285393 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:03.285393 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:03.285393 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:03.285393 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:03.285393 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:03.285393 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:03.285393 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:03.285393 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:03.285393 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:03.285393 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:03.287041 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:03.287041 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:03.287041 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:03.287041 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:03.287041 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:09:03.287041 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:09:03.287041 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:09:03.287041 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:09:03.287041 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:09:03.287041 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:09:03.287041 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 20:09:03.287041 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:03.289100 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 335/682] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jun 21 20:09:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:03.290026 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d441f1-7518-477e-a21a-fecc822fb56e None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:03.334177 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f75cff-6ec2-4e6e-8aec-1638d20b50d4 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:03.371165 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e69f9a-6097-4a38-838a-8318312d3140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:03.371890 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e69f9a-6097-4a38-838a-8318312d3140 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:03.372217 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e69f9a-6097-4a38-838a-8318312d3140 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:03.372556 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e69f9a-6097-4a38-838a-8318312d3140 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:03.373394 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e69f9a-6097-4a38-838a-8318312d3140 None admin] RBAC: Adding query filter params (role.id=a4929ef60a294190b2d59e8d61e05063, scope.project.id=4dcb71ef7b6e49148edd61a1eb8da7bb, user.id=30400df887ee433086d1810331785891) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:03.373717 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e69f9a-6097-4a38-838a-8318312d3140 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:03.375172 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e69f9a-6097-4a38-838a-8318312d3140 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:03.381261 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 348/683] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jun 21 20:09:03 2022] GET /identity/v3/role_assignments?user.id=30400df887ee433086d1810331785891&scope.project.id=4dcb71ef7b6e49148edd61a1eb8da7bb&role.id=a4929ef60a294190b2d59e8d61e05063 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:03.382060 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e69f9a-6097-4a38-838a-8318312d3140 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:03.412854 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:03.424050 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d441f1-7518-477e-a21a-fecc822fb56e None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:03.473218 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b899594-0be7-4e1c-8981-d6855267dac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:03.474747 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b899594-0be7-4e1c-8981-d6855267dac0 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:03.475046 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b899594-0be7-4e1c-8981-d6855267dac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:03.475331 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b899594-0be7-4e1c-8981-d6855267dac0 None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:03.476125 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b899594-0be7-4e1c-8981-d6855267dac0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:03.476441 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b899594-0be7-4e1c-8981-d6855267dac0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:03.477847 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b899594-0be7-4e1c-8981-d6855267dac0 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:03.499166 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 336/684] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:09:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:03.499166 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b899594-0be7-4e1c-8981-d6855267dac0 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:03.517161 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:03.536096 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e69f9a-6097-4a38-838a-8318312d3140 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:03.579346 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080ba04-4274-49a5-a1dd-4866dbbd3f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:03.580373 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080ba04-4274-49a5-a1dd-4866dbbd3f59 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:03.580847 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080ba04-4274-49a5-a1dd-4866dbbd3f59 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:03.581312 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080ba04-4274-49a5-a1dd-4866dbbd3f59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:03.582375 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d080ba04-4274-49a5-a1dd-4866dbbd3f59 None admin] RBAC: Adding query filter params (role.id=a4929ef60a294190b2d59e8d61e05063, scope.project.id=4dcb71ef7b6e49148edd61a1eb8da7bb, user.id=1b01b53897d64bbaac6efb6f13d413a1) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:03.582881 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d080ba04-4274-49a5-a1dd-4866dbbd3f59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:03.585084 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d080ba04-4274-49a5-a1dd-4866dbbd3f59 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:03.592229 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 349/685] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jun 21 20:09:03 2022] GET /identity/v3/role_assignments?user.id=1b01b53897d64bbaac6efb6f13d413a1&scope.project.id=4dcb71ef7b6e49148edd61a1eb8da7bb&role.id=a4929ef60a294190b2d59e8d61e05063 => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:03.593312 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080ba04-4274-49a5-a1dd-4866dbbd3f59 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:03.643742 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b899594-0be7-4e1c-8981-d6855267dac0 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:03.687511 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2449fe91-0755-4751-bf33-d17458102e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:03.688253 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449fe91-0755-4751-bf33-d17458102e98 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:03.688630 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449fe91-0755-4751-bf33-d17458102e98 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:03.688951 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449fe91-0755-4751-bf33-d17458102e98 None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:03.690237 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2449fe91-0755-4751-bf33-d17458102e98 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:03.690237 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2449fe91-0755-4751-bf33-d17458102e98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:03.691582 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2449fe91-0755-4751-bf33-d17458102e98 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:03.698672 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:03.702889 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 337/686] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:09:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:03.708875 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2449fe91-0755-4751-bf33-d17458102e98 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:03.732506 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080ba04-4274-49a5-a1dd-4866dbbd3f59 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:03.788095 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66141de2-597b-49de-9fd7-d0ab34542500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:03.789900 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66141de2-597b-49de-9fd7-d0ab34542500 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:03.789900 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66141de2-597b-49de-9fd7-d0ab34542500 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:03.789900 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66141de2-597b-49de-9fd7-d0ab34542500 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:03.800610 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66141de2-597b-49de-9fd7-d0ab34542500 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:03.802648 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66141de2-597b-49de-9fd7-d0ab34542500 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:03.808539 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:03.819912 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-66141de2-597b-49de-9fd7-d0ab34542500 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 21 20:09:03.819912 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:03.819912 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:03.819912 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:03.819912 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:03.819912 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:03.819912 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:03.819912 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:03.819912 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:03.819912 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:03.819912 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:03.819912 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:03.819912 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 20:09:03.819912 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 20:09:03.819912 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 20:09:03.819912 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 20:09:03.820911 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:03.820911 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:03.820911 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 20:09:03.820911 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:09:03.820911 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 20:09:03.820911 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:09:03.820911 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:03.820911 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:03.820911 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:03.820911 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:03.820911 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:03.820911 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:03.820911 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:03.820911 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:03.820911 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:03.820911 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:03.820911 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:03.820911 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:03.821913 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:03.821913 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:03.821913 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 20:09:03.821913 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 20:09:03.821913 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 20:09:03.821913 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 20:09:03.821913 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 20:09:03.821913 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 20:09:03.821913 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 21 20:09:03.821913 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:03.826356 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 350/687] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jun 21 20:09:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:03.827704 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66141de2-597b-49de-9fd7-d0ab34542500 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:03.851671 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2449fe91-0755-4751-bf33-d17458102e98 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:03.897666 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083e41a-0fc8-4106-ab57-4060d86b45f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:03.898599 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083e41a-0fc8-4106-ab57-4060d86b45f9 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:03.899268 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083e41a-0fc8-4106-ab57-4060d86b45f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:03.899554 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083e41a-0fc8-4106-ab57-4060d86b45f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:03.915327 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e083e41a-0fc8-4106-ab57-4060d86b45f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:03.916880 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e083e41a-0fc8-4106-ab57-4060d86b45f9 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:03.938815 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-e083e41a-0fc8-4106-ab57-4060d86b45f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:03.938815 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:03.938815 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:03.938815 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:03.938815 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:03.938815 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:03.938815 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:03.938815 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:03.938815 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:03.938815 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:03.938815 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:03.938815 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:03.938815 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:09:03.938815 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:09:03.938815 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:09:03.939729 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:09:03.939729 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:03.939729 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:03.939729 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:03.939729 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:03.939729 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:03.939729 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:03.939729 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:03.939729 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:03.939729 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:03.939729 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:03.939729 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:03.939729 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:03.939729 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:03.939729 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:03.939729 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:03.939729 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:03.940646 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:09:03.940646 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:09:03.940646 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:03.940646 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:03.940646 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 338/688] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:09:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:09:03.947175 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083e41a-0fc8-4106-ab57-4060d86b45f9 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:03.956283 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66141de2-597b-49de-9fd7-d0ab34542500 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:03.998037 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9def68-0a5e-4b70-af80-95919b6455c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:03.998810 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9def68-0a5e-4b70-af80-95919b6455c4 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:03.999212 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9def68-0a5e-4b70-af80-95919b6455c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:03.999507 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9def68-0a5e-4b70-af80-95919b6455c4 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:04.000372 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9def68-0a5e-4b70-af80-95919b6455c4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:04.000688 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9def68-0a5e-4b70-af80-95919b6455c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:04.002178 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9def68-0a5e-4b70-af80-95919b6455c4 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:04.005799 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:04.023298 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 351/689] 10.222.0.15 () {56 vars in 1135 bytes} [Tue Jun 21 20:09:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:04.028713 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9def68-0a5e-4b70-af80-95919b6455c4 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:04.113787 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083e41a-0fc8-4106-ab57-4060d86b45f9 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:04.145136 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:04.152322 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68834927-53af-4bef-a2be-44c13dacadd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:04.152923 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68834927-53af-4bef-a2be-44c13dacadd5 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:04.153217 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68834927-53af-4bef-a2be-44c13dacadd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:04.153501 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68834927-53af-4bef-a2be-44c13dacadd5 None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:04.154297 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68834927-53af-4bef-a2be-44c13dacadd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:04.154615 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68834927-53af-4bef-a2be-44c13dacadd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:04.156439 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68834927-53af-4bef-a2be-44c13dacadd5 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:04.169895 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 339/690] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:09:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:09:04.176957 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68834927-53af-4bef-a2be-44c13dacadd5 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:04.232767 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9def68-0a5e-4b70-af80-95919b6455c4 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:04.312966 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74484337-25eb-4d7d-9bd0-fb08be97eede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:04.313632 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74484337-25eb-4d7d-9bd0-fb08be97eede None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:04.313921 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74484337-25eb-4d7d-9bd0-fb08be97eede None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:04.314202 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74484337-25eb-4d7d-9bd0-fb08be97eede None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:04.349640 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68834927-53af-4bef-a2be-44c13dacadd5 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:04.392304 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111b512-3a66-4453-9832-72a57097e6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:04.392304 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111b512-3a66-4453-9832-72a57097e6e8 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:04.392304 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111b512-3a66-4453-9832-72a57097e6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:04.392304 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111b512-3a66-4453-9832-72a57097e6e8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:04.397273 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1111b512-3a66-4453-9832-72a57097e6e8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:04.398725 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1111b512-3a66-4453-9832-72a57097e6e8 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:04.414148 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-1111b512-3a66-4453-9832-72a57097e6e8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 20:09:04.414148 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:04.414148 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:04.414148 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:04.414148 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:04.414148 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:04.414148 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:04.414148 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:04.414148 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:04.414148 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:04.414148 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:04.414148 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:04.414148 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 20:09:04.414148 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 20:09:04.414148 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 20:09:04.414148 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 20:09:04.415088 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:04.415088 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:04.415088 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 20:09:04.415088 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:09:04.415088 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 20:09:04.415088 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:09:04.415088 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:04.415088 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:04.415088 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:04.415088 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:04.415088 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:04.415088 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:04.415088 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:04.415088 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:04.415088 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:04.415088 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:04.415088 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:04.415088 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:04.416173 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:04.416173 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:04.416173 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 20:09:04.416173 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 20:09:04.416173 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 20:09:04.416173 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 20:09:04.416173 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 20:09:04.416173 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 20:09:04.416173 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 20:09:04.416173 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:04.416173 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 340/691] 10.222.0.15 () {56 vars in 1093 bytes} [Tue Jun 21 20:09:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:04.427937 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111b512-3a66-4453-9832-72a57097e6e8 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:04.435464 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:04.450414 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74484337-25eb-4d7d-9bd0-fb08be97eede None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:04.452271 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74484337-25eb-4d7d-9bd0-fb08be97eede None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:04.478258 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:04.535318 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111b512-3a66-4453-9832-72a57097e6e8 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:04.573593 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca834867-9d15-4e1b-9f80-eeabb0bb77f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:04.574671 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca834867-9d15-4e1b-9f80-eeabb0bb77f4 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:04.575166 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca834867-9d15-4e1b-9f80-eeabb0bb77f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:04.575749 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca834867-9d15-4e1b-9f80-eeabb0bb77f4 None admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:04.576947 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca834867-9d15-4e1b-9f80-eeabb0bb77f4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:04.577481 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca834867-9d15-4e1b-9f80-eeabb0bb77f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:04.579123 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca834867-9d15-4e1b-9f80-eeabb0bb77f4 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:04.599412 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 341/692] 10.222.0.15 () {56 vars in 1133 bytes} [Tue Jun 21 20:09:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:04.606087 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca834867-9d15-4e1b-9f80-eeabb0bb77f4 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:04.628277 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 352/693] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:09:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 20:09:04.634565 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74484337-25eb-4d7d-9bd0-fb08be97eede None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:04.801303 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca834867-9d15-4e1b-9f80-eeabb0bb77f4 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:04.815034 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:04.821378 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74484337-25eb-4d7d-9bd0-fb08be97eede None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:04.824230 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:04.873133 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606a65b7-9450-4f27-b374-e85dddca3cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:04.873796 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a65b7-9450-4f27-b374-e85dddca3cef None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:04.874088 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a65b7-9450-4f27-b374-e85dddca3cef None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:04.874364 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a65b7-9450-4f27-b374-e85dddca3cef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:04.889887 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629a653-c47d-4b2c-8bce-9edee134f3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:04.890697 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629a653-c47d-4b2c-8bce-9edee134f3b1 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:04.890986 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629a653-c47d-4b2c-8bce-9edee134f3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:04.891267 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629a653-c47d-4b2c-8bce-9edee134f3b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:04.908880 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629a653-c47d-4b2c-8bce-9edee134f3b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:04.910357 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629a653-c47d-4b2c-8bce-9edee134f3b1 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:04.941063 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-a629a653-c47d-4b2c-8bce-9edee134f3b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:04.941063 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:04.941063 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:04.941063 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:04.941063 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:04.941063 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:04.941063 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:04.941063 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:04.941063 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:04.941063 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:04.941063 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:04.941063 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:04.941063 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:09:04.941063 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:09:04.941063 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:09:04.942045 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:09:04.942045 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:04.942045 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:04.942045 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:04.942045 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:04.942045 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:04.942045 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:04.942045 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:04.942045 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:04.942045 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:04.942045 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:04.942045 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:04.942045 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:04.942045 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:04.942045 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:04.942045 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:04.942045 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:04.943003 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:09:04.943003 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:09:04.943003 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:04.943003 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:04.943003 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 353/694] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:09:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:09:04.952365 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629a653-c47d-4b2c-8bce-9edee134f3b1 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:05.021036 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606a65b7-9450-4f27-b374-e85dddca3cef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:05.022517 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606a65b7-9450-4f27-b374-e85dddca3cef None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:05.074436 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629a653-c47d-4b2c-8bce-9edee134f3b1 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:05.121985 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa9cff-ff58-4158-a95b-a4f69530db57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:05.122678 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa9cff-ff58-4158-a95b-a4f69530db57 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:05.122973 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa9cff-ff58-4158-a95b-a4f69530db57 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:05.123261 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa9cff-ff58-4158-a95b-a4f69530db57 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:05.124155 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aa9cff-ff58-4158-a95b-a4f69530db57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:05.124474 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aa9cff-ff58-4158-a95b-a4f69530db57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:05.125987 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aa9cff-ff58-4158-a95b-a4f69530db57 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:05.138926 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 354/695] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:09:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:09:05.140560 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e7d4e-2c23-4108-9509-50f233aab69f None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:05.140857 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e7d4e-2c23-4108-9509-50f233aab69f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:05.141144 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e7d4e-2c23-4108-9509-50f233aab69f None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:05.147028 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 355/696] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:09:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:09:05.147910 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e7d4e-2c23-4108-9509-50f233aab69f None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:05.157903 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:05.164058 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 342/697] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:09:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 20:09:05.165869 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a757e994-7c7e-4e85-bfa2-fdd8f7f3c842 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:05.166164 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a757e994-7c7e-4e85-bfa2-fdd8f7f3c842 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:05.166701 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a757e994-7c7e-4e85-bfa2-fdd8f7f3c842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:05.184733 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-a757e994-7c7e-4e85-bfa2-fdd8f7f3c842 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:09:05.186126 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-a757e994-7c7e-4e85-bfa2-fdd8f7f3c842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:09:05.188084 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:05.265633 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e7d4e-2c23-4108-9509-50f233aab69f None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:05.272924 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 343/698] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:09:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:09:05.274249 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a757e994-7c7e-4e85-bfa2-fdd8f7f3c842 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:05.322230 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a338e3-e5ee-43d8-865b-759972652e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:05.323038 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a338e3-e5ee-43d8-865b-759972652e80 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:05.323328 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a338e3-e5ee-43d8-865b-759972652e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:05.323616 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a338e3-e5ee-43d8-865b-759972652e80 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:05.330667 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a338e3-e5ee-43d8-865b-759972652e80 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:05.332192 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a338e3-e5ee-43d8-865b-759972652e80 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:05.347414 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-73a338e3-e5ee-43d8-865b-759972652e80 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:09:05.347414 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:05.347414 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:05.347414 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:05.347414 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:05.347414 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:05.347414 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:05.347414 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:05.347414 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:05.347414 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:05.347414 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:05.347414 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:05.347414 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 20:09:05.347414 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 20:09:05.347414 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 20:09:05.350134 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 20:09:05.350134 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:05.350134 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:05.350134 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:05.350134 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:05.350134 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:05.350134 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:05.350134 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:05.350134 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:05.350134 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:05.350134 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:05.350134 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:05.350134 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:05.350134 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:05.350134 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:05.350134 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:05.350134 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:05.352408 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 20:09:05.352408 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 20:09:05.352408 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 20:09:05.352408 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 20:09:05.352408 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 20:09:05.352408 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 20:09:05.352408 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:09:05.352408 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:05.352408 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 356/699] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jun 21 20:09:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:05.352408 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a338e3-e5ee-43d8-865b-759972652e80 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:05.393265 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a757e994-7c7e-4e85-bfa2-fdd8f7f3c842 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:05.421930 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:05.442924 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5358aa-bc57-439f-a9a8-00b975ba23d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:05.444699 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5358aa-bc57-439f-a9a8-00b975ba23d6 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:05.445203 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5358aa-bc57-439f-a9a8-00b975ba23d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:05.445695 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5358aa-bc57-439f-a9a8-00b975ba23d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:05.455515 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:05.460903 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a338e3-e5ee-43d8-865b-759972652e80 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:05.462053 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5358aa-bc57-439f-a9a8-00b975ba23d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:05.464981 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5358aa-bc57-439f-a9a8-00b975ba23d6 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:05.487128 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-aa5358aa-bc57-439f-a9a8-00b975ba23d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:05.487128 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:05.487128 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:05.487128 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:05.487128 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:05.487128 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:05.487128 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:05.487128 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:05.487128 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:05.487128 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:05.487128 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:05.487128 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:05.487128 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:09:05.487128 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:09:05.487128 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:09:05.488110 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:09:05.488110 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:05.488110 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:05.488110 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:05.488110 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:05.488110 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:05.488110 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:05.488110 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:05.488110 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:05.488110 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:05.488110 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:05.488110 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:05.488110 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:05.488110 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:05.488110 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:05.488110 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:05.488110 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:05.489005 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:09:05.489005 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:09:05.489005 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:05.489005 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:05.489784 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 344/700] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:09:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:05.492545 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5358aa-bc57-439f-a9a8-00b975ba23d6 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:05.504026 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d92f9f-f820-4212-8144-e063781875a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:05.504857 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d92f9f-f820-4212-8144-e063781875a0 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:05.505678 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d92f9f-f820-4212-8144-e063781875a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:05.505960 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d92f9f-f820-4212-8144-e063781875a0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:05.506628 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d92f9f-f820-4212-8144-e063781875a0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:05.508142 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d92f9f-f820-4212-8144-e063781875a0 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:05.524445 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-f8d92f9f-f820-4212-8144-e063781875a0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 20:09:05.524445 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:05.524445 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 20:09:05.524445 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 20:09:05.524445 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 20:09:05.524445 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 20:09:05.524445 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 20:09:05.524445 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 20:09:05.524445 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 20:09:05.524445 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:05.524445 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 20:09:05.524445 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:05.524445 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:05.524445 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:05.524445 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:05.524445 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:05.525430 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:05.525430 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:05.525430 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:05.525430 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:05.525430 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:05.525430 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:05.525430 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:05.525430 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 20:09:05.525430 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 20:09:05.525430 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 20:09:05.525430 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 20:09:05.525430 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:05.525430 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:05.525430 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:05.525430 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:05.525430 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:05.526365 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:05.526365 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:05.526365 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:05.526365 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:05.526365 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:05.526365 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:05.526365 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:05.526365 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:05.526365 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:05.526365 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:05.526365 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:05.526365 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 20:09:05.526365 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 20:09:05.526365 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 20:09:05.526365 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:05.530514 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 357/701] 10.222.0.15 () {56 vars in 1129 bytes} [Tue Jun 21 20:09:05 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:05.531553 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d92f9f-f820-4212-8144-e063781875a0 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:05.627798 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5358aa-bc57-439f-a9a8-00b975ba23d6 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:05.642659 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d92f9f-f820-4212-8144-e063781875a0 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:05.674839 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:05.677865 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e1666-54f8-4c13-90fb-a27bcc395a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:05.678673 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e1666-54f8-4c13-90fb-a27bcc395a87 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:05.678960 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e1666-54f8-4c13-90fb-a27bcc395a87 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:05.679281 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e1666-54f8-4c13-90fb-a27bcc395a87 None admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:05.680159 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0e1666-54f8-4c13-90fb-a27bcc395a87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:05.680486 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0e1666-54f8-4c13-90fb-a27bcc395a87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:05.681940 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0e1666-54f8-4c13-90fb-a27bcc395a87 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:05.686304 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5a655-7a99-497d-bd87-cb93a475973a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:05.687233 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5a655-7a99-497d-bd87-cb93a475973a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:05.687725 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5a655-7a99-497d-bd87-cb93a475973a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:05.688231 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5a655-7a99-497d-bd87-cb93a475973a None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:05.689638 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e5a655-7a99-497d-bd87-cb93a475973a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:05.690151 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e5a655-7a99-497d-bd87-cb93a475973a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:05.692559 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e5a655-7a99-497d-bd87-cb93a475973a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:05.694672 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 345/702] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jun 21 20:09:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:05.695571 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e1666-54f8-4c13-90fb-a27bcc395a87 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:05.707980 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 358/703] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:09:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:05.709376 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5a655-7a99-497d-bd87-cb93a475973a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:05.757954 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:05.823341 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e1666-54f8-4c13-90fb-a27bcc395a87 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:05.829455 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5a655-7a99-497d-bd87-cb93a475973a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:05.866818 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe5e4d-abed-4061-8b5f-2e31a95263ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:05.867625 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe5e4d-abed-4061-8b5f-2e31a95263ee None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:05.868078 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe5e4d-abed-4061-8b5f-2e31a95263ee None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:05.868557 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe5e4d-abed-4061-8b5f-2e31a95263ee None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:05.869361 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efe5e4d-abed-4061-8b5f-2e31a95263ee None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:05.869742 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efe5e4d-abed-4061-8b5f-2e31a95263ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:05.871278 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efe5e4d-abed-4061-8b5f-2e31a95263ee None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:05.876324 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 346/704] 10.222.0.15 () {56 vars in 1124 bytes} [Tue Jun 21 20:09:05 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:05.878076 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88784926-47fd-4201-84a2-6593c22d1f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:05.878886 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88784926-47fd-4201-84a2-6593c22d1f10 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:05.879297 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88784926-47fd-4201-84a2-6593c22d1f10 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:05.879703 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88784926-47fd-4201-84a2-6593c22d1f10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:05.880736 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88784926-47fd-4201-84a2-6593c22d1f10 None admin] RBAC: Adding query filter params (role.id=a4929ef60a294190b2d59e8d61e05063, scope.project.id=4dcb71ef7b6e49148edd61a1eb8da7bb, user.id=038537bd12174154ba259e097b97b8bd) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:05.881179 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88784926-47fd-4201-84a2-6593c22d1f10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:05.881872 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe5e4d-abed-4061-8b5f-2e31a95263ee None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:05.882901 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88784926-47fd-4201-84a2-6593c22d1f10 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:05.890910 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 359/705] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jun 21 20:09:05 2022] GET /identity/v3/role_assignments?user.id=038537bd12174154ba259e097b97b8bd&scope.project.id=4dcb71ef7b6e49148edd61a1eb8da7bb&role.id=a4929ef60a294190b2d59e8d61e05063 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:05.892427 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88784926-47fd-4201-84a2-6593c22d1f10 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:06.010453 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe5e4d-abed-4061-8b5f-2e31a95263ee None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:06.027299 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:06.028506 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:06.039906 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88784926-47fd-4201-84a2-6593c22d1f10 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:06.054954 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf54fabd-dd51-4adb-a371-987cf545fefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:06.055936 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54fabd-dd51-4adb-a371-987cf545fefd None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:06.056235 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54fabd-dd51-4adb-a371-987cf545fefd None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:06.056518 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54fabd-dd51-4adb-a371-987cf545fefd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:06.065235 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf54fabd-dd51-4adb-a371-987cf545fefd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:06.066548 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf54fabd-dd51-4adb-a371-987cf545fefd None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:06.080021 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e5786-acf0-46d2-a331-8a95a00020f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:06.080906 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e5786-acf0-46d2-a331-8a95a00020f6 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:06.081336 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e5786-acf0-46d2-a331-8a95a00020f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:06.081773 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e5786-acf0-46d2-a331-8a95a00020f6 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:06.082633 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9e5786-acf0-46d2-a331-8a95a00020f6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:06.083617 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9e5786-acf0-46d2-a331-8a95a00020f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:06.084331 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-bf54fabd-dd51-4adb-a371-987cf545fefd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:09:06.084331 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:06.084331 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:06.084331 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:06.084331 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:06.084331 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:06.084331 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:06.084331 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:06.084331 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:06.084331 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:06.084331 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:06.084331 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:06.084331 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 20:09:06.084331 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 20:09:06.084331 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 20:09:06.085336 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 20:09:06.085336 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:06.085336 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:06.085336 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:06.085336 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:06.085336 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:06.085336 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:06.085336 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:06.085336 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:06.085336 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:06.085336 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:06.085336 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:06.085336 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:06.085336 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:06.085336 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:06.085336 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:06.085336 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:06.086409 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 20:09:06.086409 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 20:09:06.086409 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 20:09:06.086409 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 20:09:06.086409 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 20:09:06.086409 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 20:09:06.086409 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:09:06.086409 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:06.086409 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 347/706] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jun 21 20:09:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:06.087218 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e403394-0854-4fd7-b0c4-b3af0877e5b0 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:06.087516 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e403394-0854-4fd7-b0c4-b3af0877e5b0 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:06.087803 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e403394-0854-4fd7-b0c4-b3af0877e5b0 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:06.088360 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9e5786-acf0-46d2-a331-8a95a00020f6 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:06.090154 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 348/707] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:09:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:09:06.094772 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 360/708] 10.222.0.15 () {56 vars in 1124 bytes} [Tue Jun 21 20:09:05 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:06.095184 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad490c-940d-4e53-98ab-cb3832cfcd70 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:06.095483 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad490c-940d-4e53-98ab-cb3832cfcd70 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:06.095764 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad490c-940d-4e53-98ab-cb3832cfcd70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:06.096453 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e5786-acf0-46d2-a331-8a95a00020f6 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:06.116094 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-4cad490c-940d-4e53-98ab-cb3832cfcd70 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:09:06.117854 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-4cad490c-940d-4e53-98ab-cb3832cfcd70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:09:06.213157 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 349/709] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:09:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:09:06.215356 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed507d-d968-4bf9-87a1-67c803efbdc8 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:06.215721 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed507d-d968-4bf9-87a1-67c803efbdc8 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:06.220329 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed507d-d968-4bf9-87a1-67c803efbdc8 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:06.222189 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 350/710] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:09:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:09:06.228051 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a41d7-f3f4-4ed6-be34-40f1e2c8704e None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:06.228404 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a41d7-f3f4-4ed6-be34-40f1e2c8704e None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:06.228767 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a41d7-f3f4-4ed6-be34-40f1e2c8704e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:06.230659 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e5786-acf0-46d2-a331-8a95a00020f6 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:06.251099 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:06.264373 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-9e3a41d7-f3f4-4ed6-be34-40f1e2c8704e None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:09:06.264562 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-9e3a41d7-f3f4-4ed6-be34-40f1e2c8704e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:09:06.276064 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c42a8c-2044-49e1-b935-1caec9c1a290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:06.277347 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c42a8c-2044-49e1-b935-1caec9c1a290 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:06.277778 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c42a8c-2044-49e1-b935-1caec9c1a290 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:06.278210 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c42a8c-2044-49e1-b935-1caec9c1a290 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:06.279191 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c42a8c-2044-49e1-b935-1caec9c1a290 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:06.279682 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c42a8c-2044-49e1-b935-1caec9c1a290 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:06.281352 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c42a8c-2044-49e1-b935-1caec9c1a290 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:06.295949 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 361/711] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jun 21 20:09:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:09:06.297190 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c42a8c-2044-49e1-b935-1caec9c1a290 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:06.353897 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 351/712] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:09:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 20:09:06.354778 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a41d7-f3f4-4ed6-be34-40f1e2c8704e None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:06.394628 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:06.436239 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c42a8c-2044-49e1-b935-1caec9c1a290 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:06.476161 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db8bbd-78a1-4a7f-acc8-f4ce0c3eb5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:06.476887 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db8bbd-78a1-4a7f-acc8-f4ce0c3eb5ef None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:06.477175 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db8bbd-78a1-4a7f-acc8-f4ce0c3eb5ef None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:06.477456 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db8bbd-78a1-4a7f-acc8-f4ce0c3eb5ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:06.486282 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a41d7-f3f4-4ed6-be34-40f1e2c8704e None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:06.490082 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6db8bbd-78a1-4a7f-acc8-f4ce0c3eb5ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:06.491552 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6db8bbd-78a1-4a7f-acc8-f4ce0c3eb5ef None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:06.511096 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-c6db8bbd-78a1-4a7f-acc8-f4ce0c3eb5ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:06.511096 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:06.511096 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:06.511096 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:06.511096 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:06.511096 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:06.511096 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:06.511096 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:06.511096 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:06.511096 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:06.511096 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:06.511096 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:06.511096 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:09:06.511096 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:09:06.511096 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:09:06.512090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:09:06.512090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:06.512090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:06.512090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:06.512090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:06.512090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:06.512090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:06.512090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:06.512090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:06.512090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:06.512090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:06.512090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:06.512090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:06.512090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:06.512090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:06.512090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:06.512090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:06.513451 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:09:06.513451 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:09:06.513451 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:06.513451 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:06.513451 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 362/713] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:09:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:06.513824 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db8bbd-78a1-4a7f-acc8-f4ce0c3eb5ef None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:06.532655 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d028b-ebef-4a35-91f9-ba990917b5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:06.533788 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d028b-ebef-4a35-91f9-ba990917b5b4 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:06.534090 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d028b-ebef-4a35-91f9-ba990917b5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:06.534377 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d028b-ebef-4a35-91f9-ba990917b5b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:06.535507 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d028b-ebef-4a35-91f9-ba990917b5b4 None admin] RBAC: Adding query filter params (role.id=1f5332f48d9e4c2aac866d0d546c94d5, scope.project.id=4dcb71ef7b6e49148edd61a1eb8da7bb, user.id=3918fe05c8634bc39f3e295374701465) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:06.536681 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d028b-ebef-4a35-91f9-ba990917b5b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:06.538514 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d028b-ebef-4a35-91f9-ba990917b5b4 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:06.548088 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 352/714] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jun 21 20:09:06 2022] GET /identity/v3/role_assignments?user.id=3918fe05c8634bc39f3e295374701465&scope.project.id=4dcb71ef7b6e49148edd61a1eb8da7bb&role.id=1f5332f48d9e4c2aac866d0d546c94d5 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:06.548976 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d028b-ebef-4a35-91f9-ba990917b5b4 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:06.558714 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:06.707003 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:06.712185 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d028b-ebef-4a35-91f9-ba990917b5b4 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:06.742143 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db8bbd-78a1-4a7f-acc8-f4ce0c3eb5ef None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:06.759071 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d556810c-0fd0-4bd1-87f8-9b8998e9110a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:06.759754 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556810c-0fd0-4bd1-87f8-9b8998e9110a None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:06.760072 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556810c-0fd0-4bd1-87f8-9b8998e9110a None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:06.760356 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556810c-0fd0-4bd1-87f8-9b8998e9110a None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:06.761096 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d556810c-0fd0-4bd1-87f8-9b8998e9110a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:06.761407 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d556810c-0fd0-4bd1-87f8-9b8998e9110a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:06.762788 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d556810c-0fd0-4bd1-87f8-9b8998e9110a None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:06.794454 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 353/715] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:09:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:06.800158 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d556810c-0fd0-4bd1-87f8-9b8998e9110a None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:06.813326 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd1411-58a9-4628-a736-53a1bb8489a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:06.814520 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd1411-58a9-4628-a736-53a1bb8489a1 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:06.815014 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd1411-58a9-4628-a736-53a1bb8489a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:06.815554 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd1411-58a9-4628-a736-53a1bb8489a1 None admin] PATH_INFO: `/v3/services/network` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:06.816456 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bd1411-58a9-4628-a736-53a1bb8489a1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:06.818140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bd1411-58a9-4628-a736-53a1bb8489a1 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:06.839035 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-71bd1411-58a9-4628-a736-53a1bb8489a1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 20:09:06.839035 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:06.839035 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 20:09:06.839035 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 20:09:06.839035 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 20:09:06.839035 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 20:09:06.839035 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 20:09:06.839035 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 20:09:06.839035 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 20:09:06.839035 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:06.839035 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 20:09:06.839035 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:06.839035 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:06.839035 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:06.839035 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:06.839035 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:06.839035 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:06.840140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:06.840140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:06.840140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:06.840140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:06.840140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:06.840140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:06.840140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 20:09:06.840140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 20:09:06.840140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 20:09:06.840140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 20:09:06.840140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:06.840140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:06.840140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:06.840140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:06.840140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:06.840140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:06.841050 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:06.841050 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:06.841050 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:06.841050 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:06.841050 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:06.841050 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:06.841050 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:06.841050 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:06.841050 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:06.841050 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:06.841050 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 20:09:06.841050 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 20:09:06.841050 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 20:09:06.841050 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:06.842726 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 363/716] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jun 21 20:09:06 2022] GET /identity/v3/services/network => generated 88 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:06.848248 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd1411-58a9-4628-a736-53a1bb8489a1 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:06.960199 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d556810c-0fd0-4bd1-87f8-9b8998e9110a None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:07.006387 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcfe91a-6ff3-4b36-979f-3afb2d7d3e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:07.007412 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfe91a-6ff3-4b36-979f-3afb2d7d3e67 None admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:07.007945 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfe91a-6ff3-4b36-979f-3afb2d7d3e67 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:07.008508 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfe91a-6ff3-4b36-979f-3afb2d7d3e67 None admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:07.009449 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcfe91a-6ff3-4b36-979f-3afb2d7d3e67 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:07.011617 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcfe91a-6ff3-4b36-979f-3afb2d7d3e67 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:07.036102 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 354/717] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Jun 21 20:09:06 2022] POST /identity/v3/users => generated 254 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:09:07.072610 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:07.087035 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd1411-58a9-4628-a736-53a1bb8489a1 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:07.152746 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba0c0e-8950-4300-92e1-b0b68fafa09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:07.153448 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba0c0e-8950-4300-92e1-b0b68fafa09c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:07.153736 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba0c0e-8950-4300-92e1-b0b68fafa09c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:07.154019 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba0c0e-8950-4300-92e1-b0b68fafa09c None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:07.154750 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba0c0e-8950-4300-92e1-b0b68fafa09c None admin] RBAC: Adding query filter params (name=network) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:07.155063 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba0c0e-8950-4300-92e1-b0b68fafa09c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:07.156494 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba0c0e-8950-4300-92e1-b0b68fafa09c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:07.161798 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 364/718] 10.222.0.15 () {56 vars in 1112 bytes} [Tue Jun 21 20:09:06 2022] GET /identity/v3/services?name=network => generated 124 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:07.167372 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcfe91a-6ff3-4b36-979f-3afb2d7d3e67 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:07.189001 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:07.305311 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcfe91a-6ff3-4b36-979f-3afb2d7d3e67 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:07.341494 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978400fb-cf23-44d4-8093-ea6ee446b724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:07.342175 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978400fb-cf23-44d4-8093-ea6ee446b724 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:07.342464 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978400fb-cf23-44d4-8093-ea6ee446b724 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:07.342745 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978400fb-cf23-44d4-8093-ea6ee446b724 None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:07.343467 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978400fb-cf23-44d4-8093-ea6ee446b724 None admin] RBAC: Adding query filter params (type=network) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:07.343783 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978400fb-cf23-44d4-8093-ea6ee446b724 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:07.345200 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978400fb-cf23-44d4-8093-ea6ee446b724 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:07.351422 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 355/719] 10.222.0.15 () {56 vars in 1112 bytes} [Tue Jun 21 20:09:07 2022] GET /identity/v3/services?type=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:08.279137 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22d0c6-7a22-4928-8ded-cc4a9aa32946 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:08.284065 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22d0c6-7a22-4928-8ded-cc4a9aa32946 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:08.284065 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22d0c6-7a22-4928-8ded-cc4a9aa32946 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:08.284065 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 365/720] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:09:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:09:08.287819 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a0259-ead5-441e-9aae-3296d9981dc3 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:08.288148 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a0259-ead5-441e-9aae-3296d9981dc3 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:08.288438 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a0259-ead5-441e-9aae-3296d9981dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:08.317216 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-c15a0259-ead5-441e-9aae-3296d9981dc3 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:09:08.318452 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-c15a0259-ead5-441e-9aae-3296d9981dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:09:08.408013 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 356/721] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:09:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 20:09:08.443240 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22d0c6-7a22-4928-8ded-cc4a9aa32946 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:08.445056 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9080dcc3-ccd5-4fd6-b063-26f4af678419 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:08.445364 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9080dcc3-ccd5-4fd6-b063-26f4af678419 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:08.445653 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9080dcc3-ccd5-4fd6-b063-26f4af678419 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:08.447037 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 357/722] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:09:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 20:09:08.452191 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec50f7a-3975-4cc6-abf0-4d777aa8d80a None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:08.452490 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec50f7a-3975-4cc6-abf0-4d777aa8d80a None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:08.452773 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec50f7a-3975-4cc6-abf0-4d777aa8d80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:08.478129 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-9ec50f7a-3975-4cc6-abf0-4d777aa8d80a None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:09:08.480492 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-9ec50f7a-3975-4cc6-abf0-4d777aa8d80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:09:08.488217 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:08.605746 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 358/723] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:09:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 20:09:08.616565 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22d0c6-7a22-4928-8ded-cc4a9aa32946 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:08.655434 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec50f7a-3975-4cc6-abf0-4d777aa8d80a None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:08.666019 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a1558-439b-4882-bb52-bd3d530c622d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:08.666828 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a1558-439b-4882-bb52-bd3d530c622d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:08.667111 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a1558-439b-4882-bb52-bd3d530c622d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:08.667386 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a1558-439b-4882-bb52-bd3d530c622d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:08.687658 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50a1558-439b-4882-bb52-bd3d530c622d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:09:08.695936 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-f50a1558-439b-4882-bb52-bd3d530c622d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 20:09:08.695936 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:08.695936 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:08.695936 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:08.695936 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:08.695936 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:08.695936 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:08.695936 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:08.695936 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:08.695936 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:08.695936 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:08.695936 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:08.695936 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:09:08.695936 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:09:08.695936 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:09:08.695936 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:09:08.696878 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:09:08.696878 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:09:08.696878 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:09:08.696878 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:09:08.696878 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:08.696878 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:08.696878 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:08.696878 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:08.696878 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:08.696878 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:08.696878 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:08.696878 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:08.696878 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:08.696878 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:08.696878 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:08.696878 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:08.697701 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:08.697701 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:08.697701 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:08.697701 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:08.697701 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:09:08.697701 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:09:08.697701 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:09:08.697701 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:09:08.697701 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:09:08.697701 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:09:08.697701 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 20:09:08.697701 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:08.707565 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 366/724] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jun 21 20:09:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:08.715155 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a1558-439b-4882-bb52-bd3d530c622d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:08.748299 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:08.815005 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec50f7a-3975-4cc6-abf0-4d777aa8d80a None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:08.850271 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e15fed-5f69-443f-b616-e5a2283de2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:08.851265 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e15fed-5f69-443f-b616-e5a2283de2ed None admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:08.851565 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e15fed-5f69-443f-b616-e5a2283de2ed None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:08.851850 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e15fed-5f69-443f-b616-e5a2283de2ed None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:08.855224 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e15fed-5f69-443f-b616-e5a2283de2ed None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:08.855224 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e15fed-5f69-443f-b616-e5a2283de2ed None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:08.876575 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:08.882164 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 359/725] 10.222.0.15 () {60 vars in 1141 bytes} [Tue Jun 21 20:09:08 2022] POST /identity/v3/services => generated 251 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 20:09:08.883617 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90803400-4d51-438c-817c-cdd38745143e None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:08.883904 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90803400-4d51-438c-817c-cdd38745143e None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:08.884213 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90803400-4d51-438c-817c-cdd38745143e None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:08.888932 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 360/726] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:09:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:09:08.905419 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e71aa-7fde-4d7a-a286-5be237715874 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:08.906664 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e71aa-7fde-4d7a-a286-5be237715874 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:08.907137 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e71aa-7fde-4d7a-a286-5be237715874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:08.935955 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a1558-439b-4882-bb52-bd3d530c622d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:08.944965 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-a30e71aa-7fde-4d7a-a286-5be237715874 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:09:08.946506 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-a30e71aa-7fde-4d7a-a286-5be237715874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:09:08.977536 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f90725-5790-4016-b36f-96ae407c82b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:08.978366 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f90725-5790-4016-b36f-96ae407c82b2 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:08.978658 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f90725-5790-4016-b36f-96ae407c82b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:08.978941 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f90725-5790-4016-b36f-96ae407c82b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:08.979713 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f90725-5790-4016-b36f-96ae407c82b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:08.980101 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f90725-5790-4016-b36f-96ae407c82b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:08.981903 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f90725-5790-4016-b36f-96ae407c82b2 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:08.993349 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 367/727] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:09:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:08.998897 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f90725-5790-4016-b36f-96ae407c82b2 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:09.088875 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:09.117085 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f90725-5790-4016-b36f-96ae407c82b2 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:09.132273 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 361/728] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:09:08 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:09:09.154079 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c553e26a-c294-436e-9e23-8d1020c84628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:09.154886 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553e26a-c294-436e-9e23-8d1020c84628 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:09.155179 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553e26a-c294-436e-9e23-8d1020c84628 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:09.155460 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553e26a-c294-436e-9e23-8d1020c84628 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:09.164170 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e71aa-7fde-4d7a-a286-5be237715874 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:09.166732 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c553e26a-c294-436e-9e23-8d1020c84628 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:09.168410 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c553e26a-c294-436e-9e23-8d1020c84628 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:09.193138 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-c553e26a-c294-436e-9e23-8d1020c84628 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:09.193138 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:09.193138 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:09.193138 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:09.193138 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:09.193138 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:09.193138 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:09.193138 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:09.193138 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:09.193138 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:09.193138 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:09.193138 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:09.193138 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:09:09.193138 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:09:09.193138 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:09:09.194071 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:09:09.194071 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:09.194071 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:09.194071 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:09.194071 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:09.194071 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:09.194071 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:09.194071 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:09.194071 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:09.194071 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:09.194071 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:09.194071 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:09.194071 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:09.194071 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:09.194071 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:09.194071 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:09.194071 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:09.194963 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:09:09.194963 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:09:09.194963 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:09.194963 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:09.194963 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 368/729] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:09:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:09.200660 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c553e26a-c294-436e-9e23-8d1020c84628 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:09.289144 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e71aa-7fde-4d7a-a286-5be237715874 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:09.313447 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c553e26a-c294-436e-9e23-8d1020c84628 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:09.320707 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:09.330157 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be328ca2-f684-45c7-88f3-80f07c07e9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:09.331037 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be328ca2-f684-45c7-88f3-80f07c07e9f9 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:09.331255 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be328ca2-f684-45c7-88f3-80f07c07e9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:09.331554 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be328ca2-f684-45c7-88f3-80f07c07e9f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:09.342881 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be328ca2-f684-45c7-88f3-80f07c07e9f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:09:09.343908 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:09.354119 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-be328ca2-f684-45c7-88f3-80f07c07e9f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 20:09:09.354119 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:09.354119 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:09.354119 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:09.354119 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:09.354119 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:09.354119 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:09.354119 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:09.354119 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:09.354119 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:09.354119 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:09.354119 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:09.354119 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:09:09.354119 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:09:09.354119 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:09:09.354119 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:09:09.355084 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:09:09.355084 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:09:09.355084 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:09:09.355084 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:09:09.355084 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:09.355084 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:09.355084 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:09.355084 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:09.355084 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:09.355084 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:09.355084 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:09.355084 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:09.355084 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:09.355084 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:09.355084 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:09.355084 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:09.355910 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:09.355910 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:09.355910 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:09.355910 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:09.355910 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:09:09.355910 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:09:09.355910 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:09:09.355910 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:09:09.355910 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:09:09.355910 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:09:09.355910 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 20:09:09.355910 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:09.355910 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 362/730] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jun 21 20:09:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:09:09.357495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c16870-e907-4113-ae6e-af4daae7a8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:09.358396 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c16870-e907-4113-ae6e-af4daae7a8dc None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:09.358876 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c16870-e907-4113-ae6e-af4daae7a8dc None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:09.359602 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c16870-e907-4113-ae6e-af4daae7a8dc None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:09.360575 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c16870-e907-4113-ae6e-af4daae7a8dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:09.361119 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c16870-e907-4113-ae6e-af4daae7a8dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:09.361784 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be328ca2-f684-45c7-88f3-80f07c07e9f9 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:09.362912 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c16870-e907-4113-ae6e-af4daae7a8dc None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:09.376847 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 369/731] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:09:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:09.383311 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c16870-e907-4113-ae6e-af4daae7a8dc None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:09.500174 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c16870-e907-4113-ae6e-af4daae7a8dc None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:09.537761 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7061d4-6846-4c90-a88a-0012540c0786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:09.538965 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7061d4-6846-4c90-a88a-0012540c0786 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:09.539449 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7061d4-6846-4c90-a88a-0012540c0786 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:09.539999 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7061d4-6846-4c90-a88a-0012540c0786 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:09.547874 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7061d4-6846-4c90-a88a-0012540c0786 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:09.549637 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7061d4-6846-4c90-a88a-0012540c0786 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:09.566205 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-ce7061d4-6846-4c90-a88a-0012540c0786 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 21 20:09:09.566205 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:09.566205 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:09.566205 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:09.566205 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:09.566205 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:09.566205 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:09.566205 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:09.566205 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:09.566205 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:09.566205 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:09.566205 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:09.566205 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 20:09:09.566205 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 20:09:09.566205 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 20:09:09.566205 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 20:09:09.567203 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:09.567203 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:09.567203 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 20:09:09.567203 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:09:09.567203 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 20:09:09.567203 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:09:09.567203 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:09.567203 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:09.567203 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:09.567203 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:09.567203 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:09.567203 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:09.567203 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:09.567203 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:09.567203 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:09.567203 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:09.567203 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:09.567203 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:09.568260 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:09.568260 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:09.568260 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 20:09:09.568260 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 20:09:09.568260 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 20:09:09.568260 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 20:09:09.568260 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 20:09:09.568260 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 20:09:09.568260 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 21 20:09:09.568260 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:09.568786 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be328ca2-f684-45c7-88f3-80f07c07e9f9 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:09.570986 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 370/732] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jun 21 20:09:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:09:09.576102 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7061d4-6846-4c90-a88a-0012540c0786 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:09.634566 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:09.642187 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf38536-06aa-4be1-baef-d61068410568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:09.644294 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf38536-06aa-4be1-baef-d61068410568 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:09.644294 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf38536-06aa-4be1-baef-d61068410568 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:09.644294 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf38536-06aa-4be1-baef-d61068410568 None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:09.646756 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf38536-06aa-4be1-baef-d61068410568 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:09.647137 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf38536-06aa-4be1-baef-d61068410568 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:09.648638 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf38536-06aa-4be1-baef-d61068410568 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:09.667484 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 363/733] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:09:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:09.673119 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf38536-06aa-4be1-baef-d61068410568 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:09.691948 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7061d4-6846-4c90-a88a-0012540c0786 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:09.728982 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560bda0a-5b4a-46ee-bc5c-5069b4608993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:09.730099 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bda0a-5b4a-46ee-bc5c-5069b4608993 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:09.730583 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bda0a-5b4a-46ee-bc5c-5069b4608993 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:09.731168 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bda0a-5b4a-46ee-bc5c-5069b4608993 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:09.732408 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560bda0a-5b4a-46ee-bc5c-5069b4608993 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:09.732930 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560bda0a-5b4a-46ee-bc5c-5069b4608993 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:09.734902 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560bda0a-5b4a-46ee-bc5c-5069b4608993 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:09.753844 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 371/734] 10.222.0.15 () {56 vars in 1135 bytes} [Tue Jun 21 20:09:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:09.765118 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560bda0a-5b4a-46ee-bc5c-5069b4608993 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:09.780270 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:09.860193 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf38536-06aa-4be1-baef-d61068410568 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:09.920893 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff5289-2f01-4d65-a7b4-332f2f622a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:09.921621 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff5289-2f01-4d65-a7b4-332f2f622a32 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:09.921910 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff5289-2f01-4d65-a7b4-332f2f622a32 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:09.922193 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff5289-2f01-4d65-a7b4-332f2f622a32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:09.932601 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560bda0a-5b4a-46ee-bc5c-5069b4608993 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:09.933515 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff5289-2f01-4d65-a7b4-332f2f622a32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:09.934976 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff5289-2f01-4d65-a7b4-332f2f622a32 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:09.940523 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:09.953952 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-cdff5289-2f01-4d65-a7b4-332f2f622a32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:09.953952 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:09.953952 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:09.953952 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:09.953952 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:09.953952 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:09.953952 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:09.953952 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:09.953952 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:09.953952 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:09.953952 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:09.953952 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:09.953952 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:09:09.953952 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:09:09.953952 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:09:09.954869 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:09:09.954869 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:09.954869 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:09.954869 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:09.954869 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:09.954869 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:09.954869 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:09.954869 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:09.954869 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:09.954869 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:09.954869 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:09.954869 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:09.954869 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:09.954869 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:09.954869 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:09.954869 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:09.954869 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:09.955788 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:09:09.955788 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:09:09.955788 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:09.955788 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:09.956225 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 364/735] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:09:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:09:09.957673 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980cb796-4c51-4c06-9d59-717d5b762aeb None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:09.958606 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980cb796-4c51-4c06-9d59-717d5b762aeb None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:09.958890 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980cb796-4c51-4c06-9d59-717d5b762aeb None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:09.960543 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 365/736] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:09:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:09:09.961855 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9c0e7-623b-4da2-aa90-0e12bd02f313 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:09.962145 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9c0e7-623b-4da2-aa90-0e12bd02f313 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:09.962427 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9c0e7-623b-4da2-aa90-0e12bd02f313 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:09.963905 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 366/737] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:09:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:09:09.968430 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9c0e7-623b-4da2-aa90-0e12bd02f313 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:09.973794 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3bc29f-4d90-4f4a-a8d4-e3d0842aba11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:09.974454 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bc29f-4d90-4f4a-a8d4-e3d0842aba11 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:09.974750 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bc29f-4d90-4f4a-a8d4-e3d0842aba11 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:09.975033 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bc29f-4d90-4f4a-a8d4-e3d0842aba11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:10.049164 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3bc29f-4d90-4f4a-a8d4-e3d0842aba11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:10.050620 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3bc29f-4d90-4f4a-a8d4-e3d0842aba11 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:10.077315 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9c0e7-623b-4da2-aa90-0e12bd02f313 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:10.079243 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:10.114371 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f00b03f-60dc-4bd4-a571-31c239923f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:10.115036 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00b03f-60dc-4bd4-a571-31c239923f48 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:10.115323 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00b03f-60dc-4bd4-a571-31c239923f48 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:10.115603 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00b03f-60dc-4bd4-a571-31c239923f48 None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:10.116361 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f00b03f-60dc-4bd4-a571-31c239923f48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:10.116672 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f00b03f-60dc-4bd4-a571-31c239923f48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:10.118041 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f00b03f-60dc-4bd4-a571-31c239923f48 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:10.135347 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 367/738] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:09:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:10.135347 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a689c26-2b86-4448-a114-8b3fd91ec7fc None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:10.135347 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a689c26-2b86-4448-a114-8b3fd91ec7fc None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:10.135347 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a689c26-2b86-4448-a114-8b3fd91ec7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:10.149345 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-2a689c26-2b86-4448-a114-8b3fd91ec7fc None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:09:10.150533 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-2a689c26-2b86-4448-a114-8b3fd91ec7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:09:10.165218 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 372/739] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:09:09 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 21 20:09:10.165218 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f5535-5f67-4f83-be33-6c269a3d0c83 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:10.165218 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f5535-5f67-4f83-be33-6c269a3d0c83 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:10.165218 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f5535-5f67-4f83-be33-6c269a3d0c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:10.172922 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:10.180125 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e24f5535-5f67-4f83-be33-6c269a3d0c83 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:09:10.181389 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e24f5535-5f67-4f83-be33-6c269a3d0c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:09:10.225062 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 368/740] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:09:10 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:09:10.225734 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a689c26-2b86-4448-a114-8b3fd91ec7fc None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:10.269327 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 373/741] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:09:10 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 20:09:10.271428 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f5535-5f67-4f83-be33-6c269a3d0c83 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:10.320151 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:10.330010 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a689c26-2b86-4448-a114-8b3fd91ec7fc None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:10.366630 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62048a08-ff5c-499d-804a-ccb6dd585798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:10.367431 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62048a08-ff5c-499d-804a-ccb6dd585798 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:10.367718 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62048a08-ff5c-499d-804a-ccb6dd585798 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:10.368027 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62048a08-ff5c-499d-804a-ccb6dd585798 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:10.375356 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62048a08-ff5c-499d-804a-ccb6dd585798 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:10.376903 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62048a08-ff5c-499d-804a-ccb6dd585798 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:10.391874 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-62048a08-ff5c-499d-804a-ccb6dd585798 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 20:09:10.391874 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:10.391874 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:10.391874 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:10.391874 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:10.391874 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:10.391874 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:10.391874 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:10.391874 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:10.391874 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:10.391874 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:10.391874 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:10.391874 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 20:09:10.391874 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 20:09:10.391874 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 20:09:10.391874 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 20:09:10.393038 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:10.393038 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:10.393038 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 20:09:10.393038 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:09:10.393038 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 20:09:10.393038 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:09:10.393038 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:10.393038 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:10.393038 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:10.393038 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:10.393038 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:10.393038 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:10.393038 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:10.393038 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:10.393038 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:10.393038 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:10.393038 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:10.393038 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:10.394289 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:10.394289 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:10.394289 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 20:09:10.394289 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 20:09:10.394289 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 20:09:10.394289 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 20:09:10.394289 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 20:09:10.394289 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 20:09:10.394289 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 20:09:10.394289 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:10.394942 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f5535-5f67-4f83-be33-6c269a3d0c83 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:10.398021 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 369/742] 10.222.0.15 () {56 vars in 1093 bytes} [Tue Jun 21 20:09:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:10.398473 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62048a08-ff5c-499d-804a-ccb6dd585798 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:10.432856 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83aa862-3a03-401f-b1c3-ec4e2a38e08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:10.433936 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83aa862-3a03-401f-b1c3-ec4e2a38e08f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:10.434225 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83aa862-3a03-401f-b1c3-ec4e2a38e08f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:10.434506 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83aa862-3a03-401f-b1c3-ec4e2a38e08f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:10.437850 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:10.446693 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83aa862-3a03-401f-b1c3-ec4e2a38e08f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:10.448165 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83aa862-3a03-401f-b1c3-ec4e2a38e08f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:10.466048 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-a83aa862-3a03-401f-b1c3-ec4e2a38e08f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:10.466048 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:10.466048 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:10.466048 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:10.466048 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:10.466048 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:10.466048 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:10.466048 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:10.466048 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:10.466048 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:10.466048 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:10.466048 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:10.466048 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:09:10.466048 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:09:10.466048 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:09:10.467138 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:09:10.467138 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:10.467138 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:10.467138 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:10.467138 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:10.467138 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:10.467138 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:10.467138 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:10.467138 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:10.467138 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:10.467138 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:10.467138 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:10.467138 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:10.467138 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:10.467138 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:10.467138 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:10.467138 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:10.468371 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:09:10.468371 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:09:10.468371 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:10.468371 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:10.468371 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 374/743] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:09:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:10.468655 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83aa862-3a03-401f-b1c3-ec4e2a38e08f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:10.513716 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62048a08-ff5c-499d-804a-ccb6dd585798 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:10.549683 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4cb101-8349-46ce-ab48-3ffba4b1ae0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:10.550457 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4cb101-8349-46ce-ab48-3ffba4b1ae0f None admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:10.550754 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4cb101-8349-46ce-ab48-3ffba4b1ae0f None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:10.551039 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4cb101-8349-46ce-ab48-3ffba4b1ae0f None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:10.552318 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4cb101-8349-46ce-ab48-3ffba4b1ae0f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:10.553694 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4cb101-8349-46ce-ab48-3ffba4b1ae0f None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:10.575958 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 370/744] 10.222.0.15 () {60 vars in 1141 bytes} [Tue Jun 21 20:09:10 2022] POST /identity/v3/services => generated 240 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:09:10.575958 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4cb101-8349-46ce-ab48-3ffba4b1ae0f None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:10.589465 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83aa862-3a03-401f-b1c3-ec4e2a38e08f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:10.590311 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:10.636100 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bc59ae-cbc2-45fb-93f4-ed2287dd8311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:10.636929 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc59ae-cbc2-45fb-93f4-ed2287dd8311 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:10.637220 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc59ae-cbc2-45fb-93f4-ed2287dd8311 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:10.637504 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc59ae-cbc2-45fb-93f4-ed2287dd8311 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:10.649970 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bc59ae-cbc2-45fb-93f4-ed2287dd8311 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:09:10.658234 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-07bc59ae-cbc2-45fb-93f4-ed2287dd8311 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 20:09:10.658234 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:10.658234 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:10.658234 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:10.658234 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:10.658234 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:10.658234 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:10.658234 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:10.658234 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:10.658234 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:10.658234 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:10.658234 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:10.658234 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:09:10.658234 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:09:10.658234 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:09:10.658234 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:09:10.659271 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:09:10.659271 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:09:10.659271 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:09:10.659271 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:09:10.659271 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:10.659271 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:10.659271 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:10.659271 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:10.659271 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:10.659271 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:10.659271 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:10.659271 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:10.659271 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:10.659271 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:10.659271 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:10.659271 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:10.660186 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:10.660186 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:10.660186 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:10.660186 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:10.660186 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:09:10.660186 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:09:10.660186 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:09:10.660186 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:09:10.660186 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:09:10.660186 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:09:10.660186 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 20:09:10.660186 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:10.660186 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 375/745] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Jun 21 20:09:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:10.660873 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bc59ae-cbc2-45fb-93f4-ed2287dd8311 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:10.720880 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:10.722885 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4cb101-8349-46ce-ab48-3ffba4b1ae0f None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:10.769501 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59349f-ae3c-4822-93e9-28bb3941181e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:10.770198 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59349f-ae3c-4822-93e9-28bb3941181e None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:10.770524 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59349f-ae3c-4822-93e9-28bb3941181e None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:10.770806 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59349f-ae3c-4822-93e9-28bb3941181e None admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:10.771662 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb59349f-ae3c-4822-93e9-28bb3941181e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:10.772848 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb59349f-ae3c-4822-93e9-28bb3941181e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:10.774471 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb59349f-ae3c-4822-93e9-28bb3941181e None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:10.788856 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bc59ae-cbc2-45fb-93f4-ed2287dd8311 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:10.801369 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 371/746] 10.222.0.15 () {56 vars in 1133 bytes} [Tue Jun 21 20:09:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:10.802362 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59349f-ae3c-4822-93e9-28bb3941181e None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:10.843542 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce608ef-dd06-4026-afa0-ba8a9262968f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:10.844538 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce608ef-dd06-4026-afa0-ba8a9262968f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:10.845010 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce608ef-dd06-4026-afa0-ba8a9262968f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:10.845972 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce608ef-dd06-4026-afa0-ba8a9262968f None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:10.846887 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce608ef-dd06-4026-afa0-ba8a9262968f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:10.847808 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce608ef-dd06-4026-afa0-ba8a9262968f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:10.850331 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce608ef-dd06-4026-afa0-ba8a9262968f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:10.869556 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 376/747] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:09:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:10.874212 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce608ef-dd06-4026-afa0-ba8a9262968f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:10.885787 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:10.928870 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59349f-ae3c-4822-93e9-28bb3941181e None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:10.972928 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966b492-5ae1-4ad0-b126-5b0d8a959819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:10.974240 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966b492-5ae1-4ad0-b126-5b0d8a959819 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:10.974611 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966b492-5ae1-4ad0-b126-5b0d8a959819 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:10.974987 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966b492-5ae1-4ad0-b126-5b0d8a959819 None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:10.975876 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e966b492-5ae1-4ad0-b126-5b0d8a959819 None admin] RBAC: Adding query filter params (name=service) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:10.976300 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e966b492-5ae1-4ad0-b126-5b0d8a959819 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:10.977824 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e966b492-5ae1-4ad0-b126-5b0d8a959819 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:10.987245 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 372/748] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Jun 21 20:09:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:10.988217 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966b492-5ae1-4ad0-b126-5b0d8a959819 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:11.002537 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce608ef-dd06-4026-afa0-ba8a9262968f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:11.006274 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:11.057638 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ec281-7dc6-4250-9cb0-829bc82b1890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:11.059347 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ec281-7dc6-4250-9cb0-829bc82b1890 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:11.059812 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ec281-7dc6-4250-9cb0-829bc82b1890 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:11.060264 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ec281-7dc6-4250-9cb0-829bc82b1890 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:11.073931 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ec281-7dc6-4250-9cb0-829bc82b1890 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:11.076087 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ec281-7dc6-4250-9cb0-829bc82b1890 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:11.100886 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966b492-5ae1-4ad0-b126-5b0d8a959819 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:11.102183 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-691ec281-7dc6-4250-9cb0-829bc82b1890 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:11.102183 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:11.102183 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:11.102183 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:11.102183 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:11.102183 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:11.102183 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:11.102183 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:11.102183 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:11.102183 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:11.102183 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:11.102183 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:11.102183 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:09:11.102183 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:09:11.102183 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:09:11.103221 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:09:11.103221 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:11.103221 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:11.103221 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:11.103221 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:11.103221 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:11.103221 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:11.103221 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:11.103221 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:11.103221 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:11.103221 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:11.103221 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:11.103221 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:11.103221 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:11.103221 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:11.103221 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:11.103221 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:11.104347 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:09:11.104347 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:09:11.104347 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:11.104347 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:11.107324 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 377/749] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:09:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:11.108357 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ec281-7dc6-4250-9cb0-829bc82b1890 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:11.141858 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:11.149174 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3c46e-11b9-40fa-af39-35f520c29f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:11.150098 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3c46e-11b9-40fa-af39-35f520c29f73 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:11.150456 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3c46e-11b9-40fa-af39-35f520c29f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:11.150805 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3c46e-11b9-40fa-af39-35f520c29f73 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:11.158399 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f3c46e-11b9-40fa-af39-35f520c29f73 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:11.159946 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f3c46e-11b9-40fa-af39-35f520c29f73 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:11.175640 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-c3f3c46e-11b9-40fa-af39-35f520c29f73 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:09:11.175640 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:11.175640 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:11.175640 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:11.175640 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:11.175640 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:11.175640 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:11.175640 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:11.175640 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:11.175640 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:11.175640 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:11.175640 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:11.175640 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 20:09:11.175640 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 20:09:11.175640 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 20:09:11.176652 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 20:09:11.176652 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:11.176652 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:11.176652 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:11.176652 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:11.176652 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:11.176652 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:11.176652 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:11.176652 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:11.176652 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:11.176652 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:11.176652 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:11.176652 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:11.176652 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:11.176652 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:11.176652 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:11.176652 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:11.177550 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 20:09:11.177550 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 20:09:11.177550 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 20:09:11.177550 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 20:09:11.177550 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 20:09:11.177550 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 20:09:11.177550 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:09:11.177550 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:11.181893 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 373/750] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jun 21 20:09:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:11.182819 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3c46e-11b9-40fa-af39-35f520c29f73 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:11.238187 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ec281-7dc6-4250-9cb0-829bc82b1890 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:11.275023 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3837607d-f350-4e8d-bf92-0a2c9ff457b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:11.275937 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837607d-f350-4e8d-bf92-0a2c9ff457b9 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:11.276319 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837607d-f350-4e8d-bf92-0a2c9ff457b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:11.276669 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837607d-f350-4e8d-bf92-0a2c9ff457b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:11.288183 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3837607d-f350-4e8d-bf92-0a2c9ff457b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:11.289782 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3837607d-f350-4e8d-bf92-0a2c9ff457b9 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:11.308948 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-3837607d-f350-4e8d-bf92-0a2c9ff457b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:11.308948 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:11.308948 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:11.308948 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:11.308948 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:11.308948 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:11.308948 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:11.308948 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:11.308948 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:11.308948 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:11.308948 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:11.308948 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:11.308948 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:09:11.308948 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:09:11.308948 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:09:11.309889 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:09:11.309889 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:11.309889 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:11.309889 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:11.309889 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:11.309889 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:11.309889 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:11.309889 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:11.309889 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:11.309889 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:11.309889 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:11.309889 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:11.309889 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:11.309889 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:11.309889 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:11.309889 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:11.309889 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:11.310789 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:09:11.310789 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:09:11.310789 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:11.310789 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:11.310789 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 378/751] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:09:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:11.311826 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3837607d-f350-4e8d-bf92-0a2c9ff457b9 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:11.312970 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3c46e-11b9-40fa-af39-35f520c29f73 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:11.322764 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:11.360719 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4c8a1-ae3c-4b35-bd48-a85fd00b217d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:11.361408 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4c8a1-ae3c-4b35-bd48-a85fd00b217d None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:11.361694 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4c8a1-ae3c-4b35-bd48-a85fd00b217d None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:11.362139 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4c8a1-ae3c-4b35-bd48-a85fd00b217d None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:11.363256 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca4c8a1-ae3c-4b35-bd48-a85fd00b217d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:11.363577 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca4c8a1-ae3c-4b35-bd48-a85fd00b217d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:11.365480 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca4c8a1-ae3c-4b35-bd48-a85fd00b217d None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:11.380435 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 374/752] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:09:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:11.383820 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4c8a1-ae3c-4b35-bd48-a85fd00b217d None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:11.418625 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3837607d-f350-4e8d-bf92-0a2c9ff457b9 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:11.438552 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:11.455339 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c48a3-99f1-4fe8-9b46-40424fc4bd70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:11.456215 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c48a3-99f1-4fe8-9b46-40424fc4bd70 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:11.456662 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c48a3-99f1-4fe8-9b46-40424fc4bd70 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:11.457083 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c48a3-99f1-4fe8-9b46-40424fc4bd70 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:11.458610 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0c48a3-99f1-4fe8-9b46-40424fc4bd70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:11.459064 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0c48a3-99f1-4fe8-9b46-40424fc4bd70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:11.460648 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0c48a3-99f1-4fe8-9b46-40424fc4bd70 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:11.472315 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 379/753] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jun 21 20:09:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:11.473803 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b888a6e-2b85-49d0-aa1b-96665e025671 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:11.474090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b888a6e-2b85-49d0-aa1b-96665e025671 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:11.474370 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b888a6e-2b85-49d0-aa1b-96665e025671 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:11.475743 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 380/754] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:09:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:09:11.480106 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b888a6e-2b85-49d0-aa1b-96665e025671 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:11.498149 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4c8a1-ae3c-4b35-bd48-a85fd00b217d None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:11.533890 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c363032b-5d40-4509-866c-977505d3002c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:11.534549 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c363032b-5d40-4509-866c-977505d3002c None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:11.534834 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c363032b-5d40-4509-866c-977505d3002c None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:11.535109 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c363032b-5d40-4509-866c-977505d3002c None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:11.535827 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c363032b-5d40-4509-866c-977505d3002c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:11.536185 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c363032b-5d40-4509-866c-977505d3002c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:11.537547 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c363032b-5d40-4509-866c-977505d3002c None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:11.553916 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 375/755] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:09:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:11.553916 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c363032b-5d40-4509-866c-977505d3002c None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:11.555544 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:11.594010 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b888a6e-2b85-49d0-aa1b-96665e025671 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:11.631063 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb1681-8e05-41e0-90ed-0a2bc9601967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:11.631860 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb1681-8e05-41e0-90ed-0a2bc9601967 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:11.632165 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb1681-8e05-41e0-90ed-0a2bc9601967 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:11.632567 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb1681-8e05-41e0-90ed-0a2bc9601967 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:11.639629 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bb1681-8e05-41e0-90ed-0a2bc9601967 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:11.641202 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bb1681-8e05-41e0-90ed-0a2bc9601967 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:11.655034 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c363032b-5d40-4509-866c-977505d3002c None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:11.656757 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-f8bb1681-8e05-41e0-90ed-0a2bc9601967 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:09:11.656757 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:11.656757 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:11.656757 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:11.656757 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:11.656757 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:11.656757 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:11.656757 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:11.656757 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:11.656757 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:11.656757 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:11.656757 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:11.656757 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 20:09:11.656757 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 20:09:11.656757 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 20:09:11.657625 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 20:09:11.657625 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:11.657625 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:11.657625 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:11.657625 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:11.657625 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:11.657625 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:11.657625 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:11.657625 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:11.657625 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:11.657625 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:11.657625 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:11.657625 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:11.657625 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:11.657625 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:11.657625 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:11.657625 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:11.658524 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 20:09:11.658524 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 20:09:11.658524 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 20:09:11.658524 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 20:09:11.658524 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 20:09:11.658524 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 20:09:11.658524 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:09:11.658524 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:11.658524 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 381/756] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jun 21 20:09:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:11.659453 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b09e70-7c37-4168-be9a-d36d5c872bcb None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:11.659453 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b09e70-7c37-4168-be9a-d36d5c872bcb None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:11.659733 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b09e70-7c37-4168-be9a-d36d5c872bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:11.673790 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:11.678548 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-79b09e70-7c37-4168-be9a-d36d5c872bcb None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:09:11.679657 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-79b09e70-7c37-4168-be9a-d36d5c872bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:09:11.696799 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396470d9-6d52-4bc6-8378-72c4802c03af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:11.697467 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396470d9-6d52-4bc6-8378-72c4802c03af None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:11.697756 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396470d9-6d52-4bc6-8378-72c4802c03af None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:11.698057 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396470d9-6d52-4bc6-8378-72c4802c03af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:11.698882 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396470d9-6d52-4bc6-8378-72c4802c03af None admin] RBAC: Adding query filter params (role.id=1f5332f48d9e4c2aac866d0d546c94d5, scope.project.id=4dcb71ef7b6e49148edd61a1eb8da7bb, user.id=038537bd12174154ba259e097b97b8bd) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:11.699204 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396470d9-6d52-4bc6-8378-72c4802c03af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:11.700661 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396470d9-6d52-4bc6-8378-72c4802c03af None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:11.706287 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 376/757] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jun 21 20:09:11 2022] GET /identity/v3/role_assignments?user.id=038537bd12174154ba259e097b97b8bd&scope.project.id=4dcb71ef7b6e49148edd61a1eb8da7bb&role.id=1f5332f48d9e4c2aac866d0d546c94d5 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:11.707184 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396470d9-6d52-4bc6-8378-72c4802c03af None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:11.778662 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 382/758] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:09:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 20:09:11.779550 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b09e70-7c37-4168-be9a-d36d5c872bcb None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:11.834740 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396470d9-6d52-4bc6-8378-72c4802c03af None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:11.849289 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:11.876732 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b9d30-2115-42ed-89d8-56a1cf149c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:11.877475 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b9d30-2115-42ed-89d8-56a1cf149c14 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:11.877765 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b9d30-2115-42ed-89d8-56a1cf149c14 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:11.878047 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b9d30-2115-42ed-89d8-56a1cf149c14 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:11.887656 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b9d30-2115-42ed-89d8-56a1cf149c14 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:11.889152 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b9d30-2115-42ed-89d8-56a1cf149c14 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:11.896485 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b09e70-7c37-4168-be9a-d36d5c872bcb None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:11.905848 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-082b9d30-2115-42ed-89d8-56a1cf149c14 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 20:09:11.905848 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:11.905848 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:11.905848 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:11.905848 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:11.905848 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:11.905848 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:11.905848 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:11.905848 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:11.905848 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:11.905848 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:11.905848 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:11.905848 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 20:09:11.905848 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 20:09:11.905848 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 20:09:11.905848 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 20:09:11.906863 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:11.906863 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:11.906863 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 20:09:11.906863 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:09:11.906863 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 20:09:11.906863 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:09:11.906863 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:11.906863 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:11.906863 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:11.906863 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:11.906863 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:11.906863 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:11.906863 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:11.906863 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:11.906863 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:11.906863 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:11.906863 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:11.906863 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:11.907963 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:11.907963 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:11.907963 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 20:09:11.907963 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 20:09:11.907963 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 20:09:11.907963 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 20:09:11.907963 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 20:09:11.907963 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 20:09:11.907963 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 20:09:11.907963 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:11.907963 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 377/759] 10.222.0.15 () {56 vars in 1117 bytes} [Tue Jun 21 20:09:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:11.913253 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b9d30-2115-42ed-89d8-56a1cf149c14 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:11.941931 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13d97a-cc7f-4a77-acd2-f35a538c1049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:11.943171 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13d97a-cc7f-4a77-acd2-f35a538c1049 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:11.944165 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13d97a-cc7f-4a77-acd2-f35a538c1049 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:11.944630 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13d97a-cc7f-4a77-acd2-f35a538c1049 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:11.945879 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a13d97a-cc7f-4a77-acd2-f35a538c1049 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:11.946634 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a13d97a-cc7f-4a77-acd2-f35a538c1049 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:11.948920 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a13d97a-cc7f-4a77-acd2-f35a538c1049 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:11.951845 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:11.966986 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 383/760] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jun 21 20:09:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:11.968393 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13d97a-cc7f-4a77-acd2-f35a538c1049 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:12.026591 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b9d30-2115-42ed-89d8-56a1cf149c14 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:12.068975 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64364390-6c02-44ff-b71c-7748b4bf60fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:12.069721 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64364390-6c02-44ff-b71c-7748b4bf60fe None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:12.070012 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64364390-6c02-44ff-b71c-7748b4bf60fe None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:12.070295 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64364390-6c02-44ff-b71c-7748b4bf60fe None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:12.070962 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64364390-6c02-44ff-b71c-7748b4bf60fe None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:12.072421 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64364390-6c02-44ff-b71c-7748b4bf60fe None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:12.087145 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-64364390-6c02-44ff-b71c-7748b4bf60fe None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 20:09:12.087145 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:12.087145 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 20:09:12.087145 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 20:09:12.087145 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 20:09:12.087145 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 20:09:12.087145 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 20:09:12.087145 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 20:09:12.087145 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 20:09:12.087145 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:12.087145 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 20:09:12.087145 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:12.087145 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:12.087145 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:12.087145 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:12.087145 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:12.088147 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:12.088147 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:12.088147 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:12.088147 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:12.088147 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:12.088147 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:12.088147 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:12.088147 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 20:09:12.088147 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 20:09:12.088147 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 20:09:12.088147 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 20:09:12.088147 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:12.088147 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:12.088147 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:12.088147 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:12.088147 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:12.089206 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:12.089206 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:12.089206 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:12.089206 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:12.089206 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:12.089206 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:12.089206 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:12.089206 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:12.089206 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:12.089206 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:12.089206 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:12.089206 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 20:09:12.089206 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 20:09:12.089206 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 20:09:12.089206 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:12.089206 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 378/761] 10.222.0.15 () {56 vars in 1129 bytes} [Tue Jun 21 20:09:11 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:12.090217 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64364390-6c02-44ff-b71c-7748b4bf60fe None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:12.097955 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13d97a-cc7f-4a77-acd2-f35a538c1049 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:12.122304 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:12.149265 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8afe284-e365-4ff3-946b-ccf573806dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:12.150435 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afe284-e365-4ff3-946b-ccf573806dd1 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:12.151192 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afe284-e365-4ff3-946b-ccf573806dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:12.151676 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afe284-e365-4ff3-946b-ccf573806dd1 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:12.152730 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8afe284-e365-4ff3-946b-ccf573806dd1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:12.153225 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8afe284-e365-4ff3-946b-ccf573806dd1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:12.155283 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8afe284-e365-4ff3-946b-ccf573806dd1 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:12.179222 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 384/762] 10.222.0.15 () {56 vars in 1149 bytes} [Tue Jun 21 20:09:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:12.180412 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8afe284-e365-4ff3-946b-ccf573806dd1 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:12.208842 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:12.212314 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64364390-6c02-44ff-b71c-7748b4bf60fe None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:12.248160 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b79ac6-fce6-419e-9624-5d849aae0eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:12.249206 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b79ac6-fce6-419e-9624-5d849aae0eaa None admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:12.249919 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b79ac6-fce6-419e-9624-5d849aae0eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:12.249919 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b79ac6-fce6-419e-9624-5d849aae0eaa None admin] PATH_INFO: `/v3/projects/4dcb71ef7b6e49148edd61a1eb8da7bb/users/3918fe05c8634bc39f3e295374701465/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:12.252136 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b79ac6-fce6-419e-9624-5d849aae0eaa None admin] RBAC: Authorizing `identity:create_grant(project_id=4dcb71ef7b6e49148edd61a1eb8da7bb, user_id=3918fe05c8634bc39f3e295374701465, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:12.253789 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b79ac6-fce6-419e-9624-5d849aae0eaa None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:12.272852 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 379/763] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Jun 21 20:09:12 2022] PUT /identity/v3/projects/4dcb71ef7b6e49148edd61a1eb8da7bb/users/3918fe05c8634bc39f3e295374701465/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:09:12.273673 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b79ac6-fce6-419e-9624-5d849aae0eaa None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:12.304941 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8afe284-e365-4ff3-946b-ccf573806dd1 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:12.344542 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9952d55d-048d-46f1-878b-b39ce96ed244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:12.345585 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952d55d-048d-46f1-878b-b39ce96ed244 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:12.346170 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952d55d-048d-46f1-878b-b39ce96ed244 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:12.346748 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952d55d-048d-46f1-878b-b39ce96ed244 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:12.347698 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9952d55d-048d-46f1-878b-b39ce96ed244 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:12.348231 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9952d55d-048d-46f1-878b-b39ce96ed244 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:12.349847 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9952d55d-048d-46f1-878b-b39ce96ed244 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:12.355347 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 385/764] 10.222.0.15 () {56 vars in 1124 bytes} [Tue Jun 21 20:09:12 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:12.361245 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9952d55d-048d-46f1-878b-b39ce96ed244 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:12.408422 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b79ac6-fce6-419e-9624-5d849aae0eaa None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:12.415414 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:12.447220 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a314e01-df7e-4dd9-98d4-79c760207867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:12.448296 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a314e01-df7e-4dd9-98d4-79c760207867 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:12.448787 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a314e01-df7e-4dd9-98d4-79c760207867 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:12.449269 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a314e01-df7e-4dd9-98d4-79c760207867 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:12.480493 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:12.498247 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9952d55d-048d-46f1-878b-b39ce96ed244 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:12.558454 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a314e01-df7e-4dd9-98d4-79c760207867 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:12.560288 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a314e01-df7e-4dd9-98d4-79c760207867 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:12.564845 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85985ab-aade-4469-b160-9c9dea22e25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:12.565794 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85985ab-aade-4469-b160-9c9dea22e25d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:12.566301 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85985ab-aade-4469-b160-9c9dea22e25d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:12.566783 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85985ab-aade-4469-b160-9c9dea22e25d None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:12.567777 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85985ab-aade-4469-b160-9c9dea22e25d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:12.568336 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85985ab-aade-4469-b160-9c9dea22e25d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:12.569915 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85985ab-aade-4469-b160-9c9dea22e25d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:12.575541 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 386/765] 10.222.0.15 () {56 vars in 1124 bytes} [Tue Jun 21 20:09:12 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:12.580882 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85985ab-aade-4469-b160-9c9dea22e25d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:12.679933 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 380/766] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:09:12 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 20:09:12.684957 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a314e01-df7e-4dd9-98d4-79c760207867 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:12.755114 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85985ab-aade-4469-b160-9c9dea22e25d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:12.755640 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:12.758408 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:12.793222 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a3339b-9eae-4334-88bd-1770fd394fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:12.793883 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3339b-9eae-4334-88bd-1770fd394fea None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:12.794167 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3339b-9eae-4334-88bd-1770fd394fea None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:12.794442 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3339b-9eae-4334-88bd-1770fd394fea None admin] PATH_INFO: `/v3/endpoints` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:12.795233 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a3339b-9eae-4334-88bd-1770fd394fea None admin] RBAC: Adding query filter params (interface=public, service_id=22c909d047ba4b52baf6c7ec2740b9de, region_id=RegionOne) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:12.796056 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a3339b-9eae-4334-88bd-1770fd394fea None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:12.797162 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a3339b-9eae-4334-88bd-1770fd394fea None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:12.809558 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 387/767] 10.222.0.15 () {56 vars in 1251 bytes} [Tue Jun 21 20:09:12 2022] GET /identity/v3/endpoints?service_id=22c909d047ba4b52baf6c7ec2740b9de&interface=public®ion_id=RegionOne => generated 194 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:12.810026 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a314e01-df7e-4dd9-98d4-79c760207867 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:12.811031 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d701c7-6ccb-4db6-8ad8-004fbabfbdc7 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:12.811326 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d701c7-6ccb-4db6-8ad8-004fbabfbdc7 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:12.811606 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d701c7-6ccb-4db6-8ad8-004fbabfbdc7 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:12.814026 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 388/768] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:09:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:09:12.814158 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d701c7-6ccb-4db6-8ad8-004fbabfbdc7 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:12.859558 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad2eb6-9810-473e-8940-ad9c7d1d2a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:12.860574 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad2eb6-9810-473e-8940-ad9c7d1d2a73 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:12.861001 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad2eb6-9810-473e-8940-ad9c7d1d2a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:12.861439 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad2eb6-9810-473e-8940-ad9c7d1d2a73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:12.872484 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbad2eb6-9810-473e-8940-ad9c7d1d2a73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:12.874301 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbad2eb6-9810-473e-8940-ad9c7d1d2a73 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:12.892272 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-bbad2eb6-9810-473e-8940-ad9c7d1d2a73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:12.892272 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:12.892272 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:12.892272 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:12.892272 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:12.892272 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:12.892272 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:12.892272 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:12.892272 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:12.892272 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:12.892272 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:12.892272 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:12.892272 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:09:12.892272 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:09:12.892272 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:09:12.893378 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:09:12.893378 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:12.893378 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:12.893378 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:12.893378 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:12.893378 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:12.893378 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:12.893378 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:12.893378 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:12.893378 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:12.893378 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:12.893378 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:12.893378 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:12.893378 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:12.893378 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:12.893378 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:12.893378 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:12.894505 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:09:12.894505 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:09:12.894505 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:12.894505 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:12.896879 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 381/769] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:09:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:12.898330 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be868c70-8bad-405b-a247-bbb527bc33b0 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:12.898762 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be868c70-8bad-405b-a247-bbb527bc33b0 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:12.899179 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be868c70-8bad-405b-a247-bbb527bc33b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:12.917395 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-be868c70-8bad-405b-a247-bbb527bc33b0 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:09:12.918821 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-be868c70-8bad-405b-a247-bbb527bc33b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:09:12.945105 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d701c7-6ccb-4db6-8ad8-004fbabfbdc7 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:12.996121 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0d8f9-c2e8-4fdd-88cf-daaec39544b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:12.996121 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0d8f9-c2e8-4fdd-88cf-daaec39544b0 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:12.996121 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0d8f9-c2e8-4fdd-88cf-daaec39544b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:12.996121 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0d8f9-c2e8-4fdd-88cf-daaec39544b0 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:12.996573 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde0d8f9-c2e8-4fdd-88cf-daaec39544b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:12.996573 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde0d8f9-c2e8-4fdd-88cf-daaec39544b0 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:12.996793 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 382/770] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:09:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 20:09:12.997816 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be868c70-8bad-405b-a247-bbb527bc33b0 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:13.003967 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 389/771] 10.222.0.15 () {56 vars in 1087 bytes} [Tue Jun 21 20:09:12 2022] GET /identity/v3/services => generated 772 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:13.032934 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0d8f9-c2e8-4fdd-88cf-daaec39544b0 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:13.076380 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:13.092326 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:13.192973 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0d8f9-c2e8-4fdd-88cf-daaec39544b0 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:13.216056 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be868c70-8bad-405b-a247-bbb527bc33b0 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:13.255697 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4058d4-eed0-47bc-8fde-7626fe190978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:13.257115 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4058d4-eed0-47bc-8fde-7626fe190978 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:13.257610 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4058d4-eed0-47bc-8fde-7626fe190978 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:13.258498 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4058d4-eed0-47bc-8fde-7626fe190978 None admin] PATH_INFO: `/v3/services/network` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:13.259706 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4058d4-eed0-47bc-8fde-7626fe190978 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:13.261284 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4058d4-eed0-47bc-8fde-7626fe190978 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:13.263120 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf35c4-c853-4493-8dfe-e2efd87a218d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:13.264805 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf35c4-c853-4493-8dfe-e2efd87a218d None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:13.264805 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf35c4-c853-4493-8dfe-e2efd87a218d None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:13.265001 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf35c4-c853-4493-8dfe-e2efd87a218d None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:13.265758 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cf35c4-c853-4493-8dfe-e2efd87a218d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:13.266935 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cf35c4-c853-4493-8dfe-e2efd87a218d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:13.268565 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cf35c4-c853-4493-8dfe-e2efd87a218d None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:13.278616 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-6e4058d4-eed0-47bc-8fde-7626fe190978 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 20:09:13.278616 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:13.278616 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 20:09:13.278616 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 20:09:13.278616 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 20:09:13.278616 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 20:09:13.278616 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 20:09:13.278616 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 20:09:13.278616 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 20:09:13.278616 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:13.278616 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 20:09:13.278616 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:13.278616 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:13.278616 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:13.278616 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:13.278616 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:13.278616 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:13.279618 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:13.279618 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:13.279618 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:13.279618 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:13.279618 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:13.279618 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:13.279618 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 20:09:13.279618 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 20:09:13.279618 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 20:09:13.279618 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 20:09:13.279618 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:13.279618 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:13.279618 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:13.279618 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:13.279618 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:13.279618 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:13.280473 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:13.280473 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:13.280473 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:13.280473 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:13.280473 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:13.280473 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:13.280473 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:13.280473 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:13.280473 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:13.280473 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:13.280473 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 20:09:13.280473 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 20:09:13.280473 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 20:09:13.280473 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:13.283332 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 390/772] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jun 21 20:09:13 2022] GET /identity/v3/services/network => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:13.291710 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4058d4-eed0-47bc-8fde-7626fe190978 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:13.296331 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 383/773] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:09:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:13.300902 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf35c4-c853-4493-8dfe-e2efd87a218d None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:13.432820 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf35c4-c853-4493-8dfe-e2efd87a218d None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:13.434568 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:13.481417 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118552d-0909-4b3f-8e2c-23c0e4321bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:13.482134 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118552d-0909-4b3f-8e2c-23c0e4321bd7 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:13.482416 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118552d-0909-4b3f-8e2c-23c0e4321bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:13.482693 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118552d-0909-4b3f-8e2c-23c0e4321bd7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:13.491115 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f118552d-0909-4b3f-8e2c-23c0e4321bd7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:13.492750 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f118552d-0909-4b3f-8e2c-23c0e4321bd7 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:13.509540 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-f118552d-0909-4b3f-8e2c-23c0e4321bd7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:09:13.509540 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:13.509540 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:13.509540 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:13.509540 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:13.509540 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:13.509540 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:13.509540 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:13.509540 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:13.509540 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:13.509540 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:13.509540 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:13.509540 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 20:09:13.509540 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 20:09:13.509540 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 20:09:13.510480 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 20:09:13.510480 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:13.510480 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:13.510480 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:13.510480 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:13.510480 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:13.510480 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:13.510480 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:13.510480 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:13.510480 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:13.510480 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:13.510480 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:13.510480 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:13.510480 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:13.510480 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:13.510480 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:13.510480 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:13.511355 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 20:09:13.511355 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 20:09:13.511355 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 20:09:13.511355 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 20:09:13.511355 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 20:09:13.511355 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 20:09:13.511355 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:09:13.511355 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:13.512309 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 384/774] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jun 21 20:09:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:13.518253 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:13.519682 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118552d-0909-4b3f-8e2c-23c0e4321bd7 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:13.524680 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4058d4-eed0-47bc-8fde-7626fe190978 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:13.569579 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5705b45a-ca7e-4604-884c-991295a446e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:13.570266 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705b45a-ca7e-4604-884c-991295a446e4 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:13.570562 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705b45a-ca7e-4604-884c-991295a446e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:13.570848 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705b45a-ca7e-4604-884c-991295a446e4 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:13.571567 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5705b45a-ca7e-4604-884c-991295a446e4 None admin] RBAC: Adding query filter params (name=network) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:13.571879 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5705b45a-ca7e-4604-884c-991295a446e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:13.573338 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5705b45a-ca7e-4604-884c-991295a446e4 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:13.584076 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 391/775] 10.222.0.15 () {56 vars in 1112 bytes} [Tue Jun 21 20:09:13 2022] GET /identity/v3/services?name=network => generated 124 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:09:13.591806 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5705b45a-ca7e-4604-884c-991295a446e4 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:13.714156 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118552d-0909-4b3f-8e2c-23c0e4321bd7 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:13.722932 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5705b45a-ca7e-4604-884c-991295a446e4 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:13.764612 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcaa69a-13f8-4560-b6a0-32d940a7d75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:13.765610 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcaa69a-13f8-4560-b6a0-32d940a7d75f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:13.766043 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcaa69a-13f8-4560-b6a0-32d940a7d75f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:13.766545 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcaa69a-13f8-4560-b6a0-32d940a7d75f None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:13.767398 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcaa69a-13f8-4560-b6a0-32d940a7d75f None admin] RBAC: Adding query filter params (type=network) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:13.767855 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcaa69a-13f8-4560-b6a0-32d940a7d75f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:13.770011 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcaa69a-13f8-4560-b6a0-32d940a7d75f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:13.776180 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 392/776] 10.222.0.15 () {56 vars in 1112 bytes} [Tue Jun 21 20:09:13 2022] GET /identity/v3/services?type=network => generated 350 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:09:13.782351 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcaa69a-13f8-4560-b6a0-32d940a7d75f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:13.799945 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491288b-a5cf-4ff5-a12a-e8e3628a278f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:13.800886 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491288b-a5cf-4ff5-a12a-e8e3628a278f None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:13.801322 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491288b-a5cf-4ff5-a12a-e8e3628a278f None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:13.802308 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491288b-a5cf-4ff5-a12a-e8e3628a278f None admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:13.803281 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4491288b-a5cf-4ff5-a12a-e8e3628a278f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:13.803742 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4491288b-a5cf-4ff5-a12a-e8e3628a278f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:13.805357 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4491288b-a5cf-4ff5-a12a-e8e3628a278f None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:13.832062 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 385/777] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jun 21 20:09:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:13.837003 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:13.840422 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491288b-a5cf-4ff5-a12a-e8e3628a278f None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:13.871043 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:13.954978 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491288b-a5cf-4ff5-a12a-e8e3628a278f None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:13.993124 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e16412-349f-4d19-8bbc-d19e2f754760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:13.994524 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e16412-349f-4d19-8bbc-d19e2f754760 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:13.994989 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e16412-349f-4d19-8bbc-d19e2f754760 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:13.995415 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e16412-349f-4d19-8bbc-d19e2f754760 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:13.996448 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e16412-349f-4d19-8bbc-d19e2f754760 None admin] RBAC: Adding query filter params (role.id=a4929ef60a294190b2d59e8d61e05063, scope.project.id=4dcb71ef7b6e49148edd61a1eb8da7bb, user.id=5cf067b8833f4596a1b91073a66768f0) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:13.996913 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e16412-349f-4d19-8bbc-d19e2f754760 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:13.998498 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e16412-349f-4d19-8bbc-d19e2f754760 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:14.005382 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 386/778] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jun 21 20:09:13 2022] GET /identity/v3/role_assignments?user.id=5cf067b8833f4596a1b91073a66768f0&scope.project.id=4dcb71ef7b6e49148edd61a1eb8da7bb&role.id=a4929ef60a294190b2d59e8d61e05063 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:14.028184 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b75b6-7bf2-4ea8-9813-ceabac8b3c4d None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:14.028766 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b75b6-7bf2-4ea8-9813-ceabac8b3c4d None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:14.029257 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b75b6-7bf2-4ea8-9813-ceabac8b3c4d None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:14.030671 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcaa69a-13f8-4560-b6a0-32d940a7d75f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:14.031325 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 387/779] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:09:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 20:09:14.037738 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b900f-9955-41ad-b38f-27faa2a6df52 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:14.038313 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b900f-9955-41ad-b38f-27faa2a6df52 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:14.038924 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b900f-9955-41ad-b38f-27faa2a6df52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:14.058512 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-9f1b900f-9955-41ad-b38f-27faa2a6df52 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:09:14.060436 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-9f1b900f-9955-41ad-b38f-27faa2a6df52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:09:14.080785 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fbd466-0b65-4c84-bb80-0cb2a64eeb63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:14.081497 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fbd466-0b65-4c84-bb80-0cb2a64eeb63 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:14.081791 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fbd466-0b65-4c84-bb80-0cb2a64eeb63 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:14.082079 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fbd466-0b65-4c84-bb80-0cb2a64eeb63 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:14.083448 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fbd466-0b65-4c84-bb80-0cb2a64eeb63 None admin] RBAC: Adding query filter params (interface=public, service_id=7a4f171085ad4c9fabdfcc0acf4120c1, region_id=RegionOne) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:14.083772 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fbd466-0b65-4c84-bb80-0cb2a64eeb63 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:14.085267 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fbd466-0b65-4c84-bb80-0cb2a64eeb63 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:14.091148 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 393/780] 10.222.0.15 () {56 vars in 1251 bytes} [Tue Jun 21 20:09:13 2022] GET /identity/v3/endpoints?service_id=7a4f171085ad4c9fabdfcc0acf4120c1&interface=public®ion_id=RegionOne => generated 194 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:14.096586 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fbd466-0b65-4c84-bb80-0cb2a64eeb63 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:14.144721 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 388/781] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:09:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 20:09:14.199109 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b900f-9955-41ad-b38f-27faa2a6df52 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:14.227533 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:14.241037 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fbd466-0b65-4c84-bb80-0cb2a64eeb63 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:14.277471 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0b5ae6-24b8-4af2-a7e6-65e9b9fc900b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:14.278156 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b5ae6-24b8-4af2-a7e6-65e9b9fc900b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:14.278501 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b5ae6-24b8-4af2-a7e6-65e9b9fc900b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:14.278728 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b5ae6-24b8-4af2-a7e6-65e9b9fc900b None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:14.279422 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0b5ae6-24b8-4af2-a7e6-65e9b9fc900b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:14.280881 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0b5ae6-24b8-4af2-a7e6-65e9b9fc900b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:14.287966 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 394/782] 10.222.0.15 () {56 vars in 1087 bytes} [Tue Jun 21 20:09:14 2022] GET /identity/v3/services => generated 772 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:09:14.383953 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:14.479780 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b900f-9955-41ad-b38f-27faa2a6df52 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:14.522161 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d484a5b9-616b-48fe-8b40-f44762a8f9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:14.522972 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d484a5b9-616b-48fe-8b40-f44762a8f9ec None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:14.523263 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d484a5b9-616b-48fe-8b40-f44762a8f9ec None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:14.523545 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d484a5b9-616b-48fe-8b40-f44762a8f9ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:14.535345 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d484a5b9-616b-48fe-8b40-f44762a8f9ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:09:14.543389 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-d484a5b9-616b-48fe-8b40-f44762a8f9ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 20:09:14.543389 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:14.543389 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:14.543389 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:14.543389 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:14.543389 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:14.543389 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:14.543389 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:14.543389 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:14.543389 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:14.543389 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:14.543389 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:14.543389 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:09:14.543389 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:09:14.543389 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:09:14.543389 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:09:14.544568 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:09:14.544568 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:09:14.544568 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:09:14.544568 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:09:14.544568 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:14.544568 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:14.544568 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:14.544568 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:14.544568 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:14.544568 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:14.544568 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:14.544568 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:14.544568 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:14.544568 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:14.544568 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:14.544568 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:14.545592 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:14.545592 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:14.545592 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:14.545592 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:14.545592 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:09:14.545592 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:09:14.545592 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:09:14.545592 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:09:14.545592 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:09:14.545592 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:09:14.545592 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 20:09:14.545592 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:14.545592 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 389/783] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jun 21 20:09:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:09:14.550878 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0b5ae6-24b8-4af2-a7e6-65e9b9fc900b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:14.666249 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0b5ae6-24b8-4af2-a7e6-65e9b9fc900b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:14.708629 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94616a9b-9b78-48e0-bbae-1be8db34523b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:14.709312 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94616a9b-9b78-48e0-bbae-1be8db34523b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:14.709629 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94616a9b-9b78-48e0-bbae-1be8db34523b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:14.709884 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94616a9b-9b78-48e0-bbae-1be8db34523b None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:14.710641 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94616a9b-9b78-48e0-bbae-1be8db34523b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:14.710952 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94616a9b-9b78-48e0-bbae-1be8db34523b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:14.712348 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94616a9b-9b78-48e0-bbae-1be8db34523b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:14.720989 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 395/784] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:09:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:14.727455 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d484a5b9-616b-48fe-8b40-f44762a8f9ec None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:14.850322 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:14.889345 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d484a5b9-616b-48fe-8b40-f44762a8f9ec None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:14.940827 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb932c-be5f-43c6-8119-f6e3308c6427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:14.941633 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb932c-be5f-43c6-8119-f6e3308c6427 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:14.941918 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb932c-be5f-43c6-8119-f6e3308c6427 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:14.942234 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb932c-be5f-43c6-8119-f6e3308c6427 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:14.952686 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbb932c-be5f-43c6-8119-f6e3308c6427 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:14.954121 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbb932c-be5f-43c6-8119-f6e3308c6427 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:14.972236 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-fdbb932c-be5f-43c6-8119-f6e3308c6427 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:14.972236 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:14.972236 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:14.972236 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:14.972236 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:14.972236 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:14.972236 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:14.972236 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:14.972236 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:14.972236 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:14.972236 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:14.972236 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:14.972236 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:09:14.972236 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:09:14.972236 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:09:14.973183 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:09:14.973183 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:14.973183 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:14.973183 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:14.973183 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:14.973183 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:14.973183 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:14.973183 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:14.973183 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:14.973183 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:14.973183 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:14.973183 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:14.973183 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:14.973183 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:14.973183 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:14.973183 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:14.973183 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:14.974667 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:09:14.974667 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:09:14.974667 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:14.974667 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:14.974667 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 390/785] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:09:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:14.980749 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94616a9b-9b78-48e0-bbae-1be8db34523b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:15.016985 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:15.110563 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94616a9b-9b78-48e0-bbae-1be8db34523b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:15.151353 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d15cfc7-f6a3-45b0-847b-09466e55682a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:15.152420 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15cfc7-f6a3-45b0-847b-09466e55682a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:15.152903 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15cfc7-f6a3-45b0-847b-09466e55682a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:15.153378 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15cfc7-f6a3-45b0-847b-09466e55682a None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:15.154321 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d15cfc7-f6a3-45b0-847b-09466e55682a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:15.154841 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d15cfc7-f6a3-45b0-847b-09466e55682a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:15.156505 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d15cfc7-f6a3-45b0-847b-09466e55682a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:15.162939 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a20f8-3e2d-41d6-84a0-22f66530fc46 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:15.163468 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a20f8-3e2d-41d6-84a0-22f66530fc46 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:15.163992 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a20f8-3e2d-41d6-84a0-22f66530fc46 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:15.165790 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 391/786] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:09:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 20:09:15.172542 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b0985-e053-4ed1-b74d-4262a26cf67c None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:15.172831 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b0985-e053-4ed1-b74d-4262a26cf67c None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:15.173111 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b0985-e053-4ed1-b74d-4262a26cf67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:15.181778 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 396/787] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:09:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:15.191478 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d15cfc7-f6a3-45b0-847b-09466e55682a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:15.204783 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-7a6b0985-e053-4ed1-b74d-4262a26cf67c None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:09:15.206015 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-7a6b0985-e053-4ed1-b74d-4262a26cf67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:09:15.325026 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 392/788] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:09:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 20:09:15.332357 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:15.350628 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b0985-e053-4ed1-b74d-4262a26cf67c None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:15.396367 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d15cfc7-f6a3-45b0-847b-09466e55682a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:15.423698 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:15.434702 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ecac9-48c8-4fb7-88c2-8a60a323873b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:15.435778 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ecac9-48c8-4fb7-88c2-8a60a323873b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:15.436367 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ecac9-48c8-4fb7-88c2-8a60a323873b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:15.436841 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ecac9-48c8-4fb7-88c2-8a60a323873b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:15.445085 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9ecac9-48c8-4fb7-88c2-8a60a323873b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:15.446628 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9ecac9-48c8-4fb7-88c2-8a60a323873b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:15.466533 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-3c9ecac9-48c8-4fb7-88c2-8a60a323873b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 21 20:09:15.466533 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:15.466533 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:15.466533 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:15.466533 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:15.466533 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:15.466533 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:15.466533 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:15.466533 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:15.466533 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:15.466533 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:15.466533 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:15.466533 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 20:09:15.466533 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 20:09:15.466533 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 20:09:15.466533 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 20:09:15.467566 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:15.467566 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:15.467566 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 20:09:15.467566 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:09:15.467566 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 20:09:15.467566 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:09:15.467566 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:15.467566 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:15.467566 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:15.467566 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:15.467566 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:15.467566 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:15.467566 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:15.467566 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:15.467566 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:15.467566 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:15.467566 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:15.467566 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:15.468547 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:15.468547 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:15.468547 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 20:09:15.468547 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 20:09:15.468547 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 20:09:15.468547 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 20:09:15.468547 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 20:09:15.468547 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 20:09:15.468547 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 21 20:09:15.468547 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:15.472065 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 397/789] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jun 21 20:09:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:15.474396 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91ade8-9b6e-4026-80f8-9eacd0b21366 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:15.474684 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91ade8-9b6e-4026-80f8-9eacd0b21366 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:15.474959 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91ade8-9b6e-4026-80f8-9eacd0b21366 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:15.476594 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 398/790] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:09:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:09:15.477288 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91ade8-9b6e-4026-80f8-9eacd0b21366 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:15.482187 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b0985-e053-4ed1-b74d-4262a26cf67c None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:15.518276 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b20a5-49e9-4076-82f1-d8cd0ad50b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:15.519501 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b20a5-49e9-4076-82f1-d8cd0ad50b86 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:15.520094 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b20a5-49e9-4076-82f1-d8cd0ad50b86 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:15.520666 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b20a5-49e9-4076-82f1-d8cd0ad50b86 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:15.531693 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745b20a5-49e9-4076-82f1-d8cd0ad50b86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:09:15.540360 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-745b20a5-49e9-4076-82f1-d8cd0ad50b86 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 20:09:15.540360 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:15.540360 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:15.540360 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:15.540360 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:15.540360 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:15.540360 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:15.540360 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:15.540360 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:15.540360 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:15.540360 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:15.540360 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:15.540360 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:09:15.540360 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:09:15.540360 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:09:15.540360 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:09:15.541398 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:09:15.541398 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:09:15.541398 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:09:15.541398 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:09:15.541398 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:15.541398 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:15.541398 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:15.541398 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:15.541398 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:15.541398 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:15.541398 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:15.541398 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:15.541398 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:15.541398 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:15.541398 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:15.541398 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:15.542263 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:15.542263 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:15.542263 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:15.542263 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:15.542263 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:09:15.542263 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:09:15.542263 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:09:15.542263 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:09:15.542263 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:09:15.542263 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:09:15.542263 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 20:09:15.542263 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:15.549710 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 393/791] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jun 21 20:09:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:09:15.551271 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd6ba4-75b5-4599-ab12-c3175c3c8151 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:15.552328 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd6ba4-75b5-4599-ab12-c3175c3c8151 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:15.552819 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd6ba4-75b5-4599-ab12-c3175c3c8151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:15.569768 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-16cd6ba4-75b5-4599-ab12-c3175c3c8151 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:09:15.571298 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-16cd6ba4-75b5-4599-ab12-c3175c3c8151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:09:15.579722 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91ade8-9b6e-4026-80f8-9eacd0b21366 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:15.616574 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306f74a-0582-4654-a1c6-f27f1976c50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:15.617444 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306f74a-0582-4654-a1c6-f27f1976c50c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:15.617693 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306f74a-0582-4654-a1c6-f27f1976c50c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:15.617978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306f74a-0582-4654-a1c6-f27f1976c50c None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:15.618820 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1306f74a-0582-4654-a1c6-f27f1976c50c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:15.619130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1306f74a-0582-4654-a1c6-f27f1976c50c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:15.620934 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1306f74a-0582-4654-a1c6-f27f1976c50c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:15.622813 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:15.644788 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 399/792] 10.222.0.15 () {56 vars in 1135 bytes} [Tue Jun 21 20:09:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:15.644788 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306f74a-0582-4654-a1c6-f27f1976c50c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:15.654752 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 394/793] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:09:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 20:09:15.656114 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd6ba4-75b5-4599-ab12-c3175c3c8151 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:15.711565 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:15.743504 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306f74a-0582-4654-a1c6-f27f1976c50c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:15.771639 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd6ba4-75b5-4599-ab12-c3175c3c8151 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:15.779596 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a66103a-ca13-4db6-9223-df71ec9fcf2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:15.780403 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66103a-ca13-4db6-9223-df71ec9fcf2a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:15.780591 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66103a-ca13-4db6-9223-df71ec9fcf2a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:15.780846 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66103a-ca13-4db6-9223-df71ec9fcf2a None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:15.781594 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a66103a-ca13-4db6-9223-df71ec9fcf2a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:15.781899 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a66103a-ca13-4db6-9223-df71ec9fcf2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:15.783274 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a66103a-ca13-4db6-9223-df71ec9fcf2a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:15.796979 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 400/794] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:09:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:15.796979 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a66103a-ca13-4db6-9223-df71ec9fcf2a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:15.818312 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c1d37-5be4-4659-91e5-337bed9f66eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:15.819518 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c1d37-5be4-4659-91e5-337bed9f66eb None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:15.820079 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c1d37-5be4-4659-91e5-337bed9f66eb None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:15.820565 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c1d37-5be4-4659-91e5-337bed9f66eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:15.832421 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5c1d37-5be4-4659-91e5-337bed9f66eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:15.834778 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5c1d37-5be4-4659-91e5-337bed9f66eb None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:15.854683 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-9b5c1d37-5be4-4659-91e5-337bed9f66eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:15.854683 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:15.854683 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:15.854683 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:15.854683 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:15.854683 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:15.854683 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:15.854683 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:15.854683 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:15.854683 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:15.854683 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:15.854683 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:15.854683 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:09:15.854683 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:09:15.854683 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:09:15.855688 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:09:15.855688 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:15.855688 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:15.855688 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:15.855688 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:15.855688 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:15.855688 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:15.855688 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:15.855688 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:15.855688 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:15.855688 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:15.855688 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:15.855688 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:15.855688 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:15.855688 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:15.855688 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:15.855688 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:15.856629 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:09:15.856629 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:09:15.856629 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:15.856629 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:15.858129 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:15.864980 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 395/795] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:09:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:15.866095 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c1d37-5be4-4659-91e5-337bed9f66eb None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:15.905720 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a66103a-ca13-4db6-9223-df71ec9fcf2a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:15.941253 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f98b8b-7679-489b-8371-dfa53816eb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:15.941632 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f98b8b-7679-489b-8371-dfa53816eb81 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:15.941920 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f98b8b-7679-489b-8371-dfa53816eb81 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:15.942726 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f98b8b-7679-489b-8371-dfa53816eb81 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:15.943378 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f98b8b-7679-489b-8371-dfa53816eb81 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:15.944834 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f98b8b-7679-489b-8371-dfa53816eb81 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:15.956963 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-14f98b8b-7679-489b-8371-dfa53816eb81 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 20:09:15.956963 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:15.956963 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 20:09:15.956963 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 20:09:15.956963 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 20:09:15.956963 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 20:09:15.956963 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 20:09:15.956963 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 20:09:15.956963 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 20:09:15.956963 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:15.956963 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 20:09:15.956963 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:15.956963 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:15.956963 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:15.956963 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:15.956963 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:15.958460 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:15.958460 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:15.958460 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:15.958460 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:15.958460 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:15.958460 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:15.958460 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:15.958460 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 20:09:15.958460 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 20:09:15.958460 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 20:09:15.958460 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 20:09:15.958460 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:15.958460 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:15.958460 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:15.958460 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:15.958460 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:15.959328 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:15.959328 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:15.959328 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:15.959328 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:15.959328 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:15.959328 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:15.959328 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:15.959328 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:15.959328 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:15.959328 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:15.959328 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:15.959328 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 20:09:15.959328 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 20:09:15.959328 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 20:09:15.959328 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:15.959328 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 401/796] 10.222.0.15 () {56 vars in 1129 bytes} [Tue Jun 21 20:09:15 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:15.960225 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f98b8b-7679-489b-8371-dfa53816eb81 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:15.974409 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:15.978352 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c1d37-5be4-4659-91e5-337bed9f66eb None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:16.015575 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d330b2d7-adc2-4d58-beb6-70a083193361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:16.016693 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330b2d7-adc2-4d58-beb6-70a083193361 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:16.017153 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330b2d7-adc2-4d58-beb6-70a083193361 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:16.017581 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330b2d7-adc2-4d58-beb6-70a083193361 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:16.028958 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d330b2d7-adc2-4d58-beb6-70a083193361 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:16.030591 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d330b2d7-adc2-4d58-beb6-70a083193361 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:16.048773 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-d330b2d7-adc2-4d58-beb6-70a083193361 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:16.048773 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:16.048773 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:16.048773 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:16.048773 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:16.048773 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:16.048773 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:16.048773 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:16.048773 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:16.048773 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:16.048773 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:16.048773 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:16.048773 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:09:16.048773 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:09:16.048773 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:09:16.049907 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:09:16.049907 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:16.049907 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:16.049907 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:16.049907 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:16.049907 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:16.049907 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:16.049907 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:16.049907 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:16.049907 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:16.049907 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:16.049907 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:16.049907 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:16.049907 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:16.049907 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:16.049907 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:16.049907 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:16.050970 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:09:16.050970 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:09:16.050970 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:16.050970 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:16.057080 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 396/797] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:09:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:16.058095 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d330b2d7-adc2-4d58-beb6-70a083193361 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:16.063615 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f98b8b-7679-489b-8371-dfa53816eb81 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:16.081577 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:16.100477 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb7eed0-c07c-45a8-afdc-b43b52f79842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:16.101149 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7eed0-c07c-45a8-afdc-b43b52f79842 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:16.101435 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7eed0-c07c-45a8-afdc-b43b52f79842 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:16.101716 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7eed0-c07c-45a8-afdc-b43b52f79842 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:16.102443 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb7eed0-c07c-45a8-afdc-b43b52f79842 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:16.102752 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb7eed0-c07c-45a8-afdc-b43b52f79842 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:16.104208 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb7eed0-c07c-45a8-afdc-b43b52f79842 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:16.122221 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 402/798] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:09:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:16.123078 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb7eed0-c07c-45a8-afdc-b43b52f79842 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:16.171193 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d330b2d7-adc2-4d58-beb6-70a083193361 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:16.210586 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc94c914-2d0e-4ac5-9635-a206b657fa08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:16.212146 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94c914-2d0e-4ac5-9635-a206b657fa08 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:16.212697 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94c914-2d0e-4ac5-9635-a206b657fa08 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:16.213146 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94c914-2d0e-4ac5-9635-a206b657fa08 None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:16.214267 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc94c914-2d0e-4ac5-9635-a206b657fa08 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:16.215130 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc94c914-2d0e-4ac5-9635-a206b657fa08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:16.216681 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc94c914-2d0e-4ac5-9635-a206b657fa08 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:16.223859 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 397/799] 10.222.0.15 () {56 vars in 1124 bytes} [Tue Jun 21 20:09:16 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:16.224860 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc94c914-2d0e-4ac5-9635-a206b657fa08 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:16.235353 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb7eed0-c07c-45a8-afdc-b43b52f79842 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:16.251242 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:16.283537 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc5df05-f8bb-4e13-90f8-b4f9901fb5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:16.284987 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5df05-f8bb-4e13-90f8-b4f9901fb5ba None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:16.285728 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5df05-f8bb-4e13-90f8-b4f9901fb5ba None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:16.286197 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5df05-f8bb-4e13-90f8-b4f9901fb5ba None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:16.287450 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc5df05-f8bb-4e13-90f8-b4f9901fb5ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:16.287939 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc5df05-f8bb-4e13-90f8-b4f9901fb5ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:16.290511 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc5df05-f8bb-4e13-90f8-b4f9901fb5ba None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:16.312480 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 403/800] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:09:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:16.313123 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc5df05-f8bb-4e13-90f8-b4f9901fb5ba None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:16.354975 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc94c914-2d0e-4ac5-9635-a206b657fa08 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:16.360394 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:16.394866 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c14df9a-fc99-4810-abde-ec5fb1109574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:16.396114 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14df9a-fc99-4810-abde-ec5fb1109574 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:16.396577 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14df9a-fc99-4810-abde-ec5fb1109574 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:16.397133 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14df9a-fc99-4810-abde-ec5fb1109574 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:16.404835 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c14df9a-fc99-4810-abde-ec5fb1109574 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:16.406556 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c14df9a-fc99-4810-abde-ec5fb1109574 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:16.422177 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-8c14df9a-fc99-4810-abde-ec5fb1109574 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:09:16.422177 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:16.422177 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:16.422177 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:16.422177 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:16.422177 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:16.422177 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:16.422177 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:16.422177 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:16.422177 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:16.422177 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:16.422177 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:16.422177 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 20:09:16.422177 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 20:09:16.422177 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 20:09:16.423061 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 20:09:16.423061 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:16.423061 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:16.423061 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:16.423061 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:16.423061 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:16.423061 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:16.423061 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:16.423061 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:16.423061 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:16.423061 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:16.423061 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:16.423061 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:16.423061 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:16.423061 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:16.423061 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:16.423061 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:16.423973 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 20:09:16.423973 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 20:09:16.423973 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 20:09:16.423973 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 20:09:16.423973 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 20:09:16.423973 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 20:09:16.423973 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:09:16.423973 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:16.426943 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 398/801] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jun 21 20:09:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:16.428067 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c14df9a-fc99-4810-abde-ec5fb1109574 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:16.435680 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc5df05-f8bb-4e13-90f8-b4f9901fb5ba None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:16.472256 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb81318-09fd-4d55-8c47-e1134ab10f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:16.472933 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb81318-09fd-4d55-8c47-e1134ab10f6e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:16.473223 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb81318-09fd-4d55-8c47-e1134ab10f6e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:16.473586 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb81318-09fd-4d55-8c47-e1134ab10f6e None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:16.474300 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb81318-09fd-4d55-8c47-e1134ab10f6e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:16.474626 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb81318-09fd-4d55-8c47-e1134ab10f6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:16.476020 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb81318-09fd-4d55-8c47-e1134ab10f6e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:16.481228 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 404/802] 10.222.0.15 () {56 vars in 1124 bytes} [Tue Jun 21 20:09:16 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:16.481828 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb81318-09fd-4d55-8c47-e1134ab10f6e None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:16.517785 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:16.541907 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c14df9a-fc99-4810-abde-ec5fb1109574 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:16.577546 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8825041-6f61-49df-989f-f0451cd455c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:16.578340 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8825041-6f61-49df-989f-f0451cd455c3 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:16.578624 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8825041-6f61-49df-989f-f0451cd455c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:16.578899 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8825041-6f61-49df-989f-f0451cd455c3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:16.586858 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb81318-09fd-4d55-8c47-e1134ab10f6e None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:16.587402 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8825041-6f61-49df-989f-f0451cd455c3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:16.588631 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:16.588813 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8825041-6f61-49df-989f-f0451cd455c3 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:16.603156 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-e8825041-6f61-49df-989f-f0451cd455c3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 20:09:16.603156 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:16.603156 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:16.603156 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:16.603156 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:16.603156 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:16.603156 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:16.603156 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:16.603156 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:16.603156 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:16.603156 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:16.603156 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:16.603156 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 20:09:16.603156 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 20:09:16.603156 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 20:09:16.603156 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 20:09:16.604212 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:16.604212 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:16.604212 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 20:09:16.604212 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:09:16.604212 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 20:09:16.604212 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:09:16.604212 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:16.604212 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:16.604212 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:16.604212 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:16.604212 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:16.604212 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:16.604212 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:16.604212 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:16.604212 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:16.604212 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:16.604212 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:16.604212 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:16.605187 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:16.605187 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:16.605187 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 20:09:16.605187 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 20:09:16.605187 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 20:09:16.605187 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 20:09:16.605187 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 20:09:16.605187 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 20:09:16.605187 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 20:09:16.605187 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:16.605187 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 399/803] 10.222.0.15 () {56 vars in 1093 bytes} [Tue Jun 21 20:09:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:16.605774 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d276d13-ce61-4518-ba2c-e1a5c03fa21c None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:16.605844 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d276d13-ce61-4518-ba2c-e1a5c03fa21c None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:16.606561 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d276d13-ce61-4518-ba2c-e1a5c03fa21c None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:16.607458 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 400/804] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:09:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:09:16.609922 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d276d13-ce61-4518-ba2c-e1a5c03fa21c None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:16.634560 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8bc4fa-32b4-4bef-aa42-58ffe875e297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:16.635345 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8bc4fa-32b4-4bef-aa42-58ffe875e297 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:16.635908 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8bc4fa-32b4-4bef-aa42-58ffe875e297 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:16.636213 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8bc4fa-32b4-4bef-aa42-58ffe875e297 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:16.637029 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8bc4fa-32b4-4bef-aa42-58ffe875e297 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:16.637343 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8bc4fa-32b4-4bef-aa42-58ffe875e297 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:16.638982 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8bc4fa-32b4-4bef-aa42-58ffe875e297 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:16.651419 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 405/805] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jun 21 20:09:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:16.652246 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8bc4fa-32b4-4bef-aa42-58ffe875e297 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:16.723878 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d276d13-ce61-4518-ba2c-e1a5c03fa21c None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:16.756820 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8bc4fa-32b4-4bef-aa42-58ffe875e297 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:16.757425 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e1dcf8-b355-4923-bf5f-25f5586668a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:16.758085 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e1dcf8-b355-4923-bf5f-25f5586668a2 None admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:16.758376 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e1dcf8-b355-4923-bf5f-25f5586668a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:16.758656 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e1dcf8-b355-4923-bf5f-25f5586668a2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:16.759398 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e1dcf8-b355-4923-bf5f-25f5586668a2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:16.760790 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e1dcf8-b355-4923-bf5f-25f5586668a2 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:16.765064 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:16.781008 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 401/806] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Jun 21 20:09:16 2022] POST /identity/v3/endpoints => generated 346 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:09:16.782699 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95a2de-714c-413f-9960-7b6528fc5e3b None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:16.782999 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95a2de-714c-413f-9960-7b6528fc5e3b None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:16.783285 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95a2de-714c-413f-9960-7b6528fc5e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:16.797035 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f09bcdd-4545-4fa6-be00-2892c37ccceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:16.797739 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09bcdd-4545-4fa6-be00-2892c37ccceb None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:16.798037 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09bcdd-4545-4fa6-be00-2892c37ccceb None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:16.798303 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09bcdd-4545-4fa6-be00-2892c37ccceb None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:16.799178 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f09bcdd-4545-4fa6-be00-2892c37ccceb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:16.799495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f09bcdd-4545-4fa6-be00-2892c37ccceb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:16.801050 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f09bcdd-4545-4fa6-be00-2892c37ccceb None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:16.812617 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-0f95a2de-714c-413f-9960-7b6528fc5e3b None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:09:16.813022 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-0f95a2de-714c-413f-9960-7b6528fc5e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:09:16.822015 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 406/807] 10.222.0.15 () {56 vars in 1133 bytes} [Tue Jun 21 20:09:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:16.823006 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f09bcdd-4545-4fa6-be00-2892c37ccceb None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:16.848806 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:16.898366 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 402/808] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:09:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 20:09:16.900204 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d9a78-060a-44e9-a375-94a4037c34ab None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:16.900496 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d9a78-060a-44e9-a375-94a4037c34ab None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:16.900774 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d9a78-060a-44e9-a375-94a4037c34ab None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:16.902122 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 403/809] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:09:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:09:16.904176 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d9a78-060a-44e9-a375-94a4037c34ab None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:16.957664 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f09bcdd-4545-4fa6-be00-2892c37ccceb None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:16.995459 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f75a72b-7307-4ead-9ee7-274a0ebb7206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:16.996307 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75a72b-7307-4ead-9ee7-274a0ebb7206 None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:16.996593 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75a72b-7307-4ead-9ee7-274a0ebb7206 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:16.996874 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75a72b-7307-4ead-9ee7-274a0ebb7206 None admin] PATH_INFO: `/v3/projects/4dcb71ef7b6e49148edd61a1eb8da7bb/users/038537bd12174154ba259e097b97b8bd/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:16.998872 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f75a72b-7307-4ead-9ee7-274a0ebb7206 None admin] RBAC: Authorizing `identity:create_grant(project_id=4dcb71ef7b6e49148edd61a1eb8da7bb, user_id=038537bd12174154ba259e097b97b8bd, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:17.000337 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f75a72b-7307-4ead-9ee7-274a0ebb7206 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:17.013287 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 407/810] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Jun 21 20:09:16 2022] PUT /identity/v3/projects/4dcb71ef7b6e49148edd61a1eb8da7bb/users/038537bd12174154ba259e097b97b8bd/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:09:17.014518 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e4276-db5f-4619-ae71-0ef450561c03 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:17.014810 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e4276-db5f-4619-ae71-0ef450561c03 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:17.015092 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e4276-db5f-4619-ae71-0ef450561c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:17.037651 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d9a78-060a-44e9-a375-94a4037c34ab None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:17.040135 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f89e4276-db5f-4619-ae71-0ef450561c03 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:09:17.042702 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f89e4276-db5f-4619-ae71-0ef450561c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:09:17.065506 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:17.079782 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f345a-38e2-4645-b6a1-15125ce51dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:17.081089 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f345a-38e2-4645-b6a1-15125ce51dd4 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:17.081552 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f345a-38e2-4645-b6a1-15125ce51dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:17.082050 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f345a-38e2-4645-b6a1-15125ce51dd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:17.151951 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 408/811] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:09:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 20:09:17.151951 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e4276-db5f-4619-ae71-0ef450561c03 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:17.157697 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:17.183846 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17f345a-38e2-4645-b6a1-15125ce51dd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:17.185743 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17f345a-38e2-4645-b6a1-15125ce51dd4 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:17.280954 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e4276-db5f-4619-ae71-0ef450561c03 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:17.311310 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 404/812] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:09:16 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 20:09:17.312802 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f345a-38e2-4645-b6a1-15125ce51dd4 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:17.325913 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ef2719-9ff7-40c7-8cd1-bead42c195c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:17.327009 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef2719-9ff7-40c7-8cd1-bead42c195c3 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:17.327300 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef2719-9ff7-40c7-8cd1-bead42c195c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:17.327583 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef2719-9ff7-40c7-8cd1-bead42c195c3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:17.340069 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:17.342323 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ef2719-9ff7-40c7-8cd1-bead42c195c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:09:17.351454 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-51ef2719-9ff7-40c7-8cd1-bead42c195c3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 20:09:17.351454 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:17.351454 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:17.351454 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:17.351454 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:17.351454 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:17.351454 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:17.351454 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:17.351454 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:17.351454 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:17.351454 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:17.351454 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:17.351454 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:09:17.351454 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:09:17.351454 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:09:17.351454 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:09:17.352711 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:09:17.352711 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:09:17.352711 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:09:17.352711 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:09:17.352711 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:17.352711 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:17.352711 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:17.352711 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:17.352711 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:17.352711 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:17.352711 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:17.352711 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:17.352711 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:17.352711 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:17.352711 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:17.352711 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:17.353556 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:17.353556 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:17.353556 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:17.353556 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:17.353556 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:09:17.353556 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:09:17.353556 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:09:17.353556 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:09:17.353556 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:09:17.353556 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:09:17.353556 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 20:09:17.353556 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:17.353556 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 409/813] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Jun 21 20:09:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:17.354255 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ef2719-9ff7-40c7-8cd1-bead42c195c3 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:17.423375 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:17.443470 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f345a-38e2-4645-b6a1-15125ce51dd4 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:17.464296 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ef2719-9ff7-40c7-8cd1-bead42c195c3 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:17.493114 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1919b506-80e4-45b6-ba46-2e9d1037c309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:17.494504 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919b506-80e4-45b6-ba46-2e9d1037c309 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:17.494999 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919b506-80e4-45b6-ba46-2e9d1037c309 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:17.495827 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919b506-80e4-45b6-ba46-2e9d1037c309 None admin] PATH_INFO: `/v3/services/network` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:17.496957 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1919b506-80e4-45b6-ba46-2e9d1037c309 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:17.498529 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1919b506-80e4-45b6-ba46-2e9d1037c309 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:17.500572 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8321e33f-02d3-4689-9293-e10f50c0b7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:17.501555 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321e33f-02d3-4689-9293-e10f50c0b7a1 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:17.501972 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321e33f-02d3-4689-9293-e10f50c0b7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:17.502217 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321e33f-02d3-4689-9293-e10f50c0b7a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:17.513948 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-1919b506-80e4-45b6-ba46-2e9d1037c309 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 20:09:17.513948 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:17.513948 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 20:09:17.513948 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 20:09:17.513948 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 20:09:17.513948 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 20:09:17.513948 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 20:09:17.513948 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 20:09:17.513948 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 20:09:17.513948 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:17.513948 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 20:09:17.513948 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:17.513948 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:17.513948 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:17.513948 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:17.513948 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:17.513948 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:17.514932 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:17.514932 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:17.514932 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:17.514932 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:17.514932 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:17.514932 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:17.514932 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 20:09:17.514932 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 20:09:17.514932 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 20:09:17.514932 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 20:09:17.514932 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:17.514932 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:17.514932 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:17.514932 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:17.514932 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:17.514932 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:17.515791 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:17.515791 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:17.515791 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:17.515791 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:17.515791 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:17.515791 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:17.515791 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:17.515791 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:17.515791 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:17.515791 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:17.515791 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 20:09:17.515791 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 20:09:17.515791 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 20:09:17.515791 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:17.516593 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8321e33f-02d3-4689-9293-e10f50c0b7a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:17.516593 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8321e33f-02d3-4689-9293-e10f50c0b7a1 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:17.517707 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 405/814] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jun 21 20:09:17 2022] GET /identity/v3/services/network => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:17.519629 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1919b506-80e4-45b6-ba46-2e9d1037c309 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:17.543757 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-8321e33f-02d3-4689-9293-e10f50c0b7a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:17.543757 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:17.543757 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:17.543757 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:17.543757 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:17.543757 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:17.543757 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:17.543757 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:17.543757 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:17.543757 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:17.543757 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:17.543757 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:17.543757 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:09:17.543757 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:09:17.543757 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:09:17.544966 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:09:17.544966 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:17.544966 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:17.544966 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:17.544966 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:17.544966 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:17.544966 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:17.544966 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:17.544966 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:17.544966 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:17.544966 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:17.544966 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:17.544966 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:17.544966 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:17.544966 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:17.544966 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:17.544966 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:17.545862 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:09:17.545862 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:09:17.545862 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:17.545862 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:17.549121 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 410/815] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:09:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:17.550767 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8321e33f-02d3-4689-9293-e10f50c0b7a1 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:17.636431 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:17.656612 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1919b506-80e4-45b6-ba46-2e9d1037c309 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:17.684427 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8321e33f-02d3-4689-9293-e10f50c0b7a1 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:17.703566 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428541ad-3a45-4629-92f1-34d389d6a092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:17.704497 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428541ad-3a45-4629-92f1-34d389d6a092 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:17.704679 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:17.705375 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428541ad-3a45-4629-92f1-34d389d6a092 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:17.705814 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428541ad-3a45-4629-92f1-34d389d6a092 None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:17.706741 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428541ad-3a45-4629-92f1-34d389d6a092 None admin] RBAC: Adding query filter params (name=service) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:17.707204 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428541ad-3a45-4629-92f1-34d389d6a092 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:17.709831 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428541ad-3a45-4629-92f1-34d389d6a092 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:17.721301 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 406/816] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Jun 21 20:09:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:17.722320 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428541ad-3a45-4629-92f1-34d389d6a092 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:17.733567 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b417e17d-e277-4ef9-8258-2e180a5eef0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:17.734508 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417e17d-e277-4ef9-8258-2e180a5eef0a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:17.734798 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417e17d-e277-4ef9-8258-2e180a5eef0a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:17.735080 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417e17d-e277-4ef9-8258-2e180a5eef0a None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:17.735802 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b417e17d-e277-4ef9-8258-2e180a5eef0a None admin] RBAC: Adding query filter params (name=network) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:17.736140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b417e17d-e277-4ef9-8258-2e180a5eef0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:17.737663 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b417e17d-e277-4ef9-8258-2e180a5eef0a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:17.743370 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 411/817] 10.222.0.15 () {56 vars in 1112 bytes} [Tue Jun 21 20:09:17 2022] GET /identity/v3/services?name=network => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:17.744332 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b417e17d-e277-4ef9-8258-2e180a5eef0a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:17.853576 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428541ad-3a45-4629-92f1-34d389d6a092 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:17.856998 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b417e17d-e277-4ef9-8258-2e180a5eef0a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:17.894010 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c256a42e-91ac-4ffa-984e-fbcb7a345595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:17.894587 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256a42e-91ac-4ffa-984e-fbcb7a345595 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:17.894877 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256a42e-91ac-4ffa-984e-fbcb7a345595 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:17.895184 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256a42e-91ac-4ffa-984e-fbcb7a345595 None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:17.896132 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c256a42e-91ac-4ffa-984e-fbcb7a345595 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:17.896447 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c256a42e-91ac-4ffa-984e-fbcb7a345595 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:17.898273 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c256a42e-91ac-4ffa-984e-fbcb7a345595 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:17.899287 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04116370-c790-4fcf-b0c3-5bf41fd0814e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:17.900460 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04116370-c790-4fcf-b0c3-5bf41fd0814e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:17.901341 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04116370-c790-4fcf-b0c3-5bf41fd0814e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:17.901778 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04116370-c790-4fcf-b0c3-5bf41fd0814e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:17.914897 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04116370-c790-4fcf-b0c3-5bf41fd0814e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:17.915662 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 407/818] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:09:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:17.916667 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c256a42e-91ac-4ffa-984e-fbcb7a345595 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:17.917260 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04116370-c790-4fcf-b0c3-5bf41fd0814e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:17.928474 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:17.937185 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-04116370-c790-4fcf-b0c3-5bf41fd0814e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:17.937185 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:17.937185 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:17.937185 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:17.937185 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:17.937185 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:17.937185 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:17.937185 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:17.937185 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:17.937185 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:17.937185 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:17.937185 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:17.937185 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:09:17.937185 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:09:17.937185 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:09:17.938282 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:09:17.938282 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:17.938282 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:17.938282 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:17.938282 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:17.938282 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:17.938282 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:17.938282 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:17.938282 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:17.938282 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:17.938282 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:17.938282 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:17.938282 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:17.938282 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:17.938282 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:17.938282 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:17.938282 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:17.939195 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:09:17.939195 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:09:17.939195 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:17.939195 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:17.941319 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 412/819] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:09:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:17.942867 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04116370-c790-4fcf-b0c3-5bf41fd0814e None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:17.988693 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:18.029417 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c256a42e-91ac-4ffa-984e-fbcb7a345595 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:18.065526 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ebc87-7a21-4315-abf8-7965934bcb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:18.066191 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ebc87-7a21-4315-abf8-7965934bcb8a None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:18.066480 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ebc87-7a21-4315-abf8-7965934bcb8a None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:18.066759 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ebc87-7a21-4315-abf8-7965934bcb8a None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:18.068058 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301ebc87-7a21-4315-abf8-7965934bcb8a None admin] RBAC: Adding query filter params (type=network) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:18.068373 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301ebc87-7a21-4315-abf8-7965934bcb8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:18.069732 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301ebc87-7a21-4315-abf8-7965934bcb8a None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:18.070670 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04116370-c790-4fcf-b0c3-5bf41fd0814e None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:18.075146 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 408/820] 10.222.0.15 () {56 vars in 1112 bytes} [Tue Jun 21 20:09:17 2022] GET /identity/v3/services?type=network => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:18.076122 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ebc87-7a21-4315-abf8-7965934bcb8a None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:18.113167 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cec9a8-2aa2-4b1d-b0f0-5429abb4d7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:18.114929 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cec9a8-2aa2-4b1d-b0f0-5429abb4d7f9 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:18.115289 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cec9a8-2aa2-4b1d-b0f0-5429abb4d7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:18.116543 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cec9a8-2aa2-4b1d-b0f0-5429abb4d7f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:18.124516 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cec9a8-2aa2-4b1d-b0f0-5429abb4d7f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:18.125970 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cec9a8-2aa2-4b1d-b0f0-5429abb4d7f9 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:18.148600 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-f0cec9a8-2aa2-4b1d-b0f0-5429abb4d7f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:09:18.148600 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:18.148600 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:18.148600 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:18.148600 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:18.148600 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:18.148600 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:18.148600 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:18.148600 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:18.148600 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:18.148600 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:18.148600 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:18.148600 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 20:09:18.148600 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 20:09:18.148600 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 20:09:18.149637 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 20:09:18.149637 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:18.149637 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:18.149637 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:18.149637 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:18.149637 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:18.149637 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:18.149637 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:18.149637 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:18.149637 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:18.149637 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:18.149637 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:18.149637 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:18.149637 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:18.149637 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:18.149637 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:18.149637 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:18.150527 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 20:09:18.150527 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 20:09:18.150527 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 20:09:18.150527 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 20:09:18.150527 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 20:09:18.150527 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 20:09:18.150527 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:09:18.150527 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:18.157823 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 413/821] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jun 21 20:09:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:18.157823 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cec9a8-2aa2-4b1d-b0f0-5429abb4d7f9 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:18.168946 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:18.212230 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ebc87-7a21-4315-abf8-7965934bcb8a None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:18.261197 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671767f5-50b4-485c-b5eb-bb60674922a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:18.261929 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671767f5-50b4-485c-b5eb-bb60674922a2 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:18.262228 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671767f5-50b4-485c-b5eb-bb60674922a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:18.262516 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671767f5-50b4-485c-b5eb-bb60674922a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:18.263469 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671767f5-50b4-485c-b5eb-bb60674922a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:18.263791 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671767f5-50b4-485c-b5eb-bb60674922a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:18.265481 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671767f5-50b4-485c-b5eb-bb60674922a2 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:18.273495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:18.284410 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 409/822] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:09:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:18.284410 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671767f5-50b4-485c-b5eb-bb60674922a2 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:18.286573 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cec9a8-2aa2-4b1d-b0f0-5429abb4d7f9 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:18.323897 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfaa2a4-50ab-4a05-86c7-8108b583215e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:18.324989 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfaa2a4-50ab-4a05-86c7-8108b583215e None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:18.325517 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfaa2a4-50ab-4a05-86c7-8108b583215e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:18.326172 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfaa2a4-50ab-4a05-86c7-8108b583215e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:18.327107 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfaa2a4-50ab-4a05-86c7-8108b583215e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:18.328711 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfaa2a4-50ab-4a05-86c7-8108b583215e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:18.351442 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 414/823] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Jun 21 20:09:18 2022] POST /identity/v3/endpoints => generated 327 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:09:18.352905 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfaa2a4-50ab-4a05-86c7-8108b583215e None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:18.423344 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671767f5-50b4-485c-b5eb-bb60674922a2 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:18.468176 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:18.505004 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfaa2a4-50ab-4a05-86c7-8108b583215e None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:18.514731 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329fbbb4-d8bf-4f33-9a77-a06b733e4490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:18.515739 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329fbbb4-d8bf-4f33-9a77-a06b733e4490 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:18.516270 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329fbbb4-d8bf-4f33-9a77-a06b733e4490 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:18.516770 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329fbbb4-d8bf-4f33-9a77-a06b733e4490 None admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:18.517824 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329fbbb4-d8bf-4f33-9a77-a06b733e4490 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:18.518349 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329fbbb4-d8bf-4f33-9a77-a06b733e4490 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:18.520443 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329fbbb4-d8bf-4f33-9a77-a06b733e4490 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:18.547638 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 410/824] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jun 21 20:09:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:18.552443 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329fbbb4-d8bf-4f33-9a77-a06b733e4490 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:18.573264 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a22814-e08f-4abf-80ff-71e7a3b608a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:18.574190 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a22814-e08f-4abf-80ff-71e7a3b608a4 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:18.574480 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a22814-e08f-4abf-80ff-71e7a3b608a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:18.574854 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a22814-e08f-4abf-80ff-71e7a3b608a4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:18.583729 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a22814-e08f-4abf-80ff-71e7a3b608a4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:18.585439 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a22814-e08f-4abf-80ff-71e7a3b608a4 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:18.605780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-d1a22814-e08f-4abf-80ff-71e7a3b608a4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 20:09:18.605780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:18.605780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:18.605780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:18.605780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:18.605780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:18.605780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:18.605780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:18.605780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:18.605780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:18.605780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:18.605780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:18.605780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 20:09:18.605780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 20:09:18.605780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 20:09:18.605780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 20:09:18.606776 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:18.606776 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:18.606776 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 20:09:18.606776 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:09:18.606776 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 20:09:18.606776 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:09:18.606776 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:18.606776 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:18.606776 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:18.606776 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:18.606776 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:18.606776 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:18.606776 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:18.606776 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:18.606776 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:18.606776 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:18.606776 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:18.606776 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:18.607723 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:18.607723 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:18.607723 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 20:09:18.607723 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 20:09:18.607723 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 20:09:18.607723 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 20:09:18.607723 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 20:09:18.607723 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 20:09:18.607723 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 20:09:18.607723 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:18.607723 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 415/825] 10.222.0.15 () {56 vars in 1117 bytes} [Tue Jun 21 20:09:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:18.616949 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a22814-e08f-4abf-80ff-71e7a3b608a4 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:18.631870 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:18.681127 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329fbbb4-d8bf-4f33-9a77-a06b733e4490 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:18.718793 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc0ef3-cc83-4e21-a2d0-40a56ac9a818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:18.719792 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc0ef3-cc83-4e21-a2d0-40a56ac9a818 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:18.720246 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc0ef3-cc83-4e21-a2d0-40a56ac9a818 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:18.720674 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc0ef3-cc83-4e21-a2d0-40a56ac9a818 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:18.721721 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfc0ef3-cc83-4e21-a2d0-40a56ac9a818 None admin] RBAC: Adding query filter params (role.id=1f5332f48d9e4c2aac866d0d546c94d5, scope.project.id=4dcb71ef7b6e49148edd61a1eb8da7bb, user.id=3918fe05c8634bc39f3e295374701465) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:18.722286 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfc0ef3-cc83-4e21-a2d0-40a56ac9a818 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:18.724596 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfc0ef3-cc83-4e21-a2d0-40a56ac9a818 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:18.731818 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 411/826] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jun 21 20:09:18 2022] GET /identity/v3/role_assignments?user.id=3918fe05c8634bc39f3e295374701465&scope.project.id=4dcb71ef7b6e49148edd61a1eb8da7bb&role.id=1f5332f48d9e4c2aac866d0d546c94d5 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:09:18.743552 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a22814-e08f-4abf-80ff-71e7a3b608a4 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:18.782799 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7d0b38-63d7-4fd1-afee-8625a03374a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:18.783600 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d0b38-63d7-4fd1-afee-8625a03374a8 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:18.783987 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d0b38-63d7-4fd1-afee-8625a03374a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:18.784343 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d0b38-63d7-4fd1-afee-8625a03374a8 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:18.785295 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7d0b38-63d7-4fd1-afee-8625a03374a8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:18.785762 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7d0b38-63d7-4fd1-afee-8625a03374a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:18.787843 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7d0b38-63d7-4fd1-afee-8625a03374a8 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:18.808459 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 416/827] 10.222.0.15 () {56 vars in 1149 bytes} [Tue Jun 21 20:09:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:18.814076 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc0ef3-cc83-4e21-a2d0-40a56ac9a818 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:18.880486 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:18.935781 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc0ef3-cc83-4e21-a2d0-40a56ac9a818 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:18.972551 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e22c72c-28cf-4c9b-8c40-0528e5beb9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:18.973735 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e22c72c-28cf-4c9b-8c40-0528e5beb9b7 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:18.974157 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e22c72c-28cf-4c9b-8c40-0528e5beb9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:18.974604 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e22c72c-28cf-4c9b-8c40-0528e5beb9b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:18.976682 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032fdd27-378c-4962-b602-1d67e5c8957f None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:18.976986 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032fdd27-378c-4962-b602-1d67e5c8957f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:18.977276 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032fdd27-378c-4962-b602-1d67e5c8957f None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:18.978648 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 417/828] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:09:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:09:18.984868 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ee4ff-61de-49b3-8fc2-e09528ae5c3c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:18.985247 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ee4ff-61de-49b3-8fc2-e09528ae5c3c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:18.985991 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ee4ff-61de-49b3-8fc2-e09528ae5c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:18.987819 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e22c72c-28cf-4c9b-8c40-0528e5beb9b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:18.989531 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e22c72c-28cf-4c9b-8c40-0528e5beb9b7 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:19.006645 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-2e8ee4ff-61de-49b3-8fc2-e09528ae5c3c None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:09:19.007828 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-0e22c72c-28cf-4c9b-8c40-0528e5beb9b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:19.007828 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:19.007828 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:19.007828 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:19.007828 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:19.007828 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:19.007828 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:19.007828 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:19.007828 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:19.007828 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:19.007828 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:19.007828 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:19.007828 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:09:19.007828 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:09:19.007828 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:09:19.008703 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:09:19.008703 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:19.008703 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:19.008703 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:19.008703 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:19.008703 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:19.008703 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:19.008703 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:19.008703 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:19.008703 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:19.008703 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:19.008703 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:19.008703 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:19.008703 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:19.008703 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:19.008703 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:19.008703 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:19.009589 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:09:19.009589 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:09:19.009589 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:19.009589 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:19.009808 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2e8ee4ff-61de-49b3-8fc2-e09528ae5c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:09:19.011495 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 412/829] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:09:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:19.016638 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e22c72c-28cf-4c9b-8c40-0528e5beb9b7 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:19.092307 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:19.103368 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 418/830] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:09:18 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 20:09:19.120745 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ee4ff-61de-49b3-8fc2-e09528ae5c3c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:19.131403 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e22c72c-28cf-4c9b-8c40-0528e5beb9b7 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:19.134381 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:19.176336 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12723dbc-8c54-432e-a809-1b4f4fab01c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:19.177432 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12723dbc-8c54-432e-a809-1b4f4fab01c7 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:19.177761 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12723dbc-8c54-432e-a809-1b4f4fab01c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:19.178049 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12723dbc-8c54-432e-a809-1b4f4fab01c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:19.179063 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12723dbc-8c54-432e-a809-1b4f4fab01c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:19.179374 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12723dbc-8c54-432e-a809-1b4f4fab01c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:19.180936 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12723dbc-8c54-432e-a809-1b4f4fab01c7 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:19.201417 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 413/831] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:09:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:09:19.202887 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12723dbc-8c54-432e-a809-1b4f4fab01c7 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:19.239447 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ee4ff-61de-49b3-8fc2-e09528ae5c3c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:19.277845 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba4d9bd-b218-4b38-9c59-de578110f3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:19.279089 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4d9bd-b218-4b38-9c59-de578110f3df None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:19.279522 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4d9bd-b218-4b38-9c59-de578110f3df None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:19.279810 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4d9bd-b218-4b38-9c59-de578110f3df None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:19.280495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba4d9bd-b218-4b38-9c59-de578110f3df None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:19.281852 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba4d9bd-b218-4b38-9c59-de578110f3df None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:19.293699 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-eba4d9bd-b218-4b38-9c59-de578110f3df None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 20:09:19.293699 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:19.293699 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 20:09:19.293699 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 20:09:19.293699 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 20:09:19.293699 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 20:09:19.293699 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 20:09:19.293699 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 20:09:19.293699 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 20:09:19.293699 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:19.293699 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 20:09:19.293699 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:19.293699 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:19.293699 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:19.293699 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:19.293699 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:19.293699 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:19.294782 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:19.294782 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:19.294782 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:19.294782 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:19.294782 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:19.294782 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:19.294782 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 20:09:19.294782 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 20:09:19.294782 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 20:09:19.294782 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 20:09:19.294782 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:19.294782 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:19.294782 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:19.294782 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:19.294782 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:19.294782 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:19.295656 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:19.295656 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:19.295656 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:19.295656 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:19.295656 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:19.295656 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:19.295656 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:19.295656 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:19.295656 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:19.295656 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:19.295656 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 20:09:19.295656 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 20:09:19.295656 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 20:09:19.295656 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:19.295656 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 419/832] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Jun 21 20:09:19 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:09:19.297061 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5adbafb-d412-4365-b82b-70d632df5f22 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:19.297061 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5adbafb-d412-4365-b82b-70d632df5f22 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:19.297061 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5adbafb-d412-4365-b82b-70d632df5f22 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:19.302601 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 420/833] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:09:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:09:19.302601 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5adbafb-d412-4365-b82b-70d632df5f22 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:19.324256 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12723dbc-8c54-432e-a809-1b4f4fab01c7 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:19.359067 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebfaa4d-543f-4c93-a44a-e860c777db78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:19.360142 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfaa4d-543f-4c93-a44a-e860c777db78 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:19.360431 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfaa4d-543f-4c93-a44a-e860c777db78 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:19.360711 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfaa4d-543f-4c93-a44a-e860c777db78 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:19.367868 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:19.368087 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebfaa4d-543f-4c93-a44a-e860c777db78 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:19.369603 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebfaa4d-543f-4c93-a44a-e860c777db78 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:19.383803 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-7ebfaa4d-543f-4c93-a44a-e860c777db78 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:09:19.383803 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:19.383803 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:19.383803 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:19.383803 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:19.383803 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:19.383803 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:19.383803 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:19.383803 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:19.383803 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:19.383803 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:19.383803 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:19.383803 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 20:09:19.383803 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 20:09:19.383803 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 20:09:19.384730 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 20:09:19.384730 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:19.384730 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:19.384730 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:19.384730 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:19.384730 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:19.384730 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:19.384730 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:19.384730 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:19.384730 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:19.384730 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:19.384730 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:19.384730 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:19.384730 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:19.384730 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:19.384730 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:19.384730 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:19.385629 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 20:09:19.385629 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 20:09:19.385629 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 20:09:19.385629 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 20:09:19.385629 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 20:09:19.385629 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 20:09:19.385629 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:09:19.385629 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:19.385629 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 414/834] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jun 21 20:09:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:09:19.386626 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f9810-b865-4318-a516-5fd8190093b9 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:19.386899 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f9810-b865-4318-a516-5fd8190093b9 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:19.387179 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f9810-b865-4318-a516-5fd8190093b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:19.403279 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-3f1f9810-b865-4318-a516-5fd8190093b9 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:09:19.404485 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-3f1f9810-b865-4318-a516-5fd8190093b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:09:19.418114 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5adbafb-d412-4365-b82b-70d632df5f22 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:19.423323 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:19.455455 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe13ee1-ea19-4f0e-98c3-18ec802147f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:19.456126 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe13ee1-ea19-4f0e-98c3-18ec802147f3 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:19.456411 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe13ee1-ea19-4f0e-98c3-18ec802147f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:19.456981 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe13ee1-ea19-4f0e-98c3-18ec802147f3 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:19.457466 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe13ee1-ea19-4f0e-98c3-18ec802147f3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:19.457831 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe13ee1-ea19-4f0e-98c3-18ec802147f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:19.459192 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe13ee1-ea19-4f0e-98c3-18ec802147f3 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:19.468096 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 421/835] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Jun 21 20:09:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:19.468096 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe13ee1-ea19-4f0e-98c3-18ec802147f3 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:19.480612 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 415/836] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:09:19 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 20:09:19.481449 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f9810-b865-4318-a516-5fd8190093b9 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:19.582959 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f9810-b865-4318-a516-5fd8190093b9 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:19.584505 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe13ee1-ea19-4f0e-98c3-18ec802147f3 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:19.607730 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:19.620984 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e097953-8ecf-4d82-b401-618ab8d01977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:19.621646 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e097953-8ecf-4d82-b401-618ab8d01977 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:19.621917 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e05cb5-2e29-4150-9a80-b54ee5fefac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:19.622030 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e097953-8ecf-4d82-b401-618ab8d01977 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:19.622203 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e097953-8ecf-4d82-b401-618ab8d01977 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:19.622578 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e05cb5-2e29-4150-9a80-b54ee5fefac8 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:19.622861 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e05cb5-2e29-4150-9a80-b54ee5fefac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:19.623014 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e097953-8ecf-4d82-b401-618ab8d01977 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:19.623161 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e05cb5-2e29-4150-9a80-b54ee5fefac8 None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:19.623319 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e097953-8ecf-4d82-b401-618ab8d01977 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:19.623884 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e05cb5-2e29-4150-9a80-b54ee5fefac8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:19.624272 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e05cb5-2e29-4150-9a80-b54ee5fefac8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:19.624771 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e097953-8ecf-4d82-b401-618ab8d01977 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:19.625621 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e05cb5-2e29-4150-9a80-b54ee5fefac8 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:19.640311 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 416/837] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Jun 21 20:09:19 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:19.640311 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e05cb5-2e29-4150-9a80-b54ee5fefac8 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:19.647280 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 422/838] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jun 21 20:09:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:19.652979 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e097953-8ecf-4d82-b401-618ab8d01977 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:19.667231 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:19.767962 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e05cb5-2e29-4150-9a80-b54ee5fefac8 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:19.770029 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e097953-8ecf-4d82-b401-618ab8d01977 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:19.810567 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f271ae0-1293-4fff-a734-fff6bab56073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:19.811725 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f271ae0-1293-4fff-a734-fff6bab56073 None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:19.812231 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f271ae0-1293-4fff-a734-fff6bab56073 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:19.812515 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f271ae0-1293-4fff-a734-fff6bab56073 None admin] PATH_INFO: `/v3/projects/4dcb71ef7b6e49148edd61a1eb8da7bb/users/5cf067b8833f4596a1b91073a66768f0/roles/a4929ef60a294190b2d59e8d61e05063` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:19.814508 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f74843-a997-4633-9975-6623a333680e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:19.815948 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f74843-a997-4633-9975-6623a333680e None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:19.816447 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f74843-a997-4633-9975-6623a333680e None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:19.816795 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f74843-a997-4633-9975-6623a333680e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:19.830611 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f74843-a997-4633-9975-6623a333680e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:09:19.836057 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f271ae0-1293-4fff-a734-fff6bab56073 None admin] RBAC: Authorizing `identity:create_grant(project_id=4dcb71ef7b6e49148edd61a1eb8da7bb, user_id=5cf067b8833f4596a1b91073a66768f0, role_id=a4929ef60a294190b2d59e8d61e05063)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:19.837744 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f271ae0-1293-4fff-a734-fff6bab56073 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:19.838543 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-43f74843-a997-4633-9975-6623a333680e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 20:09:19.838543 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:19.838543 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:19.838543 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:19.838543 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:19.838543 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:19.838543 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:19.838543 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:19.838543 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:19.838543 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:19.838543 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:19.838543 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:19.838543 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:09:19.838543 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:09:19.838543 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:09:19.838543 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:09:19.839476 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:09:19.839476 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:09:19.839476 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:09:19.839476 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:09:19.839476 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:19.839476 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:19.839476 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:19.839476 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:19.839476 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:19.839476 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:19.839476 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:19.839476 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:19.839476 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:19.839476 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:19.839476 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:19.839476 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:19.841730 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:19.841730 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:19.841730 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:19.841730 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:19.841730 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:09:19.841730 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:09:19.841730 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:09:19.841730 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:09:19.841730 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:09:19.841730 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:09:19.841730 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 20:09:19.841730 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:19.841730 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 417/839] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jun 21 20:09:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:19.847511 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f74843-a997-4633-9975-6623a333680e None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:19.860140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 423/840] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Jun 21 20:09:19 2022] PUT /identity/v3/projects/4dcb71ef7b6e49148edd61a1eb8da7bb/users/5cf067b8833f4596a1b91073a66768f0/roles/a4929ef60a294190b2d59e8d61e05063 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:09:19.950566 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:19.975948 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f74843-a997-4633-9975-6623a333680e None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:20.017126 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf2249f-0bba-43aa-b033-e98304534275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:20.018166 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2249f-0bba-43aa-b033-e98304534275 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:20.018624 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2249f-0bba-43aa-b033-e98304534275 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:20.019055 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2249f-0bba-43aa-b033-e98304534275 None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:20.020045 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf2249f-0bba-43aa-b033-e98304534275 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:20.020509 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf2249f-0bba-43aa-b033-e98304534275 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:20.022156 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf2249f-0bba-43aa-b033-e98304534275 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:20.032188 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 418/841] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:09:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:20.038279 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f271ae0-1293-4fff-a734-fff6bab56073 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:20.076489 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:20.150687 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f271ae0-1293-4fff-a734-fff6bab56073 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:20.185445 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315725b6-f4c5-4ae0-a6c5-2b83e2af8dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:20.186253 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315725b6-f4c5-4ae0-a6c5-2b83e2af8dda None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:20.186537 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315725b6-f4c5-4ae0-a6c5-2b83e2af8dda None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:20.186815 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315725b6-f4c5-4ae0-a6c5-2b83e2af8dda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:20.196821 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315725b6-f4c5-4ae0-a6c5-2b83e2af8dda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:20.198312 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315725b6-f4c5-4ae0-a6c5-2b83e2af8dda None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:20.217435 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-315725b6-f4c5-4ae0-a6c5-2b83e2af8dda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:20.217435 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:20.217435 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:20.217435 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:20.217435 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:20.217435 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:20.217435 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:20.217435 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:20.217435 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:20.217435 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:20.217435 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:20.217435 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:20.217435 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:09:20.217435 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:09:20.217435 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:09:20.218347 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:09:20.218347 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:20.218347 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:20.218347 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:20.218347 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:20.218347 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:20.218347 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:20.218347 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:20.218347 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:20.218347 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:20.218347 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:20.218347 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:20.218347 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:20.218347 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:20.218347 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:20.218347 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:20.218347 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:20.219325 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:09:20.219325 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:09:20.219325 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:20.219325 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:20.219325 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 424/842] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:09:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:09:20.225019 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf2249f-0bba-43aa-b033-e98304534275 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:20.327732 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf2249f-0bba-43aa-b033-e98304534275 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:20.363012 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa6e30-0159-4b4a-8743-e42347a0c88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:20.363687 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa6e30-0159-4b4a-8743-e42347a0c88a None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:20.364043 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa6e30-0159-4b4a-8743-e42347a0c88a None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:20.364328 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa6e30-0159-4b4a-8743-e42347a0c88a None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:20.365060 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fa6e30-0159-4b4a-8743-e42347a0c88a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:20.365375 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fa6e30-0159-4b4a-8743-e42347a0c88a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:20.366759 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fa6e30-0159-4b4a-8743-e42347a0c88a None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:20.379098 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 419/843] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:09:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:20.379723 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:20.384674 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315725b6-f4c5-4ae0-a6c5-2b83e2af8dda None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:20.471182 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:20.492721 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315725b6-f4c5-4ae0-a6c5-2b83e2af8dda None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:20.529099 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a71216-2909-45bf-97a0-706593018882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:20.530255 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a71216-2909-45bf-97a0-706593018882 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:20.530778 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a71216-2909-45bf-97a0-706593018882 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:20.531270 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a71216-2909-45bf-97a0-706593018882 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:20.541118 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a71216-2909-45bf-97a0-706593018882 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:20.542566 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a71216-2909-45bf-97a0-706593018882 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:20.556969 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-c0a71216-2909-45bf-97a0-706593018882 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 21 20:09:20.556969 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:20.556969 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:20.556969 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:20.556969 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:20.556969 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:20.556969 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:20.556969 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:20.556969 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:20.556969 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:20.556969 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:20.556969 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:20.556969 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 20:09:20.556969 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 20:09:20.556969 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 20:09:20.556969 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 20:09:20.557925 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:20.557925 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:20.557925 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 20:09:20.557925 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:09:20.557925 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 20:09:20.557925 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:09:20.557925 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:20.557925 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:20.557925 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:20.557925 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:20.557925 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:20.557925 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:20.557925 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:20.557925 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:20.557925 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:20.557925 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:20.557925 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:20.557925 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:20.558873 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:20.558873 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:20.558873 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 20:09:20.558873 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 20:09:20.558873 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 20:09:20.558873 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 20:09:20.558873 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 20:09:20.558873 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 20:09:20.558873 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 21 20:09:20.558873 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:20.558873 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 425/844] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jun 21 20:09:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:20.564266 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa6e30-0159-4b4a-8743-e42347a0c88a None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:20.666955 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa6e30-0159-4b4a-8743-e42347a0c88a None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:20.701942 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adacee7-3234-415a-8414-258ff2c9e14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:20.702620 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adacee7-3234-415a-8414-258ff2c9e14e None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:20.702907 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adacee7-3234-415a-8414-258ff2c9e14e None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:20.703185 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adacee7-3234-415a-8414-258ff2c9e14e None admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:20.704051 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adacee7-3234-415a-8414-258ff2c9e14e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:20.704368 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adacee7-3234-415a-8414-258ff2c9e14e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:20.705791 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adacee7-3234-415a-8414-258ff2c9e14e None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:20.728244 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 420/845] 10.222.0.15 () {56 vars in 1135 bytes} [Tue Jun 21 20:09:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:20.729779 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a71216-2909-45bf-97a0-706593018882 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:20.837017 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a71216-2909-45bf-97a0-706593018882 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:20.876062 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fefd95d-f7ff-4d67-962f-456557fac826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:20.876729 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fefd95d-f7ff-4d67-962f-456557fac826 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:20.877066 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fefd95d-f7ff-4d67-962f-456557fac826 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:20.877358 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fefd95d-f7ff-4d67-962f-456557fac826 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:20.889922 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60511e8-8545-4d11-bd42-7ba84d51e8db None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:20.890455 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60511e8-8545-4d11-bd42-7ba84d51e8db None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:20.890738 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60511e8-8545-4d11-bd42-7ba84d51e8db None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:20.892395 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 421/846] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:09:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 20:09:20.895481 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:20.902109 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c0ed2-9bbb-406c-a2c9-ec4fa8c84019 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:20.902402 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c0ed2-9bbb-406c-a2c9-ec4fa8c84019 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:20.902681 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c0ed2-9bbb-406c-a2c9-ec4fa8c84019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:20.920081 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-1d6c0ed2-9bbb-406c-a2c9-ec4fa8c84019 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:09:20.921186 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-1d6c0ed2-9bbb-406c-a2c9-ec4fa8c84019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:09:20.967274 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fefd95d-f7ff-4d67-962f-456557fac826 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:20.969783 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fefd95d-f7ff-4d67-962f-456557fac826 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:20.978923 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:20.989801 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 422/847] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:09:20 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 20:09:21.011318 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c0ed2-9bbb-406c-a2c9-ec4fa8c84019 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:21.083372 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 426/848] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:09:20 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 20:09:21.089811 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fefd95d-f7ff-4d67-962f-456557fac826 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:21.125099 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c0ed2-9bbb-406c-a2c9-ec4fa8c84019 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:21.144305 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:21.166557 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a1a5a-74d1-4ba9-ac59-8e50ee7548b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:21.167390 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a1a5a-74d1-4ba9-ac59-8e50ee7548b4 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:21.167959 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a1a5a-74d1-4ba9-ac59-8e50ee7548b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:21.168250 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a1a5a-74d1-4ba9-ac59-8e50ee7548b4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:21.168918 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2a1a5a-74d1-4ba9-ac59-8e50ee7548b4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:21.171303 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2a1a5a-74d1-4ba9-ac59-8e50ee7548b4 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:21.186148 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-eb2a1a5a-74d1-4ba9-ac59-8e50ee7548b4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 20:09:21.186148 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:21.186148 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 20:09:21.186148 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 20:09:21.186148 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 20:09:21.186148 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 20:09:21.186148 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 20:09:21.186148 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 20:09:21.186148 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 20:09:21.186148 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:21.186148 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 20:09:21.186148 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:21.186148 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:21.186148 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:21.186148 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:21.186148 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:21.187215 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:21.187215 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:21.187215 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:21.187215 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:21.187215 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:21.187215 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:21.187215 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:21.187215 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 20:09:21.187215 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 20:09:21.187215 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 20:09:21.187215 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 20:09:21.187215 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:21.187215 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:21.187215 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:21.187215 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:21.187215 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:21.188091 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:21.188091 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:21.188091 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:21.188091 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:21.188091 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:21.188091 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:21.188091 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:21.188091 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:21.188091 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:21.188091 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:21.188091 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:21.188091 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 20:09:21.188091 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 20:09:21.188091 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 20:09:21.188091 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:21.188091 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 423/849] 10.222.0.15 () {56 vars in 1132 bytes} [Tue Jun 21 20:09:21 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:09:21.194241 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a1a5a-74d1-4ba9-ac59-8e50ee7548b4 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:21.214958 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fefd95d-f7ff-4d67-962f-456557fac826 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:21.248849 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:21.260008 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6924f6-d305-4713-af3e-229d33d6704b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:21.260910 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6924f6-d305-4713-af3e-229d33d6704b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:21.261201 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6924f6-d305-4713-af3e-229d33d6704b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:21.261571 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6924f6-d305-4713-af3e-229d33d6704b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:21.273316 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6924f6-d305-4713-af3e-229d33d6704b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:21.274739 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6924f6-d305-4713-af3e-229d33d6704b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:21.293410 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-ee6924f6-d305-4713-af3e-229d33d6704b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:21.293410 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:21.293410 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:21.293410 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:21.293410 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:21.293410 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:21.293410 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:21.293410 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:21.293410 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:21.293410 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:21.293410 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:21.293410 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:21.293410 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:09:21.293410 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:09:21.293410 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:09:21.295250 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:09:21.295250 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:21.295250 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:21.295250 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:21.295250 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:21.295250 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:21.295250 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:21.295250 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:21.295250 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:21.295250 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:21.295250 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:21.295250 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:21.295250 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:21.295250 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:21.295250 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:21.295250 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:21.295250 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:21.296379 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:09:21.296379 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:09:21.296379 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:21.296379 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:21.296379 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 427/850] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:09:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:21.300360 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6924f6-d305-4713-af3e-229d33d6704b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:21.310626 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a1a5a-74d1-4ba9-ac59-8e50ee7548b4 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:21.358174 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ad0e6-f610-4780-9263-d8a7f2310fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:21.359353 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ad0e6-f610-4780-9263-d8a7f2310fb9 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:21.359651 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ad0e6-f610-4780-9263-d8a7f2310fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:21.359945 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ad0e6-f610-4780-9263-d8a7f2310fb9 None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:21.360921 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1ad0e6-f610-4780-9263-d8a7f2310fb9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:21.361230 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1ad0e6-f610-4780-9263-d8a7f2310fb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:21.362982 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1ad0e6-f610-4780-9263-d8a7f2310fb9 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:21.369694 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 424/851] 10.222.0.15 () {56 vars in 1126 bytes} [Tue Jun 21 20:09:21 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:09:21.376142 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ad0e6-f610-4780-9263-d8a7f2310fb9 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:21.420897 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:21.429700 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6924f6-d305-4713-af3e-229d33d6704b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:21.475950 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a498e5f-e032-4558-83ce-4a78f412028e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:21.476639 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a498e5f-e032-4558-83ce-4a78f412028e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:21.476923 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a498e5f-e032-4558-83ce-4a78f412028e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:21.477194 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a498e5f-e032-4558-83ce-4a78f412028e None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:21.478445 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a498e5f-e032-4558-83ce-4a78f412028e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:21.478758 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a498e5f-e032-4558-83ce-4a78f412028e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:21.480719 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a498e5f-e032-4558-83ce-4a78f412028e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:21.490354 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ad0e6-f610-4780-9263-d8a7f2310fb9 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:21.500606 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 428/852] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:09:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:21.502781 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a498e5f-e032-4558-83ce-4a78f412028e None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:21.508633 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:21.528887 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f621c6-5f32-4e91-a416-c1af957cf89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:21.529701 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f621c6-5f32-4e91-a416-c1af957cf89f None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:21.530048 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f621c6-5f32-4e91-a416-c1af957cf89f None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:21.530392 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f621c6-5f32-4e91-a416-c1af957cf89f None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:21.531219 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f621c6-5f32-4e91-a416-c1af957cf89f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:21.531592 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f621c6-5f32-4e91-a416-c1af957cf89f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:21.533109 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f621c6-5f32-4e91-a416-c1af957cf89f None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:21.544094 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 425/853] 10.222.0.15 () {56 vars in 1126 bytes} [Tue Jun 21 20:09:21 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:09:21.615570 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a498e5f-e032-4558-83ce-4a78f412028e None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:21.653641 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef18499-fdf2-46cf-a782-3dc518e17c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:21.654463 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef18499-fdf2-46cf-a782-3dc518e17c6e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:21.654747 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef18499-fdf2-46cf-a782-3dc518e17c6e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:21.655026 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef18499-fdf2-46cf-a782-3dc518e17c6e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:21.663085 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef18499-fdf2-46cf-a782-3dc518e17c6e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:21.664586 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef18499-fdf2-46cf-a782-3dc518e17c6e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:21.680468 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-5ef18499-fdf2-46cf-a782-3dc518e17c6e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:09:21.680468 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:21.680468 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:21.680468 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:21.680468 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:21.680468 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:21.680468 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:21.680468 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:21.680468 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:21.680468 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:21.680468 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:21.680468 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:21.680468 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 20:09:21.680468 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 20:09:21.680468 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 20:09:21.682515 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 20:09:21.682515 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:21.682515 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:21.682515 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:21.682515 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:21.682515 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:21.682515 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:21.682515 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:21.682515 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:21.682515 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:21.682515 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:21.682515 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:21.682515 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:21.682515 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:21.682515 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:21.682515 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:21.682515 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:21.684703 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 20:09:21.684703 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 20:09:21.684703 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 20:09:21.684703 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 20:09:21.684703 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 20:09:21.684703 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 20:09:21.684703 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:09:21.684703 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:21.684703 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 429/854] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jun 21 20:09:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:21.689316 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f621c6-5f32-4e91-a416-c1af957cf89f None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:21.799895 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f621c6-5f32-4e91-a416-c1af957cf89f None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:21.835426 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47477971-4624-4269-b6ab-c5ef18129aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:21.836118 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47477971-4624-4269-b6ab-c5ef18129aca None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:21.836400 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47477971-4624-4269-b6ab-c5ef18129aca None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:21.836678 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47477971-4624-4269-b6ab-c5ef18129aca None admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:21.837531 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47477971-4624-4269-b6ab-c5ef18129aca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:21.837842 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47477971-4624-4269-b6ab-c5ef18129aca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:21.839319 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47477971-4624-4269-b6ab-c5ef18129aca None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:21.854449 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d01ab-6f3e-42ed-841d-f54befb8a813 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:21.854449 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d01ab-6f3e-42ed-841d-f54befb8a813 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:21.855216 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 426/855] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jun 21 20:09:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:21.855373 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d01ab-6f3e-42ed-841d-f54befb8a813 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:21.855373 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 430/856] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:09:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 20:09:21.859964 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47477971-4624-4269-b6ab-c5ef18129aca None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:21.864459 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3563d29f-1767-4a72-b8ac-c34d7ad3cdf7 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:21.864459 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3563d29f-1767-4a72-b8ac-c34d7ad3cdf7 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:21.864459 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3563d29f-1767-4a72-b8ac-c34d7ad3cdf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:21.880676 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-3563d29f-1767-4a72-b8ac-c34d7ad3cdf7 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:09:21.882202 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3563d29f-1767-4a72-b8ac-c34d7ad3cdf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:09:21.900264 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:21.909911 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:21.972235 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 431/857] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:09:21 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 20:09:21.985701 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47477971-4624-4269-b6ab-c5ef18129aca None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:21.990151 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3563d29f-1767-4a72-b8ac-c34d7ad3cdf7 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:22.035116 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10221186-b5f6-4209-9c63-d42773530192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:22.036752 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10221186-b5f6-4209-9c63-d42773530192 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:22.037040 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10221186-b5f6-4209-9c63-d42773530192 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:22.037318 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10221186-b5f6-4209-9c63-d42773530192 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:22.038442 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10221186-b5f6-4209-9c63-d42773530192 None admin] RBAC: Adding query filter params (role.id=1f5332f48d9e4c2aac866d0d546c94d5, scope.project.id=4dcb71ef7b6e49148edd61a1eb8da7bb, user.id=038537bd12174154ba259e097b97b8bd) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:22.038757 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10221186-b5f6-4209-9c63-d42773530192 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:22.040474 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10221186-b5f6-4209-9c63-d42773530192 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:22.049357 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 427/858] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jun 21 20:09:21 2022] GET /identity/v3/role_assignments?user.id=038537bd12174154ba259e097b97b8bd&scope.project.id=4dcb71ef7b6e49148edd61a1eb8da7bb&role.id=1f5332f48d9e4c2aac866d0d546c94d5 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:22.087838 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef461d23-f035-4e08-bcd6-3665a0b1a2ad None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:22.088183 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef461d23-f035-4e08-bcd6-3665a0b1a2ad None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:22.088458 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef461d23-f035-4e08-bcd6-3665a0b1a2ad None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:22.090049 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 428/859] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:09:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:09:22.095526 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dabf35-aa23-44ba-a8cc-ed8549800e18 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:22.095839 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dabf35-aa23-44ba-a8cc-ed8549800e18 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:22.096113 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dabf35-aa23-44ba-a8cc-ed8549800e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:22.103821 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3563d29f-1767-4a72-b8ac-c34d7ad3cdf7 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:22.125365 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-b2dabf35-aa23-44ba-a8cc-ed8549800e18 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:09:22.126999 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-b2dabf35-aa23-44ba-a8cc-ed8549800e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:09:22.142989 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f968f2-8430-48b8-a050-0792d0928465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:22.143673 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f968f2-8430-48b8-a050-0792d0928465 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:22.143988 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f968f2-8430-48b8-a050-0792d0928465 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:22.144287 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f968f2-8430-48b8-a050-0792d0928465 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:22.145075 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f968f2-8430-48b8-a050-0792d0928465 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:22.146486 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f968f2-8430-48b8-a050-0792d0928465 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:22.171970 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 432/860] 10.222.0.15 () {60 vars in 1141 bytes} [Tue Jun 21 20:09:21 2022] POST /identity/v3/services => generated 251 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:09:22.227788 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 429/861] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:09:22 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 20:09:22.252960 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f968f2-8430-48b8-a050-0792d0928465 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:22.263547 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:22.368908 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f968f2-8430-48b8-a050-0792d0928465 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:22.404112 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b3994-ea69-4d54-a39e-247ca28404cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:22.405285 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b3994-ea69-4d54-a39e-247ca28404cc None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:22.405781 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b3994-ea69-4d54-a39e-247ca28404cc None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:22.406291 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b3994-ea69-4d54-a39e-247ca28404cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:22.417616 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51b3994-ea69-4d54-a39e-247ca28404cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:09:22.425908 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-d51b3994-ea69-4d54-a39e-247ca28404cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 20:09:22.425908 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:22.425908 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:22.425908 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:22.425908 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:22.425908 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:22.425908 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:22.425908 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:22.425908 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:22.425908 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:22.425908 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:22.425908 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:22.425908 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:09:22.425908 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:09:22.425908 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:09:22.425908 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:09:22.426905 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:09:22.426905 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:09:22.426905 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:09:22.426905 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:09:22.426905 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:22.426905 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:22.426905 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:22.426905 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:22.426905 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:22.426905 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:22.426905 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:22.426905 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:22.426905 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:22.426905 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:22.426905 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:22.426905 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:22.427751 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:22.427751 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:22.427751 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:22.427751 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:22.427751 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:09:22.427751 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:09:22.427751 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:09:22.427751 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:09:22.427751 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:09:22.427751 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:09:22.427751 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 20:09:22.427751 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:22.430563 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 433/862] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Jun 21 20:09:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:22.437007 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dabf35-aa23-44ba-a8cc-ed8549800e18 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:22.467481 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:22.540636 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dabf35-aa23-44ba-a8cc-ed8549800e18 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:22.575664 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e628cfe-4983-4cb2-b020-a6aba013127b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:22.576738 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e628cfe-4983-4cb2-b020-a6aba013127b None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:22.577250 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e628cfe-4983-4cb2-b020-a6aba013127b None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:22.577750 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e628cfe-4983-4cb2-b020-a6aba013127b None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:22.578704 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e628cfe-4983-4cb2-b020-a6aba013127b None admin] RBAC: Adding query filter params (name=service) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:22.579217 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e628cfe-4983-4cb2-b020-a6aba013127b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:22.580826 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e628cfe-4983-4cb2-b020-a6aba013127b None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:22.594765 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 430/863] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Jun 21 20:09:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:22.601101 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b3994-ea69-4d54-a39e-247ca28404cc None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:22.672904 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:22.712284 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b3994-ea69-4d54-a39e-247ca28404cc None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:22.747046 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae318c7-5e81-47d7-bdb5-4db11a1b8cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:22.747856 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae318c7-5e81-47d7-bdb5-4db11a1b8cb3 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:22.748172 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae318c7-5e81-47d7-bdb5-4db11a1b8cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:22.748460 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae318c7-5e81-47d7-bdb5-4db11a1b8cb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:22.759819 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae318c7-5e81-47d7-bdb5-4db11a1b8cb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:22.761403 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae318c7-5e81-47d7-bdb5-4db11a1b8cb3 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:22.779508 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-fae318c7-5e81-47d7-bdb5-4db11a1b8cb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:22.779508 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:22.779508 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:22.779508 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:22.779508 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:22.779508 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:22.779508 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:22.779508 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:22.779508 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:22.779508 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:22.779508 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:22.779508 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:22.779508 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:09:22.779508 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:09:22.779508 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:09:22.780485 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:09:22.780485 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:22.780485 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:22.780485 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:22.780485 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:22.780485 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:22.780485 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:22.780485 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:22.780485 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:22.780485 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:22.780485 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:22.780485 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:22.780485 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:22.780485 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:22.780485 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:22.780485 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:22.780485 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:22.781497 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:09:22.781497 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:09:22.781497 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:22.781497 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:22.781497 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 434/864] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:09:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:22.787784 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e628cfe-4983-4cb2-b020-a6aba013127b None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:22.892362 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:22.896022 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e628cfe-4983-4cb2-b020-a6aba013127b None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:22.930801 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a332d-6c3d-4658-b0eb-1c2c42a56790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:22.931470 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a332d-6c3d-4658-b0eb-1c2c42a56790 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:22.931756 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a332d-6c3d-4658-b0eb-1c2c42a56790 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:22.932058 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a332d-6c3d-4658-b0eb-1c2c42a56790 None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:22.932778 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5a332d-6c3d-4658-b0eb-1c2c42a56790 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:22.933084 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5a332d-6c3d-4658-b0eb-1c2c42a56790 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:22.934445 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5a332d-6c3d-4658-b0eb-1c2c42a56790 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:22.947271 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 431/865] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:09:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:22.952781 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae318c7-5e81-47d7-bdb5-4db11a1b8cb3 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:23.058306 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae318c7-5e81-47d7-bdb5-4db11a1b8cb3 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:23.076746 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:23.095859 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83632ef-fd33-4f06-9b7b-d2ead352bcd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:23.096979 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83632ef-fd33-4f06-9b7b-d2ead352bcd9 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:23.097501 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83632ef-fd33-4f06-9b7b-d2ead352bcd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:23.097996 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83632ef-fd33-4f06-9b7b-d2ead352bcd9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:23.105988 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83632ef-fd33-4f06-9b7b-d2ead352bcd9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:23.107743 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83632ef-fd33-4f06-9b7b-d2ead352bcd9 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:23.124058 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-d83632ef-fd33-4f06-9b7b-d2ead352bcd9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 20:09:23.124058 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:23.124058 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:23.124058 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:23.124058 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:23.124058 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:23.124058 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:23.124058 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:23.124058 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:23.124058 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:23.124058 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:23.124058 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:23.124058 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 20:09:23.124058 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 20:09:23.124058 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 20:09:23.124058 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 20:09:23.125060 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:23.125060 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:23.125060 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 20:09:23.125060 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:09:23.125060 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 20:09:23.125060 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:09:23.125060 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:23.125060 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:23.125060 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:23.125060 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:23.125060 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:23.125060 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:23.125060 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:23.125060 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:23.125060 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:23.125060 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:23.125060 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:23.125060 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:23.126027 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:23.126027 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:23.126027 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 20:09:23.126027 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 20:09:23.126027 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 20:09:23.126027 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 20:09:23.126027 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 20:09:23.126027 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 20:09:23.126027 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 20:09:23.126027 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:23.128693 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 435/866] 10.222.0.15 () {56 vars in 1117 bytes} [Tue Jun 21 20:09:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:23.135413 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a332d-6c3d-4658-b0eb-1c2c42a56790 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:23.241983 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a332d-6c3d-4658-b0eb-1c2c42a56790 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:23.282222 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff76b0-8c47-4a58-94b1-e774ee8f393b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:23.282908 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff76b0-8c47-4a58-94b1-e774ee8f393b None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:23.283196 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff76b0-8c47-4a58-94b1-e774ee8f393b None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:23.283477 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff76b0-8c47-4a58-94b1-e774ee8f393b None admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:23.284352 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ff76b0-8c47-4a58-94b1-e774ee8f393b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:23.284667 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ff76b0-8c47-4a58-94b1-e774ee8f393b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:23.286142 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ff76b0-8c47-4a58-94b1-e774ee8f393b None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:23.304703 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 432/867] 10.222.0.15 () {56 vars in 1149 bytes} [Tue Jun 21 20:09:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:23.310241 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83632ef-fd33-4f06-9b7b-d2ead352bcd9 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:23.417810 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83632ef-fd33-4f06-9b7b-d2ead352bcd9 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:23.454941 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c429cb48-9362-44bf-be3d-044c78762522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:23.456011 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429cb48-9362-44bf-be3d-044c78762522 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:23.456525 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429cb48-9362-44bf-be3d-044c78762522 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:23.457009 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429cb48-9362-44bf-be3d-044c78762522 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:23.509436 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:23.531665 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c429cb48-9362-44bf-be3d-044c78762522 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:23.533174 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c429cb48-9362-44bf-be3d-044c78762522 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:23.627006 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5a9c3-016b-46e1-950b-a41e861fbbdd None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:23.627395 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5a9c3-016b-46e1-950b-a41e861fbbdd None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:23.627628 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5a9c3-016b-46e1-950b-a41e861fbbdd None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:23.630176 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 433/868] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:09:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 20:09:23.634031 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040c7ef-97ce-47ba-89d3-4b0c7c7ab417 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:23.634323 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040c7ef-97ce-47ba-89d3-4b0c7c7ab417 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:23.634603 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040c7ef-97ce-47ba-89d3-4b0c7c7ab417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:23.634846 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 436/869] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:09:23 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 20:09:23.641105 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c429cb48-9362-44bf-be3d-044c78762522 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:23.651075 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-c040c7ef-97ce-47ba-89d3-4b0c7c7ab417 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:09:23.652426 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-c040c7ef-97ce-47ba-89d3-4b0c7c7ab417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:09:23.655296 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:23.727298 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 434/870] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:09:23 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 20:09:23.747738 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:23.755619 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c040c7ef-97ce-47ba-89d3-4b0c7c7ab417 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:23.770503 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c429cb48-9362-44bf-be3d-044c78762522 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:23.885703 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c040c7ef-97ce-47ba-89d3-4b0c7c7ab417 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:23.925202 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8907ae-3d11-41ff-ad2b-b0bc1ce28ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:23.925416 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba14034-1c36-4fc9-99b7-9afcbf1f9e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:23.926426 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8907ae-3d11-41ff-ad2b-b0bc1ce28ffa None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:23.926628 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba14034-1c36-4fc9-99b7-9afcbf1f9e99 None admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:23.926953 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8907ae-3d11-41ff-ad2b-b0bc1ce28ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:23.927376 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba14034-1c36-4fc9-99b7-9afcbf1f9e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:23.927482 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8907ae-3d11-41ff-ad2b-b0bc1ce28ffa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:23.927978 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba14034-1c36-4fc9-99b7-9afcbf1f9e99 None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:23.928914 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba14034-1c36-4fc9-99b7-9afcbf1f9e99 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:23.930720 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba14034-1c36-4fc9-99b7-9afcbf1f9e99 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:23.938419 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8907ae-3d11-41ff-ad2b-b0bc1ce28ffa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:23.939867 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8907ae-3d11-41ff-ad2b-b0bc1ce28ffa None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:23.942816 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:23.956666 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 435/871] 10.222.0.15 () {60 vars in 1141 bytes} [Tue Jun 21 20:09:23 2022] POST /identity/v3/services => generated 269 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 20:09:23.959479 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-ca8907ae-3d11-41ff-ad2b-b0bc1ce28ffa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:23.959479 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:23.959479 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:23.959479 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:23.959479 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:23.959479 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:23.959479 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:23.959479 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:23.959479 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:23.959479 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:23.959479 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:23.959479 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:23.959479 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:09:23.959479 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:09:23.959479 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:09:23.960718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:09:23.960718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:23.960718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:23.960718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:23.960718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:23.960718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:23.960718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:23.960718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:23.960718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:23.960718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:23.960718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:23.960718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:23.960718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:23.960718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:23.960718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:23.960718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:23.960718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:23.961610 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:09:23.961610 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:09:23.961610 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:23.961610 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:23.965384 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 437/872] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:09:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:23.966908 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba14034-1c36-4fc9-99b7-9afcbf1f9e99 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:24.092662 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba14034-1c36-4fc9-99b7-9afcbf1f9e99 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:24.133382 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bba71a-d48b-4f08-b0e3-2b2ff57669ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:24.134421 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bba71a-d48b-4f08-b0e3-2b2ff57669ab None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:24.134917 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bba71a-d48b-4f08-b0e3-2b2ff57669ab None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:24.135413 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bba71a-d48b-4f08-b0e3-2b2ff57669ab None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:24.136411 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bba71a-d48b-4f08-b0e3-2b2ff57669ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:24.136931 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bba71a-d48b-4f08-b0e3-2b2ff57669ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:24.138613 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bba71a-d48b-4f08-b0e3-2b2ff57669ab None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:24.152982 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 436/873] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:09:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:24.158271 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8907ae-3d11-41ff-ad2b-b0bc1ce28ffa None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:24.269490 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8907ae-3d11-41ff-ad2b-b0bc1ce28ffa None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:24.300888 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:24.308988 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04babdee-946a-4ffa-872e-ef84fdc11386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:24.310107 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04babdee-946a-4ffa-872e-ef84fdc11386 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:24.310626 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04babdee-946a-4ffa-872e-ef84fdc11386 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:24.311106 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04babdee-946a-4ffa-872e-ef84fdc11386 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:24.319046 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04babdee-946a-4ffa-872e-ef84fdc11386 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:24.320873 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04babdee-946a-4ffa-872e-ef84fdc11386 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:24.326670 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401514b-7fc0-4a3e-8358-e24290f7d3af None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:24.326967 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401514b-7fc0-4a3e-8358-e24290f7d3af None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:24.327254 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401514b-7fc0-4a3e-8358-e24290f7d3af None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:24.328884 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 437/874] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:09:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:09:24.334485 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09fc32-38a9-4b2d-a6fd-ace26383b6cb None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:24.334780 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09fc32-38a9-4b2d-a6fd-ace26383b6cb None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:24.335069 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09fc32-38a9-4b2d-a6fd-ace26383b6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:24.337683 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-04babdee-946a-4ffa-872e-ef84fdc11386 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:09:24.337683 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:24.337683 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:24.337683 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:24.337683 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:24.337683 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:24.337683 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:24.337683 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:24.337683 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:24.337683 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:24.337683 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:24.337683 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:24.337683 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 20:09:24.337683 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 20:09:24.337683 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 20:09:24.338555 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 20:09:24.338555 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:24.338555 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:24.338555 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:24.338555 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:24.338555 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:24.338555 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:24.338555 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:24.338555 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:24.338555 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:24.338555 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:24.338555 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:24.338555 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:24.338555 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:24.338555 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:24.338555 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:24.338555 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:24.339461 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 20:09:24.339461 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 20:09:24.339461 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 20:09:24.339461 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 20:09:24.339461 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 20:09:24.339461 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 20:09:24.339461 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:09:24.339461 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:24.343245 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 438/875] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jun 21 20:09:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:24.349249 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04babdee-946a-4ffa-872e-ef84fdc11386 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:24.352741 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-ae09fc32-38a9-4b2d-a6fd-ace26383b6cb None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:09:24.353949 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-ae09fc32-38a9-4b2d-a6fd-ace26383b6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:09:24.407890 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:24.425609 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 438/876] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:09:24 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 20:09:24.426797 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baaf102-1943-46a2-8245-226899d8ebc4 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:24.427094 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baaf102-1943-46a2-8245-226899d8ebc4 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:24.427377 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baaf102-1943-46a2-8245-226899d8ebc4 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:24.432522 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 439/877] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:09:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:09:24.433780 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be34f74-77e7-4d55-8918-60fb84b9fae6 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:24.434071 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be34f74-77e7-4d55-8918-60fb84b9fae6 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:24.434351 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be34f74-77e7-4d55-8918-60fb84b9fae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:24.456277 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-0be34f74-77e7-4d55-8918-60fb84b9fae6 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:09:24.458034 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-0be34f74-77e7-4d55-8918-60fb84b9fae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:09:24.488715 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04babdee-946a-4ffa-872e-ef84fdc11386 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:24.526780 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 440/878] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:09:24 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 20:09:24.527616 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be34f74-77e7-4d55-8918-60fb84b9fae6 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:24.532819 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d18771-4d0f-4f2c-b723-ddedfdc9497a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:24.533801 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d18771-4d0f-4f2c-b723-ddedfdc9497a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:24.534298 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d18771-4d0f-4f2c-b723-ddedfdc9497a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:24.534800 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d18771-4d0f-4f2c-b723-ddedfdc9497a None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:24.535831 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d18771-4d0f-4f2c-b723-ddedfdc9497a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:24.536406 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d18771-4d0f-4f2c-b723-ddedfdc9497a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:24.538152 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d18771-4d0f-4f2c-b723-ddedfdc9497a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:24.552686 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 439/879] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jun 21 20:09:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:24.553815 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d18771-4d0f-4f2c-b723-ddedfdc9497a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:24.607116 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:24.645924 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be34f74-77e7-4d55-8918-60fb84b9fae6 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:24.661299 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d18771-4d0f-4f2c-b723-ddedfdc9497a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:24.663324 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:24.684446 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f791107-f628-4401-b2d1-b9998385228f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:24.685452 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f791107-f628-4401-b2d1-b9998385228f None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:24.685736 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f791107-f628-4401-b2d1-b9998385228f None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:24.686013 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f791107-f628-4401-b2d1-b9998385228f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:24.686663 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f791107-f628-4401-b2d1-b9998385228f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:24.688261 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f791107-f628-4401-b2d1-b9998385228f None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:24.696305 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e96e7d-94e3-472d-97a1-1dabc72342e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:24.697110 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e96e7d-94e3-472d-97a1-1dabc72342e2 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:24.697394 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e96e7d-94e3-472d-97a1-1dabc72342e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:24.697671 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e96e7d-94e3-472d-97a1-1dabc72342e2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:24.698327 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e96e7d-94e3-472d-97a1-1dabc72342e2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:24.699673 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e96e7d-94e3-472d-97a1-1dabc72342e2 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:24.701046 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-6f791107-f628-4401-b2d1-b9998385228f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 20:09:24.701046 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:24.701046 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 20:09:24.701046 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 20:09:24.701046 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 20:09:24.701046 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 20:09:24.701046 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 20:09:24.701046 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 20:09:24.701046 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 20:09:24.701046 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:24.701046 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 20:09:24.701046 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:24.701046 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:24.701046 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:24.701046 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:24.701046 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:24.701046 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:24.701991 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:24.701991 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:24.701991 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:24.701991 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:24.701991 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:24.701991 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:24.701991 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 20:09:24.701991 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 20:09:24.701991 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 20:09:24.701991 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 20:09:24.701991 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:24.701991 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:24.701991 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:24.701991 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:24.701991 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:24.701991 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:24.702872 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:24.702872 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:24.702872 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:24.702872 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:24.702872 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:24.702872 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:24.702872 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:24.702872 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:24.702872 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:24.702872 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:24.702872 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 20:09:24.702872 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 20:09:24.702872 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 20:09:24.702872 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:24.702872 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 441/880] 10.222.0.15 () {56 vars in 1126 bytes} [Tue Jun 21 20:09:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:24.703670 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f791107-f628-4401-b2d1-b9998385228f None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:24.717864 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-38e96e7d-94e3-472d-97a1-1dabc72342e2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 20:09:24.717864 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:24.717864 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 20:09:24.717864 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 20:09:24.717864 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 20:09:24.717864 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 20:09:24.717864 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 20:09:24.717864 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 20:09:24.717864 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 20:09:24.717864 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:24.717864 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 20:09:24.717864 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:24.717864 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:24.717864 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:24.717864 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:24.717864 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:24.717864 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:24.718981 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:24.718981 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:24.718981 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:24.718981 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:24.718981 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:24.718981 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:24.718981 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 20:09:24.718981 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 20:09:24.718981 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 20:09:24.718981 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 20:09:24.718981 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:24.718981 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:24.718981 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:24.718981 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:24.718981 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:24.718981 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:24.719820 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:24.719820 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:24.719820 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:24.719820 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:24.719820 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:24.719820 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:24.719820 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:24.719820 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:24.719820 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:24.719820 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:24.719820 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 20:09:24.719820 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 20:09:24.719820 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 20:09:24.719820 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:24.719820 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 440/881] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Jun 21 20:09:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:24.722220 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e96e7d-94e3-472d-97a1-1dabc72342e2 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:24.812588 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f791107-f628-4401-b2d1-b9998385228f None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:24.822455 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e96e7d-94e3-472d-97a1-1dabc72342e2 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:24.836652 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:24.852102 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b484848-5eec-4188-8c61-a5058df10ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:24.852770 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b484848-5eec-4188-8c61-a5058df10ad2 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:24.853051 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b484848-5eec-4188-8c61-a5058df10ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:24.853328 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b484848-5eec-4188-8c61-a5058df10ad2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:24.854151 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b484848-5eec-4188-8c61-a5058df10ad2 None admin] RBAC: Adding query filter params (role.id=a4929ef60a294190b2d59e8d61e05063, scope.project.id=4dcb71ef7b6e49148edd61a1eb8da7bb, user.id=5cf067b8833f4596a1b91073a66768f0) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:24.854464 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b484848-5eec-4188-8c61-a5058df10ad2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:24.855878 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b484848-5eec-4188-8c61-a5058df10ad2 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:24.864961 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8a6d54-d8f9-46ee-b286-98ebaf201d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:24.865631 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a6d54-d8f9-46ee-b286-98ebaf201d33 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:24.865924 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a6d54-d8f9-46ee-b286-98ebaf201d33 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:24.866193 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a6d54-d8f9-46ee-b286-98ebaf201d33 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:24.866903 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8a6d54-d8f9-46ee-b286-98ebaf201d33 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:24.867216 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8a6d54-d8f9-46ee-b286-98ebaf201d33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:24.868637 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8a6d54-d8f9-46ee-b286-98ebaf201d33 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:24.872820 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 442/882] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jun 21 20:09:24 2022] GET /identity/v3/role_assignments?user.id=5cf067b8833f4596a1b91073a66768f0&scope.project.id=4dcb71ef7b6e49148edd61a1eb8da7bb&role.id=a4929ef60a294190b2d59e8d61e05063 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:24.873688 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b484848-5eec-4188-8c61-a5058df10ad2 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:24.874252 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 441/883] 10.222.0.15 () {56 vars in 1122 bytes} [Tue Jun 21 20:09:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:24.880807 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8a6d54-d8f9-46ee-b286-98ebaf201d33 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:24.944168 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:25.006863 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b484848-5eec-4188-8c61-a5058df10ad2 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:25.019680 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8a6d54-d8f9-46ee-b286-98ebaf201d33 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:25.049202 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df7fa3-1994-4e15-be26-d4ed47a6e9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:25.050194 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df7fa3-1994-4e15-be26-d4ed47a6e9df None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:25.050481 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df7fa3-1994-4e15-be26-d4ed47a6e9df None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:25.050764 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df7fa3-1994-4e15-be26-d4ed47a6e9df None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:25.052159 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df7fa3-1994-4e15-be26-d4ed47a6e9df None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:25.052471 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df7fa3-1994-4e15-be26-d4ed47a6e9df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:25.053850 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df7fa3-1994-4e15-be26-d4ed47a6e9df None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:25.058576 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14692b9d-1f85-4a44-83dc-24681a992802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:25.059374 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 443/884] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Jun 21 20:09:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:25.059601 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14692b9d-1f85-4a44-83dc-24681a992802 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:25.059903 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14692b9d-1f85-4a44-83dc-24681a992802 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:25.060212 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14692b9d-1f85-4a44-83dc-24681a992802 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:25.060923 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14692b9d-1f85-4a44-83dc-24681a992802 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:25.061234 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14692b9d-1f85-4a44-83dc-24681a992802 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:25.062585 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14692b9d-1f85-4a44-83dc-24681a992802 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:25.066138 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df7fa3-1994-4e15-be26-d4ed47a6e9df None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:25.067747 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 442/885] 10.222.0.15 () {56 vars in 1122 bytes} [Tue Jun 21 20:09:24 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:09:25.192109 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df7fa3-1994-4e15-be26-d4ed47a6e9df None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:25.202509 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:25.233545 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce6d0e9-512d-45f4-9bb1-b553b7e04a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:25.234483 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6d0e9-512d-45f4-9bb1-b553b7e04a79 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:25.234772 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6d0e9-512d-45f4-9bb1-b553b7e04a79 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:25.235052 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6d0e9-512d-45f4-9bb1-b553b7e04a79 None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:25.235771 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce6d0e9-512d-45f4-9bb1-b553b7e04a79 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:25.236107 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce6d0e9-512d-45f4-9bb1-b553b7e04a79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:25.237483 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce6d0e9-512d-45f4-9bb1-b553b7e04a79 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:25.244744 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 444/886] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Jun 21 20:09:25 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:25.250351 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14692b9d-1f85-4a44-83dc-24681a992802 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:25.300445 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:25.359269 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14692b9d-1f85-4a44-83dc-24681a992802 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:25.393100 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af68502a-dd70-496d-990a-0fb27ff33c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:25.393761 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68502a-dd70-496d-990a-0fb27ff33c1a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:25.394053 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68502a-dd70-496d-990a-0fb27ff33c1a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:25.394329 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68502a-dd70-496d-990a-0fb27ff33c1a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:25.395639 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af68502a-dd70-496d-990a-0fb27ff33c1a None admin] RBAC: Adding query filter params (interface=public, service_id=4a70b62b8f5440c58de49d00a93a6f9d, region_id=RegionOne) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:25.395977 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af68502a-dd70-496d-990a-0fb27ff33c1a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:25.397335 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af68502a-dd70-496d-990a-0fb27ff33c1a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:25.402843 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 443/887] 10.222.0.15 () {56 vars in 1251 bytes} [Tue Jun 21 20:09:25 2022] GET /identity/v3/endpoints?service_id=4a70b62b8f5440c58de49d00a93a6f9d&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:25.412458 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce6d0e9-512d-45f4-9bb1-b553b7e04a79 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:25.516961 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce6d0e9-512d-45f4-9bb1-b553b7e04a79 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:25.552629 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a23c8-4100-4532-816f-4d1147bbb1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:25.553304 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a23c8-4100-4532-816f-4d1147bbb1d6 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:25.553590 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a23c8-4100-4532-816f-4d1147bbb1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:25.553869 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a23c8-4100-4532-816f-4d1147bbb1d6 None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:25.554559 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5a23c8-4100-4532-816f-4d1147bbb1d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:25.555952 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5a23c8-4100-4532-816f-4d1147bbb1d6 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:25.562449 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 445/888] 10.222.0.15 () {56 vars in 1087 bytes} [Tue Jun 21 20:09:25 2022] GET /identity/v3/services => generated 1268 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:09:26.082691 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa14746-78be-4e9b-8391-08f30dcf8006 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:26.083206 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa14746-78be-4e9b-8391-08f30dcf8006 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:26.083314 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa14746-78be-4e9b-8391-08f30dcf8006 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:26.084898 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 444/889] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:09:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:09:26.090294 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b3e2d-f526-4816-99b2-0efc7f0342de None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:26.090712 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b3e2d-f526-4816-99b2-0efc7f0342de None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:26.090893 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b3e2d-f526-4816-99b2-0efc7f0342de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:26.107937 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-7b6b3e2d-f526-4816-99b2-0efc7f0342de None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:09:26.109344 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-7b6b3e2d-f526-4816-99b2-0efc7f0342de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:09:26.139462 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:26.186003 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 446/890] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:09:26 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 20:09:26.209127 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa14746-78be-4e9b-8391-08f30dcf8006 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:26.314710 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa14746-78be-4e9b-8391-08f30dcf8006 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:26.322303 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:26.350485 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5b626-be81-4a63-ab51-ccda9e21a2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:26.351300 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5b626-be81-4a63-ab51-ccda9e21a2ec None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:26.351588 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5b626-be81-4a63-ab51-ccda9e21a2ec None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:26.351871 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5b626-be81-4a63-ab51-ccda9e21a2ec None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:26.352616 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a5b626-be81-4a63-ab51-ccda9e21a2ec None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:26.354040 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a5b626-be81-4a63-ab51-ccda9e21a2ec None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:26.366952 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-e8a5b626-be81-4a63-ab51-ccda9e21a2ec None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 20:09:26.366952 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:26.366952 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 20:09:26.366952 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 20:09:26.366952 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 20:09:26.366952 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 20:09:26.366952 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 20:09:26.366952 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 20:09:26.366952 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 20:09:26.366952 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:26.366952 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 20:09:26.366952 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:26.366952 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:26.366952 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:26.366952 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:26.366952 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:26.367891 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:26.367891 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:26.367891 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:26.367891 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:26.367891 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:26.367891 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:26.367891 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:26.367891 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 20:09:26.367891 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 20:09:26.367891 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 20:09:26.367891 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 20:09:26.367891 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:26.367891 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:26.367891 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:26.367891 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:26.367891 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:26.368780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:26.368780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:26.368780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:26.368780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:26.368780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:26.368780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:26.368780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:26.368780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:26.368780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:26.368780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:26.368780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:26.368780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 20:09:26.368780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 20:09:26.368780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 20:09:26.368780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:26.368780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 445/891] 10.222.0.15 () {56 vars in 1132 bytes} [Tue Jun 21 20:09:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:26.374426 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b3e2d-f526-4816-99b2-0efc7f0342de None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:26.474150 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b3e2d-f526-4816-99b2-0efc7f0342de None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:26.508344 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7145b9d-3cd2-46b9-bca5-196583302e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:26.509010 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7145b9d-3cd2-46b9-bca5-196583302e1a None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:26.509300 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7145b9d-3cd2-46b9-bca5-196583302e1a None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:26.509584 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7145b9d-3cd2-46b9-bca5-196583302e1a None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:26.510298 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7145b9d-3cd2-46b9-bca5-196583302e1a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:26.510609 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7145b9d-3cd2-46b9-bca5-196583302e1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:26.511995 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7145b9d-3cd2-46b9-bca5-196583302e1a None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:26.516944 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 447/892] 10.222.0.15 () {56 vars in 1126 bytes} [Tue Jun 21 20:09:26 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:26.522468 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5b626-be81-4a63-ab51-ccda9e21a2ec None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:26.625700 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5b626-be81-4a63-ab51-ccda9e21a2ec None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:26.660305 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68262c4b-5d8a-4bfd-8e7e-8a23bb4195f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:26.661811 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68262c4b-5d8a-4bfd-8e7e-8a23bb4195f0 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:26.662309 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68262c4b-5d8a-4bfd-8e7e-8a23bb4195f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:26.662821 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68262c4b-5d8a-4bfd-8e7e-8a23bb4195f0 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:26.663706 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68262c4b-5d8a-4bfd-8e7e-8a23bb4195f0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:26.664227 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68262c4b-5d8a-4bfd-8e7e-8a23bb4195f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:26.665779 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68262c4b-5d8a-4bfd-8e7e-8a23bb4195f0 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:26.671396 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 446/893] 10.222.0.15 () {56 vars in 1126 bytes} [Tue Jun 21 20:09:26 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:26.677554 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7145b9d-3cd2-46b9-bca5-196583302e1a None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:26.710400 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:26.789316 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7145b9d-3cd2-46b9-bca5-196583302e1a None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:26.824628 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade76d8d-00db-4516-8082-cd3df3e6ed04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:26.825304 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade76d8d-00db-4516-8082-cd3df3e6ed04 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:26.825594 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade76d8d-00db-4516-8082-cd3df3e6ed04 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:26.825878 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade76d8d-00db-4516-8082-cd3df3e6ed04 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:26.826679 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade76d8d-00db-4516-8082-cd3df3e6ed04 None admin] RBAC: Adding query filter params (interface=public, service_id=73d8401cc14e4601b1da76a5ac96634b, region_id=RegionOne) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:26.826999 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade76d8d-00db-4516-8082-cd3df3e6ed04 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:26.828402 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade76d8d-00db-4516-8082-cd3df3e6ed04 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:26.846624 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 448/894] 10.222.0.15 () {56 vars in 1251 bytes} [Tue Jun 21 20:09:26 2022] GET /identity/v3/endpoints?service_id=73d8401cc14e4601b1da76a5ac96634b&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:26.847698 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68262c4b-5d8a-4bfd-8e7e-8a23bb4195f0 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:26.887592 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:26.954144 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68262c4b-5d8a-4bfd-8e7e-8a23bb4195f0 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:26.989477 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054cd96f-cc35-45f1-852e-e058bc839218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:26.990153 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054cd96f-cc35-45f1-852e-e058bc839218 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:26.990443 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054cd96f-cc35-45f1-852e-e058bc839218 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:26.990726 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054cd96f-cc35-45f1-852e-e058bc839218 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:26.991478 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054cd96f-cc35-45f1-852e-e058bc839218 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:26.992913 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054cd96f-cc35-45f1-852e-e058bc839218 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:26.998918 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 447/895] 10.222.0.15 () {56 vars in 1087 bytes} [Tue Jun 21 20:09:26 2022] GET /identity/v3/services => generated 1268 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:09:27.163034 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623bce2-95d6-4795-b459-3a84fa2eed40 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:27.163522 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623bce2-95d6-4795-b459-3a84fa2eed40 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:27.163522 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623bce2-95d6-4795-b459-3a84fa2eed40 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:27.165130 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 449/896] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:09:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:09:27.170456 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12515671-ff38-4b98-95a2-c571b6d28a1c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:27.170859 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12515671-ff38-4b98-95a2-c571b6d28a1c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:27.171026 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12515671-ff38-4b98-95a2-c571b6d28a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:27.188310 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-12515671-ff38-4b98-95a2-c571b6d28a1c None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:09:27.189526 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-12515671-ff38-4b98-95a2-c571b6d28a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:09:27.259693 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 448/897] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:09:27 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 20:09:27.283757 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3623bce2-95d6-4795-b459-3a84fa2eed40 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:27.308755 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47086c2b-5e58-4357-90be-9eb7aecfe180 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:27.309205 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47086c2b-5e58-4357-90be-9eb7aecfe180 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:27.309627 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47086c2b-5e58-4357-90be-9eb7aecfe180 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:27.311732 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 449/898] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:09:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:09:27.317227 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379d6e6-9ae5-496b-8d42-cf3b3826ad9b None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:27.317513 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379d6e6-9ae5-496b-8d42-cf3b3826ad9b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:27.318086 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379d6e6-9ae5-496b-8d42-cf3b3826ad9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:27.336866 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-d379d6e6-9ae5-496b-8d42-cf3b3826ad9b None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:09:27.338503 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d379d6e6-9ae5-496b-8d42-cf3b3826ad9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:09:27.368317 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:27.385511 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:27.393382 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3623bce2-95d6-4795-b459-3a84fa2eed40 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:27.420237 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 450/899] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:09:27 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 20:09:27.428804 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e0349-fbf0-4831-8e19-266556fa58c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:27.429748 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e0349-fbf0-4831-8e19-266556fa58c6 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:27.430140 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e0349-fbf0-4831-8e19-266556fa58c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:27.430525 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e0349-fbf0-4831-8e19-266556fa58c6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:27.442393 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52e0349-fbf0-4831-8e19-266556fa58c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:09:27.443126 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d379d6e6-9ae5-496b-8d42-cf3b3826ad9b None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:27.450835 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-f52e0349-fbf0-4831-8e19-266556fa58c6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 20:09:27.450835 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:27.450835 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:27.450835 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:27.450835 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:27.450835 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:27.450835 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:27.450835 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:27.450835 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:27.450835 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:27.450835 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:27.450835 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:27.450835 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:09:27.450835 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:09:27.450835 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:09:27.450835 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:09:27.452068 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:09:27.452068 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:09:27.452068 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:09:27.452068 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:09:27.452068 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:27.452068 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:27.452068 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:27.452068 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:27.452068 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:27.452068 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:27.452068 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:27.452068 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:27.452068 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:27.452068 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:27.452068 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:27.452068 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:27.453151 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:27.453151 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:27.453151 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:27.453151 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:27.453151 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:09:27.453151 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:09:27.453151 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:09:27.453151 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:09:27.453151 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:09:27.453151 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:09:27.453151 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 20:09:27.453151 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:27.455038 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 450/900] 10.222.0.15 () {56 vars in 1120 bytes} [Tue Jun 21 20:09:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:27.461061 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e0349-fbf0-4831-8e19-266556fa58c6 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:27.554280 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d379d6e6-9ae5-496b-8d42-cf3b3826ad9b None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:27.563895 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e0349-fbf0-4831-8e19-266556fa58c6 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:27.591969 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d44bac-bf70-4c5e-8a35-661454ef31d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:27.592993 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d44bac-bf70-4c5e-8a35-661454ef31d8 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:27.593601 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d44bac-bf70-4c5e-8a35-661454ef31d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:27.594104 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d44bac-bf70-4c5e-8a35-661454ef31d8 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:27.595076 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d44bac-bf70-4c5e-8a35-661454ef31d8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:27.596874 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d44bac-bf70-4c5e-8a35-661454ef31d8 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:27.599312 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8ffe5-1538-4d56-8690-7b57cefdedbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:27.599969 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8ffe5-1538-4d56-8690-7b57cefdedbd None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:27.600265 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8ffe5-1538-4d56-8690-7b57cefdedbd None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:27.600546 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8ffe5-1538-4d56-8690-7b57cefdedbd None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:27.601306 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc8ffe5-1538-4d56-8690-7b57cefdedbd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:27.601620 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc8ffe5-1538-4d56-8690-7b57cefdedbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:27.603113 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc8ffe5-1538-4d56-8690-7b57cefdedbd None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:27.623587 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 451/902] 10.222.0.15 () {56 vars in 1115 bytes} [Tue Jun 21 20:09:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:09:27.623587 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8ffe5-1538-4d56-8690-7b57cefdedbd None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:27.624120 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 451/902] 10.222.0.15 () {60 vars in 1141 bytes} [Tue Jun 21 20:09:27 2022] POST /identity/v3/services => generated 241 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:09:27.644451 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:27.657386 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc818fe-2fab-4b19-b570-f5b375667a7a None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:27.657700 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc818fe-2fab-4b19-b570-f5b375667a7a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:27.657961 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc818fe-2fab-4b19-b570-f5b375667a7a None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:27.659619 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 452/903] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:09:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 20:09:27.665507 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be7e5b-b48a-4db7-a7a9-5c7edcca0268 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:27.665805 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be7e5b-b48a-4db7-a7a9-5c7edcca0268 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:27.666069 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be7e5b-b48a-4db7-a7a9-5c7edcca0268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:27.684946 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-93be7e5b-b48a-4db7-a7a9-5c7edcca0268 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:09:27.686133 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-93be7e5b-b48a-4db7-a7a9-5c7edcca0268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:09:27.702669 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:27.738019 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8ffe5-1538-4d56-8690-7b57cefdedbd None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:27.776017 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a08809c-7ce9-4905-b06b-7ffed9bebbdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:27.776840 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08809c-7ce9-4905-b06b-7ffed9bebbdd None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:27.777130 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08809c-7ce9-4905-b06b-7ffed9bebbdd None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:27.777414 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08809c-7ce9-4905-b06b-7ffed9bebbdd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:27.780078 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 453/904] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:09:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 20:09:27.795007 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a08809c-7ce9-4905-b06b-7ffed9bebbdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:27.795495 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a08809c-7ce9-4905-b06b-7ffed9bebbdd None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:27.803859 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93be7e5b-b48a-4db7-a7a9-5c7edcca0268 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:27.816268 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-2a08809c-7ce9-4905-b06b-7ffed9bebbdd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:27.816268 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:27.816268 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:27.816268 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:27.816268 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:27.816268 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:27.816268 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:27.816268 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:27.816268 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:27.816268 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:27.816268 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:27.816268 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:27.816268 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:09:27.816268 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:09:27.816268 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:09:27.817907 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:09:27.817907 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:27.817907 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:27.817907 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:27.817907 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:27.817907 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:27.817907 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:27.817907 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:27.817907 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:27.817907 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:27.817907 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:27.817907 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:27.817907 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:27.817907 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:27.817907 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:27.817907 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:27.817907 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:27.819017 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:09:27.819017 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:09:27.819017 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:27.819017 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:27.820883 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 452/905] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:09:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:27.826870 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a08809c-7ce9-4905-b06b-7ffed9bebbdd None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:27.910165 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:27.915312 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93be7e5b-b48a-4db7-a7a9-5c7edcca0268 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:27.947603 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a08809c-7ce9-4905-b06b-7ffed9bebbdd None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:27.951182 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6469512-d54c-44d8-86f9-8b9ca0ba9528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:27.952022 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6469512-d54c-44d8-86f9-8b9ca0ba9528 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:27.952313 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6469512-d54c-44d8-86f9-8b9ca0ba9528 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:27.952592 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6469512-d54c-44d8-86f9-8b9ca0ba9528 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:27.953255 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6469512-d54c-44d8-86f9-8b9ca0ba9528 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:27.954626 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6469512-d54c-44d8-86f9-8b9ca0ba9528 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:27.966674 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-a6469512-d54c-44d8-86f9-8b9ca0ba9528 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 20:09:27.966674 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:27.966674 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 20:09:27.966674 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 20:09:27.966674 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 20:09:27.966674 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 20:09:27.966674 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 20:09:27.966674 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 20:09:27.966674 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 20:09:27.966674 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:27.966674 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 20:09:27.966674 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:27.966674 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:27.966674 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:27.966674 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:27.966674 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:27.966674 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:27.967694 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:27.967694 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:27.967694 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:27.967694 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:27.967694 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:27.967694 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:27.967694 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 20:09:27.967694 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 20:09:27.967694 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 20:09:27.967694 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 20:09:27.967694 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:27.967694 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:27.967694 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:27.967694 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:27.967694 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:27.967694 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:27.969026 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:27.969026 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:27.969026 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:27.969026 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:27.969026 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:27.969026 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:27.969026 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:27.969026 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:27.969026 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:27.969026 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:27.969026 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 20:09:27.969026 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 20:09:27.969026 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 20:09:27.969026 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:27.969026 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 454/906] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Jun 21 20:09:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:27.976971 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6469512-d54c-44d8-86f9-8b9ca0ba9528 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:27.991896 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:28.000934 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e66d9e-679d-414b-ae5d-9914f8169159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:28.001728 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e66d9e-679d-414b-ae5d-9914f8169159 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:28.002285 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e66d9e-679d-414b-ae5d-9914f8169159 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:28.002663 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e66d9e-679d-414b-ae5d-9914f8169159 None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:28.004108 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e66d9e-679d-414b-ae5d-9914f8169159 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:28.004492 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e66d9e-679d-414b-ae5d-9914f8169159 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:28.005996 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e66d9e-679d-414b-ae5d-9914f8169159 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:28.029129 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 453/907] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:09:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:09:28.031755 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e66d9e-679d-414b-ae5d-9914f8169159 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:28.096148 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6469512-d54c-44d8-86f9-8b9ca0ba9528 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:28.134175 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd7772-41ad-40c7-aa05-b5eac5efa129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:28.134691 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd7772-41ad-40c7-aa05-b5eac5efa129 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:28.134980 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd7772-41ad-40c7-aa05-b5eac5efa129 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:28.135259 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd7772-41ad-40c7-aa05-b5eac5efa129 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:28.136000 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacd7772-41ad-40c7-aa05-b5eac5efa129 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:28.136297 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacd7772-41ad-40c7-aa05-b5eac5efa129 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:28.137754 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacd7772-41ad-40c7-aa05-b5eac5efa129 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:28.144903 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e66d9e-679d-414b-ae5d-9914f8169159 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:28.147333 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 455/908] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Jun 21 20:09:27 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:28.148609 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd7772-41ad-40c7-aa05-b5eac5efa129 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:28.184289 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:28.189392 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc1eb4-b6e7-4f3a-8d95-8cb8606007c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:28.190467 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc1eb4-b6e7-4f3a-8d95-8cb8606007c7 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:28.190992 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc1eb4-b6e7-4f3a-8d95-8cb8606007c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:28.191567 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc1eb4-b6e7-4f3a-8d95-8cb8606007c7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:28.200416 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dc1eb4-b6e7-4f3a-8d95-8cb8606007c7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:28.202408 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dc1eb4-b6e7-4f3a-8d95-8cb8606007c7 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:28.219338 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-f5dc1eb4-b6e7-4f3a-8d95-8cb8606007c7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 20:09:28.219338 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:28.219338 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:28.219338 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:28.219338 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:28.219338 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:28.219338 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:28.219338 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:28.219338 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:28.219338 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:28.219338 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:28.219338 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:28.219338 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 20:09:28.219338 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 20:09:28.219338 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 20:09:28.219338 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 20:09:28.220599 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:28.220599 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:28.220599 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 20:09:28.220599 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:09:28.220599 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 20:09:28.220599 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:09:28.220599 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:28.220599 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:28.220599 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:28.220599 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:28.220599 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:28.220599 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:28.220599 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:28.220599 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:28.220599 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:28.220599 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:28.220599 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:28.220599 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:28.221547 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:28.221547 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:28.221547 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 20:09:28.221547 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 20:09:28.221547 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 20:09:28.221547 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 20:09:28.221547 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 20:09:28.221547 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 20:09:28.221547 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 20:09:28.221547 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:28.222765 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:28.226614 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 454/909] 10.222.0.15 () {56 vars in 1117 bytes} [Tue Jun 21 20:09:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:28.231627 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc1eb4-b6e7-4f3a-8d95-8cb8606007c7 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:28.263936 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd7772-41ad-40c7-aa05-b5eac5efa129 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:28.306941 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5990a3-e8c3-4713-b4b4-4af66f26d22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:28.308546 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5990a3-e8c3-4713-b4b4-4af66f26d22a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:28.309040 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5990a3-e8c3-4713-b4b4-4af66f26d22a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:28.309545 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5990a3-e8c3-4713-b4b4-4af66f26d22a None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:28.310615 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5990a3-e8c3-4713-b4b4-4af66f26d22a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:28.311147 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5990a3-e8c3-4713-b4b4-4af66f26d22a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:28.313481 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5990a3-e8c3-4713-b4b4-4af66f26d22a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:28.319893 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 456/910] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Jun 21 20:09:28 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:09:28.325466 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5990a3-e8c3-4713-b4b4-4af66f26d22a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:28.353461 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc1eb4-b6e7-4f3a-8d95-8cb8606007c7 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:28.390416 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6757e951-13f7-4d70-ae96-6526010ce4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:28.391495 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757e951-13f7-4d70-ae96-6526010ce4f4 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:28.392018 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757e951-13f7-4d70-ae96-6526010ce4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:28.392501 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757e951-13f7-4d70-ae96-6526010ce4f4 None admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:28.393551 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6757e951-13f7-4d70-ae96-6526010ce4f4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:28.394176 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6757e951-13f7-4d70-ae96-6526010ce4f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:28.396456 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6757e951-13f7-4d70-ae96-6526010ce4f4 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:28.420797 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 455/911] 10.222.0.15 () {56 vars in 1149 bytes} [Tue Jun 21 20:09:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:09:28.422124 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6757e951-13f7-4d70-ae96-6526010ce4f4 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:28.430490 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5990a3-e8c3-4713-b4b4-4af66f26d22a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:28.466971 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03644e42-fe81-4bdc-a204-2ec52e190cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:28.467555 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03644e42-fe81-4bdc-a204-2ec52e190cc3 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:28.467840 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03644e42-fe81-4bdc-a204-2ec52e190cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:28.468149 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03644e42-fe81-4bdc-a204-2ec52e190cc3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:28.469060 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03644e42-fe81-4bdc-a204-2ec52e190cc3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:28.470336 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03644e42-fe81-4bdc-a204-2ec52e190cc3 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:28.475262 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:28.476653 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:28.500011 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 457/912] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Jun 21 20:09:28 2022] POST /identity/v3/endpoints => generated 346 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 20:09:28.547382 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6757e951-13f7-4d70-ae96-6526010ce4f4 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:28.593475 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf8c20f-3a9b-4cfe-87dd-3614479077da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:28.594486 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8c20f-3a9b-4cfe-87dd-3614479077da None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:28.594968 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8c20f-3a9b-4cfe-87dd-3614479077da None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:28.595478 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8c20f-3a9b-4cfe-87dd-3614479077da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:28.674515 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf8c20f-3a9b-4cfe-87dd-3614479077da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:28.676334 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf8c20f-3a9b-4cfe-87dd-3614479077da None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:28.721164 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:28.782366 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 456/913] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:09:28 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 20:09:28.788169 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03644e42-fe81-4bdc-a204-2ec52e190cc3 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:28.911164 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03644e42-fe81-4bdc-a204-2ec52e190cc3 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:28.944748 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a7a094-f107-4b66-b8f5-cb54105ed1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:28.945808 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7a094-f107-4b66-b8f5-cb54105ed1af None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:28.946239 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7a094-f107-4b66-b8f5-cb54105ed1af None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:28.946657 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7a094-f107-4b66-b8f5-cb54105ed1af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:28.958212 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a7a094-f107-4b66-b8f5-cb54105ed1af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:28.959818 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a7a094-f107-4b66-b8f5-cb54105ed1af None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:28.976978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-89a7a094-f107-4b66-b8f5-cb54105ed1af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:28.976978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:28.976978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:28.976978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:28.976978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:28.976978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:28.976978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:28.976978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:28.976978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:28.976978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:28.976978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:28.976978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:28.976978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:09:28.976978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:09:28.976978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:09:28.978040 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:09:28.978040 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:28.978040 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:28.978040 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:28.978040 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:28.978040 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:28.978040 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:28.978040 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:28.978040 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:28.978040 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:28.978040 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:28.978040 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:28.978040 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:28.978040 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:28.978040 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:28.978040 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:28.978040 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:28.979143 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:09:28.979143 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:09:28.979143 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:28.979143 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:28.981047 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 458/914] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:09:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:09:28.988736 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf8c20f-3a9b-4cfe-87dd-3614479077da None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:29.090918 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf8c20f-3a9b-4cfe-87dd-3614479077da None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:29.129947 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eccdfd-d974-460e-bb84-c24681dbbc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:29.130971 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eccdfd-d974-460e-bb84-c24681dbbc07 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:29.131262 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eccdfd-d974-460e-bb84-c24681dbbc07 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:29.131535 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eccdfd-d974-460e-bb84-c24681dbbc07 None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:29.131956 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c9842-3338-4c14-9a6f-fdda2d725700 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:29.132293 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eccdfd-d974-460e-bb84-c24681dbbc07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:29.132405 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c9842-3338-4c14-9a6f-fdda2d725700 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:29.132574 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c9842-3338-4c14-9a6f-fdda2d725700 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:29.132679 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eccdfd-d974-460e-bb84-c24681dbbc07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:29.133944 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eccdfd-d974-460e-bb84-c24681dbbc07 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:29.137573 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 459/915] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:09:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 20:09:29.141408 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ad0b5-2177-4767-ac08-28bc8c24ccc6 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:29.141701 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ad0b5-2177-4767-ac08-28bc8c24ccc6 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:29.141976 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ad0b5-2177-4767-ac08-28bc8c24ccc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:29.146913 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 457/916] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:09:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:29.153753 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eccdfd-d974-460e-bb84-c24681dbbc07 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:29.156856 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:29.164231 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-815ad0b5-2177-4767-ac08-28bc8c24ccc6 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:09:29.165668 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-815ad0b5-2177-4767-ac08-28bc8c24ccc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:09:29.222495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:29.268180 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 460/917] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:09:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 20:09:29.282828 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eccdfd-d974-460e-bb84-c24681dbbc07 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:29.291343 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ad0b5-2177-4767-ac08-28bc8c24ccc6 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:29.327790 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef90ea9-bf58-4626-948a-00dfa11269d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:29.329153 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef90ea9-bf58-4626-948a-00dfa11269d2 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:29.329675 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef90ea9-bf58-4626-948a-00dfa11269d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:29.330864 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef90ea9-bf58-4626-948a-00dfa11269d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:29.339317 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef90ea9-bf58-4626-948a-00dfa11269d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:29.341293 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef90ea9-bf58-4626-948a-00dfa11269d2 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:29.359336 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-1ef90ea9-bf58-4626-948a-00dfa11269d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:09:29.359336 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:29.359336 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:29.359336 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:29.359336 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:29.359336 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:29.359336 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:29.359336 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:29.359336 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:29.359336 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:29.359336 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:29.359336 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:29.359336 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 20:09:29.359336 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 20:09:29.359336 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 20:09:29.360426 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 20:09:29.360426 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:29.360426 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:29.360426 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:29.360426 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:29.360426 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:29.360426 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:29.360426 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:29.360426 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:29.360426 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:29.360426 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:29.360426 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:29.360426 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:29.360426 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:29.360426 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:29.360426 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:29.360426 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:29.361357 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 20:09:29.361357 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 20:09:29.361357 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 20:09:29.361357 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 20:09:29.361357 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 20:09:29.361357 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 20:09:29.361357 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:09:29.361357 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:29.368986 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 458/918] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jun 21 20:09:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:29.371156 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef90ea9-bf58-4626-948a-00dfa11269d2 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:29.411017 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ad0b5-2177-4767-ac08-28bc8c24ccc6 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:29.436177 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:29.450509 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7c531-33a2-4d81-9cf0-5869eb0abea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:29.451330 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7c531-33a2-4d81-9cf0-5869eb0abea5 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:29.451666 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7c531-33a2-4d81-9cf0-5869eb0abea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:29.451967 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7c531-33a2-4d81-9cf0-5869eb0abea5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:29.452847 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b7c531-33a2-4d81-9cf0-5869eb0abea5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:29.454333 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b7c531-33a2-4d81-9cf0-5869eb0abea5 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:29.467705 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-92b7c531-33a2-4d81-9cf0-5869eb0abea5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 20:09:29.467705 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:29.467705 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 20:09:29.467705 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 20:09:29.467705 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 20:09:29.467705 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 20:09:29.467705 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 20:09:29.467705 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 20:09:29.467705 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 20:09:29.467705 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:29.467705 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 20:09:29.467705 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:29.467705 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:29.467705 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:29.467705 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:29.467705 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:29.468749 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:29.468749 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:29.468749 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:29.468749 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:29.468749 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:29.468749 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:29.468749 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:29.468749 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 20:09:29.468749 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 20:09:29.468749 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 20:09:29.468749 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 20:09:29.468749 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:29.468749 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:29.468749 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:29.468749 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:29.468749 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:29.469621 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:29.469621 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:29.469621 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:29.469621 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:29.469621 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:29.469621 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:29.469621 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:29.469621 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:29.469621 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:29.469621 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:29.469621 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:29.469621 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 20:09:29.469621 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 20:09:29.469621 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 20:09:29.469621 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:29.473932 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 461/919] 10.222.0.15 () {56 vars in 1132 bytes} [Tue Jun 21 20:09:29 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:09:29.475602 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7c531-33a2-4d81-9cf0-5869eb0abea5 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:29.484471 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef90ea9-bf58-4626-948a-00dfa11269d2 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:29.519306 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:29.520696 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b353154b-522d-42fc-bca2-27d9f75dc13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:29.521610 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353154b-522d-42fc-bca2-27d9f75dc13e None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:29.522105 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353154b-522d-42fc-bca2-27d9f75dc13e None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:29.522613 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353154b-522d-42fc-bca2-27d9f75dc13e None admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:29.523628 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b353154b-522d-42fc-bca2-27d9f75dc13e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:29.524337 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b353154b-522d-42fc-bca2-27d9f75dc13e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:29.525987 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b353154b-522d-42fc-bca2-27d9f75dc13e None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:29.544021 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 459/920] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jun 21 20:09:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:29.545184 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b353154b-522d-42fc-bca2-27d9f75dc13e None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:29.586160 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7c531-33a2-4d81-9cf0-5869eb0abea5 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:29.625252 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc581a-256c-4987-89bd-c96804423063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:29.626232 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc581a-256c-4987-89bd-c96804423063 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:29.626521 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc581a-256c-4987-89bd-c96804423063 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:29.626798 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc581a-256c-4987-89bd-c96804423063 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:29.627896 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc581a-256c-4987-89bd-c96804423063 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:29.628027 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc581a-256c-4987-89bd-c96804423063 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:29.629428 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc581a-256c-4987-89bd-c96804423063 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:29.639804 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 462/921] 10.222.0.15 () {56 vars in 1126 bytes} [Tue Jun 21 20:09:29 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:09:29.640921 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc581a-256c-4987-89bd-c96804423063 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:29.652474 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b353154b-522d-42fc-bca2-27d9f75dc13e None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:29.677035 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:29.689367 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05aa62-eca5-46c3-ba7c-913571a23193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:29.690547 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05aa62-eca5-46c3-ba7c-913571a23193 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:29.691053 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05aa62-eca5-46c3-ba7c-913571a23193 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:29.691596 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05aa62-eca5-46c3-ba7c-913571a23193 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:29.692689 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c05aa62-eca5-46c3-ba7c-913571a23193 None admin] RBAC: Adding query filter params (role.id=1db2217c34b945f19d47444f74970dd5, scope.project.id=4dcb71ef7b6e49148edd61a1eb8da7bb, user.id=5cf067b8833f4596a1b91073a66768f0) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:29.693216 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c05aa62-eca5-46c3-ba7c-913571a23193 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:29.694844 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c05aa62-eca5-46c3-ba7c-913571a23193 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:29.708062 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 460/922] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jun 21 20:09:29 2022] GET /identity/v3/role_assignments?user.id=5cf067b8833f4596a1b91073a66768f0&scope.project.id=4dcb71ef7b6e49148edd61a1eb8da7bb&role.id=1db2217c34b945f19d47444f74970dd5 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:29.761836 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc581a-256c-4987-89bd-c96804423063 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:29.763711 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:29.775752 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a50a1-0710-4cf5-b6e4-bc08c0d90866 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:29.776060 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a50a1-0710-4cf5-b6e4-bc08c0d90866 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:29.776288 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a50a1-0710-4cf5-b6e4-bc08c0d90866 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:29.777989 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 461/923] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:09:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 20:09:29.783518 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7e6ff-54e2-45bb-bc1d-dd48d5f74347 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:29.783821 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7e6ff-54e2-45bb-bc1d-dd48d5f74347 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:29.784135 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7e6ff-54e2-45bb-bc1d-dd48d5f74347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:29.802970 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-3ba7e6ff-54e2-45bb-bc1d-dd48d5f74347 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:09:29.803169 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3799de-8f2a-441d-85da-67fdd63c5504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:29.803684 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3799de-8f2a-441d-85da-67fdd63c5504 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:29.803997 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3799de-8f2a-441d-85da-67fdd63c5504 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:29.804239 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-3ba7e6ff-54e2-45bb-bc1d-dd48d5f74347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:09:29.804342 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3799de-8f2a-441d-85da-67fdd63c5504 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:29.804979 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3799de-8f2a-441d-85da-67fdd63c5504 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:29.805285 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3799de-8f2a-441d-85da-67fdd63c5504 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:29.806855 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3799de-8f2a-441d-85da-67fdd63c5504 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:29.816972 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 463/924] 10.222.0.15 () {56 vars in 1126 bytes} [Tue Jun 21 20:09:29 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:29.818779 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3799de-8f2a-441d-85da-67fdd63c5504 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:29.901678 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 462/925] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:09:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 20:09:29.925519 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba7e6ff-54e2-45bb-bc1d-dd48d5f74347 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:29.944633 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3799de-8f2a-441d-85da-67fdd63c5504 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:29.994101 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf3bd8-faa6-4ed5-a397-c8673655c20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:29.995096 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf3bd8-faa6-4ed5-a397-c8673655c20a None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:29.995577 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf3bd8-faa6-4ed5-a397-c8673655c20a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:29.996095 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf3bd8-faa6-4ed5-a397-c8673655c20a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:29.997038 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf3bd8-faa6-4ed5-a397-c8673655c20a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:29.998600 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf3bd8-faa6-4ed5-a397-c8673655c20a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:30.021632 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 464/926] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Jun 21 20:09:29 2022] POST /identity/v3/endpoints => generated 347 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 20:09:30.066440 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba7e6ff-54e2-45bb-bc1d-dd48d5f74347 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:30.087709 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:30.115733 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00662b2c-d5fb-41e9-9dcd-834221df71e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:30.116587 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00662b2c-d5fb-41e9-9dcd-834221df71e3 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:30.116869 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00662b2c-d5fb-41e9-9dcd-834221df71e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:30.117141 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00662b2c-d5fb-41e9-9dcd-834221df71e3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:30.117801 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00662b2c-d5fb-41e9-9dcd-834221df71e3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:30.119192 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00662b2c-d5fb-41e9-9dcd-834221df71e3 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:30.132596 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-00662b2c-d5fb-41e9-9dcd-834221df71e3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 20:09:30.132596 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:30.132596 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 20:09:30.132596 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 20:09:30.132596 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 20:09:30.132596 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 20:09:30.132596 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 20:09:30.132596 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 20:09:30.132596 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 20:09:30.132596 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:30.132596 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 20:09:30.132596 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:30.132596 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:30.132596 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:30.132596 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:30.132596 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:30.132596 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:30.133674 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:30.133674 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:30.133674 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:30.133674 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:30.133674 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:30.133674 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:30.133674 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 20:09:30.133674 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 20:09:30.133674 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 20:09:30.133674 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 20:09:30.133674 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:30.133674 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:30.133674 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:30.133674 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:30.133674 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:30.133674 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:30.134519 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:30.134519 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:30.134519 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:30.134519 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:30.134519 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:30.134519 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:30.134519 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:30.134519 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:30.134519 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:30.134519 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:30.134519 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 20:09:30.134519 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 20:09:30.134519 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 20:09:30.134519 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:30.134519 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 463/927] 10.222.0.15 () {56 vars in 1126 bytes} [Tue Jun 21 20:09:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:30.142095 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf3bd8-faa6-4ed5-a397-c8673655c20a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:30.171679 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:30.254906 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf3bd8-faa6-4ed5-a397-c8673655c20a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:30.291725 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36328e72-acbd-4571-b006-0cbe5b7f5a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:30.293300 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36328e72-acbd-4571-b006-0cbe5b7f5a8b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:30.293797 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36328e72-acbd-4571-b006-0cbe5b7f5a8b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:30.294335 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36328e72-acbd-4571-b006-0cbe5b7f5a8b None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:30.295262 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36328e72-acbd-4571-b006-0cbe5b7f5a8b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:30.295784 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36328e72-acbd-4571-b006-0cbe5b7f5a8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:30.297380 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36328e72-acbd-4571-b006-0cbe5b7f5a8b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:30.303063 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 465/928] 10.222.0.15 () {56 vars in 1122 bytes} [Tue Jun 21 20:09:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:30.308934 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00662b2c-d5fb-41e9-9dcd-834221df71e3 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:30.414542 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00662b2c-d5fb-41e9-9dcd-834221df71e3 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:30.450436 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee5a9f3-fa65-4ffa-bc0d-583c8a57d473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:30.451478 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5a9f3-fa65-4ffa-bc0d-583c8a57d473 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:30.452016 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5a9f3-fa65-4ffa-bc0d-583c8a57d473 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:30.452560 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5a9f3-fa65-4ffa-bc0d-583c8a57d473 None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:30.453530 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee5a9f3-fa65-4ffa-bc0d-583c8a57d473 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:30.454047 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee5a9f3-fa65-4ffa-bc0d-583c8a57d473 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:30.455648 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee5a9f3-fa65-4ffa-bc0d-583c8a57d473 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:30.462220 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 464/929] 10.222.0.15 () {56 vars in 1122 bytes} [Tue Jun 21 20:09:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:30.468512 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36328e72-acbd-4571-b006-0cbe5b7f5a8b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:30.563298 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:30.580151 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36328e72-acbd-4571-b006-0cbe5b7f5a8b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:30.615966 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0cff0-9043-42a5-b0ec-047a5c4e71ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:30.617086 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0cff0-9043-42a5-b0ec-047a5c4e71ab None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:30.617653 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0cff0-9043-42a5-b0ec-047a5c4e71ab None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:30.618222 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0cff0-9043-42a5-b0ec-047a5c4e71ab None admin] PATH_INFO: `/v3/endpoints` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:30.619291 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e0cff0-9043-42a5-b0ec-047a5c4e71ab None admin] RBAC: Adding query filter params (interface=public, service_id=67b495e61f314c5dbf4cd61185c7f6c8, region_id=RegionOne) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:30.619840 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e0cff0-9043-42a5-b0ec-047a5c4e71ab None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:30.621505 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e0cff0-9043-42a5-b0ec-047a5c4e71ab None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:30.627587 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 466/930] 10.222.0.15 () {56 vars in 1251 bytes} [Tue Jun 21 20:09:30 2022] GET /identity/v3/endpoints?service_id=67b495e61f314c5dbf4cd61185c7f6c8&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:30.634023 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee5a9f3-fa65-4ffa-bc0d-583c8a57d473 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:30.678245 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:30.715829 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e17be2-d543-4338-8bca-3ea254c23ff7 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:30.716204 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e17be2-d543-4338-8bca-3ea254c23ff7 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:30.716446 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e17be2-d543-4338-8bca-3ea254c23ff7 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:30.718057 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 467/931] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:09:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:09:30.722848 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149dc08-3b08-45d1-b933-23cd30b2f341 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:30.723141 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149dc08-3b08-45d1-b933-23cd30b2f341 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:30.723422 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149dc08-3b08-45d1-b933-23cd30b2f341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:30.742852 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee5a9f3-fa65-4ffa-bc0d-583c8a57d473 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:30.744075 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-9149dc08-3b08-45d1-b933-23cd30b2f341 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:09:30.745434 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9149dc08-3b08-45d1-b933-23cd30b2f341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:09:30.785151 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f88928f-ae2c-4eeb-9170-67a2744b6d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:30.786458 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88928f-ae2c-4eeb-9170-67a2744b6d24 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:30.787799 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88928f-ae2c-4eeb-9170-67a2744b6d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:30.788335 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88928f-ae2c-4eeb-9170-67a2744b6d24 None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:30.789258 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f88928f-ae2c-4eeb-9170-67a2744b6d24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:30.791058 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f88928f-ae2c-4eeb-9170-67a2744b6d24 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:30.800053 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 465/932] 10.222.0.15 () {56 vars in 1087 bytes} [Tue Jun 21 20:09:30 2022] GET /identity/v3/services => generated 1497 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:09:30.828226 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 468/933] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:09:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 20:09:30.862878 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f88928f-ae2c-4eeb-9170-67a2744b6d24 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:30.975126 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f88928f-ae2c-4eeb-9170-67a2744b6d24 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:30.977822 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:31.010885 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581bbd3b-b343-4544-856b-f8beb1a84845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:31.011557 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581bbd3b-b343-4544-856b-f8beb1a84845 None admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:31.011848 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581bbd3b-b343-4544-856b-f8beb1a84845 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:31.012157 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581bbd3b-b343-4544-856b-f8beb1a84845 None admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:31.012857 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581bbd3b-b343-4544-856b-f8beb1a84845 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:31.014354 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581bbd3b-b343-4544-856b-f8beb1a84845 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:31.015776 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: WARNING keystone.server.flask.common [None req-581bbd3b-b343-4544-856b-f8beb1a84845 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 21 20:09:31.038375 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.sql.core [None req-581bbd3b-b343-4544-856b-f8beb1a84845 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 21 20:09:31.038375 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 21 20:09:31.038375 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [parameters: {'id': 'cd8d0413bd7e45aa9071dbfa74ece38c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 21 20:09:31.038375 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80136) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 21 20:09:31.055997 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-581bbd3b-b343-4544-856b-f8beb1a84845 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id cd8d0413bd7e45aa9071dbfa74ece38c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id cd8d0413bd7e45aa9071dbfa74ece38c. Jun 21 20:09:31.055997 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:31.055997 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 21 20:09:31.055997 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 21 20:09:31.055997 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 21 20:09:31.055997 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 21 20:09:31.055997 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 21 20:09:31.055997 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application result = self._query(query) Jun 21 20:09:31.055997 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 21 20:09:31.055997 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application conn.query(q) Jun 21 20:09:31.055997 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 21 20:09:31.055997 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 21 20:09:31.055997 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 21 20:09:31.056870 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application result.read() Jun 21 20:09:31.056870 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 21 20:09:31.056870 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 21 20:09:31.056870 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 21 20:09:31.056870 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 21 20:09:31.056870 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 21 20:09:31.056870 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 21 20:09:31.056870 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 21 20:09:31.056870 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 21 20:09:31.056870 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 21 20:09:31.056870 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:31.056870 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 21 20:09:31.056870 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:31.056870 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:31.056870 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 21 20:09:31.056870 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 21 20:09:31.056870 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 21 20:09:31.056870 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 21 20:09:31.057856 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 21 20:09:31.057856 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application next(self.gen) Jun 21 20:09:31.057856 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 21 20:09:31.057856 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application yield resource Jun 21 20:09:31.057856 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 21 20:09:31.057856 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application next(self.gen) Jun 21 20:09:31.057856 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 21 20:09:31.057856 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application self.session.rollback() Jun 21 20:09:31.057856 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 21 20:09:31.057856 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application self.force_reraise() Jun 21 20:09:31.057856 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 21 20:09:31.057856 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise self.value Jun 21 20:09:31.057856 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 21 20:09:31.057856 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 21 20:09:31.057856 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 21 20:09:31.057856 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application session.commit() Jun 21 20:09:31.057856 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 21 20:09:31.058746 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 21 20:09:31.058746 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 21 20:09:31.058746 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._prepare_impl() Jun 21 20:09:31.058746 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 21 20:09:31.058746 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application self.session.flush() Jun 21 20:09:31.058746 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 21 20:09:31.058746 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._flush(objects) Jun 21 20:09:31.058746 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 21 20:09:31.058746 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 21 20:09:31.058746 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 21 20:09:31.058746 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application compat.raise_( Jun 21 20:09:31.058746 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 21 20:09:31.058746 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception Jun 21 20:09:31.058746 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 21 20:09:31.058746 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application flush_context.execute() Jun 21 20:09:31.058746 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 21 20:09:31.058746 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rec.execute(self) Jun 21 20:09:31.059654 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 21 20:09:31.059654 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 21 20:09:31.059654 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 21 20:09:31.059654 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 21 20:09:31.059654 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 21 20:09:31.059654 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 21 20:09:31.059654 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 21 20:09:31.059654 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 21 20:09:31.059654 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 21 20:09:31.059654 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 21 20:09:31.059654 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 21 20:09:31.059654 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 21 20:09:31.059654 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 21 20:09:31.059654 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 21 20:09:31.059654 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 21 20:09:31.060494 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 21 20:09:31.060494 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 21 20:09:31.060494 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception Jun 21 20:09:31.060494 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 21 20:09:31.060494 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 21 20:09:31.060494 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 21 20:09:31.060494 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 21 20:09:31.060494 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 21 20:09:31.060494 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application result = self._query(query) Jun 21 20:09:31.060494 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 21 20:09:31.060494 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application conn.query(q) Jun 21 20:09:31.060494 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 21 20:09:31.060494 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 21 20:09:31.060494 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 21 20:09:31.060494 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application result.read() Jun 21 20:09:31.060494 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 21 20:09:31.060494 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 21 20:09:31.061453 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 21 20:09:31.061453 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 21 20:09:31.061453 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 21 20:09:31.061453 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 21 20:09:31.061453 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 21 20:09:31.061453 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 21 20:09:31.061453 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 21 20:09:31.061453 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 21 20:09:31.061453 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [parameters: {'id': 'cd8d0413bd7e45aa9071dbfa74ece38c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 21 20:09:31.061453 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 21 20:09:31.061453 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:31.061453 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 20:09:31.061453 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:31.061453 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:31.061453 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 21 20:09:31.062264 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 21 20:09:31.062264 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 21 20:09:31.062264 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 21 20:09:31.062264 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 21 20:09:31.062264 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:31.062264 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 20:09:31.062264 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:31.062264 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:31.062264 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:31.062264 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:31.062264 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:31.062264 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:31.062264 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:31.062264 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:31.062264 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:31.062264 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:31.062264 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:31.065566 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:31.065566 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 21 20:09:31.065566 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 21 20:09:31.065566 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:31.065566 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:31.065566 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 21 20:09:31.065566 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 21 20:09:31.065566 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id cd8d0413bd7e45aa9071dbfa74ece38c. Jun 21 20:09:31.065566 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:31.065566 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 466/934] 10.222.0.15 () {60 vars in 1140 bytes} [Tue Jun 21 20:09:30 2022] POST /identity/v3/projects => generated 262 bytes in 195 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:31.070579 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9149dc08-3b08-45d1-b933-23cd30b2f341 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:31.151143 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:31.172251 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9149dc08-3b08-45d1-b933-23cd30b2f341 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:31.208305 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe6949-5a06-45ca-8d0f-8d78873358bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:31.209496 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe6949-5a06-45ca-8d0f-8d78873358bf None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:31.210007 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe6949-5a06-45ca-8d0f-8d78873358bf None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:31.210504 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe6949-5a06-45ca-8d0f-8d78873358bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:31.217736 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffe6949-5a06-45ca-8d0f-8d78873358bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:31.219455 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffe6949-5a06-45ca-8d0f-8d78873358bf None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:31.234930 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-0ffe6949-5a06-45ca-8d0f-8d78873358bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:09:31.234930 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:31.234930 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:31.234930 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:31.234930 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:31.234930 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:31.234930 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:31.234930 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:31.234930 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:31.234930 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:31.234930 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:31.234930 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:31.234930 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 20:09:31.234930 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 20:09:31.234930 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 20:09:31.235878 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 20:09:31.235878 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:31.235878 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:31.235878 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:31.235878 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:31.235878 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:31.235878 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:31.235878 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:31.235878 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:31.235878 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:31.235878 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:31.235878 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:31.235878 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:31.235878 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:31.235878 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:31.235878 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:31.235878 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:31.236864 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 20:09:31.236864 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 20:09:31.236864 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 20:09:31.236864 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 20:09:31.236864 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 20:09:31.236864 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 20:09:31.236864 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:09:31.236864 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:31.239954 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 469/935] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jun 21 20:09:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:31.245688 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581bbd3b-b343-4544-856b-f8beb1a84845 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:31.354165 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581bbd3b-b343-4544-856b-f8beb1a84845 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:31.388460 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19b2f9-417c-43e1-be82-9b11175dbee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:31.389133 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19b2f9-417c-43e1-be82-9b11175dbee5 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:31.389433 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19b2f9-417c-43e1-be82-9b11175dbee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:31.389702 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19b2f9-417c-43e1-be82-9b11175dbee5 None admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:31.390469 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19b2f9-417c-43e1-be82-9b11175dbee5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:31.390782 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19b2f9-417c-43e1-be82-9b11175dbee5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:31.392456 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19b2f9-417c-43e1-be82-9b11175dbee5 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:31.414178 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 467/936] 10.222.0.15 () {56 vars in 1112 bytes} [Tue Jun 21 20:09:31 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:31.810269 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6a8b7-d5a7-4ea2-81b9-3ca9d162dd11 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:31.810791 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6a8b7-d5a7-4ea2-81b9-3ca9d162dd11 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:31.810870 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6a8b7-d5a7-4ea2-81b9-3ca9d162dd11 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:31.812545 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 470/937] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:09:31.818490 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54188d6c-590d-4bf8-b382-cfd7c88f62b6 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:31.818786 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54188d6c-590d-4bf8-b382-cfd7c88f62b6 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:31.819071 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54188d6c-590d-4bf8-b382-cfd7c88f62b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:31.837199 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-54188d6c-590d-4bf8-b382-cfd7c88f62b6 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:09:31.838736 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-54188d6c-590d-4bf8-b382-cfd7c88f62b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:09:31.856345 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:31.918026 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 468/938] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:09:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 20:09:31.942116 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6a8b7-d5a7-4ea2-81b9-3ca9d162dd11 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:32.051732 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6a8b7-d5a7-4ea2-81b9-3ca9d162dd11 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:32.087085 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0aa4db-788d-42fa-b9ad-b9e266f657b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:32.088282 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0aa4db-788d-42fa-b9ad-b9e266f657b9 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:32.088805 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0aa4db-788d-42fa-b9ad-b9e266f657b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:32.089302 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0aa4db-788d-42fa-b9ad-b9e266f657b9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:32.100263 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:32.104602 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0aa4db-788d-42fa-b9ad-b9e266f657b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:09:32.114304 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-2d0aa4db-788d-42fa-b9ad-b9e266f657b9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 20:09:32.114304 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:32.114304 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:32.114304 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:32.114304 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:32.114304 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:32.114304 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:32.114304 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:32.114304 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:32.114304 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:32.114304 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:32.114304 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:32.114304 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:09:32.114304 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:09:32.114304 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:09:32.114304 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:09:32.115470 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:09:32.115470 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:09:32.115470 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:09:32.115470 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:09:32.115470 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:32.115470 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:32.115470 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:32.115470 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:32.115470 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:32.115470 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:32.115470 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:32.115470 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:32.115470 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:32.115470 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:32.115470 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:32.115470 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:32.116552 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:32.116552 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:32.116552 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:32.116552 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:32.116552 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:09:32.116552 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:09:32.116552 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:09:32.116552 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:09:32.116552 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:09:32.116552 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:09:32.116552 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 20:09:32.116552 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:32.119417 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 471/939] 10.222.0.15 () {56 vars in 1120 bytes} [Tue Jun 21 20:09:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:32.125106 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54188d6c-590d-4bf8-b382-cfd7c88f62b6 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:32.228231 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54188d6c-590d-4bf8-b382-cfd7c88f62b6 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:32.264625 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf207a-3308-44b0-bea9-9c0316f03272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:32.265306 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf207a-3308-44b0-bea9-9c0316f03272 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:32.265595 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf207a-3308-44b0-bea9-9c0316f03272 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:32.265877 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf207a-3308-44b0-bea9-9c0316f03272 None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:32.266634 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaf207a-3308-44b0-bea9-9c0316f03272 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:32.266948 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaf207a-3308-44b0-bea9-9c0316f03272 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:32.268398 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaf207a-3308-44b0-bea9-9c0316f03272 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:32.277158 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 469/940] 10.222.0.15 () {56 vars in 1115 bytes} [Tue Jun 21 20:09:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:32.282768 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0aa4db-788d-42fa-b9ad-b9e266f657b9 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:32.299758 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4afceec-90ae-4a20-9222-c6cda9383b56 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:32.300116 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4afceec-90ae-4a20-9222-c6cda9383b56 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:32.300368 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4afceec-90ae-4a20-9222-c6cda9383b56 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:32.302562 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 470/941] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:09:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:09:32.307250 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e46e24-053f-40e6-ba23-0c7c4a2f822c None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:32.307692 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e46e24-053f-40e6-ba23-0c7c4a2f822c None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:32.307801 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e46e24-053f-40e6-ba23-0c7c4a2f822c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:32.331452 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-b1e46e24-053f-40e6-ba23-0c7c4a2f822c None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:09:32.332768 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-b1e46e24-053f-40e6-ba23-0c7c4a2f822c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:09:32.341306 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:32.410471 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0aa4db-788d-42fa-b9ad-b9e266f657b9 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:32.419996 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 471/942] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:09:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 20:09:32.441323 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e46e24-053f-40e6-ba23-0c7c4a2f822c None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:32.455895 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a0e329-ffd8-4e58-81b5-11254f7dcf93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:32.457129 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0e329-ffd8-4e58-81b5-11254f7dcf93 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:32.457646 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0e329-ffd8-4e58-81b5-11254f7dcf93 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:32.458149 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0e329-ffd8-4e58-81b5-11254f7dcf93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:32.469371 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a0e329-ffd8-4e58-81b5-11254f7dcf93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:32.471281 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a0e329-ffd8-4e58-81b5-11254f7dcf93 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:32.492090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-84a0e329-ffd8-4e58-81b5-11254f7dcf93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:32.492090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:32.492090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:32.492090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:32.492090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:32.492090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:32.492090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:32.492090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:32.492090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:32.492090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:32.492090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:32.492090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:32.492090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:09:32.492090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:09:32.492090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:09:32.493068 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:09:32.493068 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:32.493068 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:32.493068 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:32.493068 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:32.493068 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:32.493068 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:32.493068 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:32.493068 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:32.493068 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:32.493068 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:32.493068 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:32.493068 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:32.493068 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:32.493068 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:32.493068 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:32.493068 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:32.493996 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:09:32.493996 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:09:32.493996 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:32.493996 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:32.496366 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 472/943] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:09:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:32.502134 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a0e329-ffd8-4e58-81b5-11254f7dcf93 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:32.548022 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e46e24-053f-40e6-ba23-0c7c4a2f822c None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:32.558366 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:32.584917 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e774574-91d1-4b9a-b50e-11f61490113c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:32.585878 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e774574-91d1-4b9a-b50e-11f61490113c None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:32.586231 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e774574-91d1-4b9a-b50e-11f61490113c None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:32.586584 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e774574-91d1-4b9a-b50e-11f61490113c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:32.587363 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e774574-91d1-4b9a-b50e-11f61490113c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:32.588992 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e774574-91d1-4b9a-b50e-11f61490113c None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:32.601924 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-9e774574-91d1-4b9a-b50e-11f61490113c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 20:09:32.601924 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:32.601924 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 20:09:32.601924 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 20:09:32.601924 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 20:09:32.601924 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 20:09:32.601924 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 20:09:32.601924 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 20:09:32.601924 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 20:09:32.601924 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:32.601924 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 20:09:32.601924 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:32.601924 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:32.601924 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:32.601924 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:32.601924 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:32.601924 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:32.602967 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:32.602967 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:32.602967 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:32.602967 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:32.602967 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:32.602967 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:32.602967 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 20:09:32.602967 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 20:09:32.602967 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 20:09:32.602967 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 20:09:32.602967 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:32.602967 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:32.602967 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:32.602967 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:32.602967 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:32.602967 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:32.603827 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:32.603827 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:32.603827 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:32.603827 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:32.603827 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:32.603827 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:32.603827 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:32.603827 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:32.603827 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:32.603827 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:32.603827 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 20:09:32.603827 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 20:09:32.603827 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 20:09:32.603827 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:32.608118 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 472/944] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jun 21 20:09:32 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:09:32.609247 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e774574-91d1-4b9a-b50e-11f61490113c None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:32.616955 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a0e329-ffd8-4e58-81b5-11254f7dcf93 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:32.619717 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:32.656795 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b5a08e-4cd7-4520-aa97-520cf3832a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:32.657832 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5a08e-4cd7-4520-aa97-520cf3832a02 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:32.658343 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5a08e-4cd7-4520-aa97-520cf3832a02 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:32.658838 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5a08e-4cd7-4520-aa97-520cf3832a02 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:32.659774 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b5a08e-4cd7-4520-aa97-520cf3832a02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:32.660857 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b5a08e-4cd7-4520-aa97-520cf3832a02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:32.662444 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b5a08e-4cd7-4520-aa97-520cf3832a02 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:32.680383 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 473/945] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:09:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:32.681560 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b5a08e-4cd7-4520-aa97-520cf3832a02 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:32.719831 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e774574-91d1-4b9a-b50e-11f61490113c None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:32.761670 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242be1c6-b531-4acf-be74-6a3cbb41f011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:32.763149 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242be1c6-b531-4acf-be74-6a3cbb41f011 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:32.764093 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242be1c6-b531-4acf-be74-6a3cbb41f011 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:32.764605 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242be1c6-b531-4acf-be74-6a3cbb41f011 None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:32.765745 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242be1c6-b531-4acf-be74-6a3cbb41f011 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:32.766214 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242be1c6-b531-4acf-be74-6a3cbb41f011 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:32.768522 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242be1c6-b531-4acf-be74-6a3cbb41f011 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:32.775608 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 473/946] 10.222.0.15 () {56 vars in 1112 bytes} [Tue Jun 21 20:09:32 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:32.780424 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242be1c6-b531-4acf-be74-6a3cbb41f011 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:32.793106 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b5a08e-4cd7-4520-aa97-520cf3832a02 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:32.808067 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:32.830861 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4bb322-d94e-44f7-a817-9bacfb9e5a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:32.833016 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4bb322-d94e-44f7-a817-9bacfb9e5a10 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:32.833505 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4bb322-d94e-44f7-a817-9bacfb9e5a10 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:32.833986 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4bb322-d94e-44f7-a817-9bacfb9e5a10 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:32.842013 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4bb322-d94e-44f7-a817-9bacfb9e5a10 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:32.843827 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4bb322-d94e-44f7-a817-9bacfb9e5a10 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:32.861108 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-6a4bb322-d94e-44f7-a817-9bacfb9e5a10 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 20:09:32.861108 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:32.861108 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:32.861108 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:32.861108 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:32.861108 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:32.861108 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:32.861108 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:32.861108 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:32.861108 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:32.861108 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:32.861108 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:32.861108 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 20:09:32.861108 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 20:09:32.861108 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 20:09:32.861108 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 20:09:32.862052 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:32.862052 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:32.862052 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 20:09:32.862052 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:09:32.862052 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 20:09:32.862052 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:09:32.862052 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:32.862052 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:32.862052 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:32.862052 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:32.862052 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:32.862052 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:32.862052 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:32.862052 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:32.862052 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:32.862052 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:32.862052 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:32.862052 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:32.863010 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:32.863010 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:32.863010 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 20:09:32.863010 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 20:09:32.863010 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 20:09:32.863010 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 20:09:32.863010 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 20:09:32.863010 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 20:09:32.863010 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 20:09:32.863010 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:32.870089 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:32.870395 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 474/947] 10.222.0.15 () {56 vars in 1117 bytes} [Tue Jun 21 20:09:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:32.871428 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4bb322-d94e-44f7-a817-9bacfb9e5a10 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:32.899895 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242be1c6-b531-4acf-be74-6a3cbb41f011 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:32.935960 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29594f6-17f3-4887-8307-5c9b734e1e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:32.936619 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29594f6-17f3-4887-8307-5c9b734e1e46 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:32.936937 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29594f6-17f3-4887-8307-5c9b734e1e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:32.937211 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29594f6-17f3-4887-8307-5c9b734e1e46 None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:32.937888 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29594f6-17f3-4887-8307-5c9b734e1e46 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:32.938280 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29594f6-17f3-4887-8307-5c9b734e1e46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:32.939559 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29594f6-17f3-4887-8307-5c9b734e1e46 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:32.944991 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 474/948] 10.222.0.15 () {56 vars in 1112 bytes} [Tue Jun 21 20:09:32 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:09:32.946083 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a9834-7113-4654-b895-2f171ff271eb None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:32.946374 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a9834-7113-4654-b895-2f171ff271eb None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:32.946656 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a9834-7113-4654-b895-2f171ff271eb None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:32.952030 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 475/949] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:09:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:09:32.954311 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed79da-1973-4d70-a3c4-dd4dd762ab4c None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:32.954602 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed79da-1973-4d70-a3c4-dd4dd762ab4c None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:32.954885 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed79da-1973-4d70-a3c4-dd4dd762ab4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:32.977775 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-58ed79da-1973-4d70-a3c4-dd4dd762ab4c None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:09:32.979062 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-58ed79da-1973-4d70-a3c4-dd4dd762ab4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:09:33.000471 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4bb322-d94e-44f7-a817-9bacfb9e5a10 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:33.042527 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d6d95-2cf6-4d23-994d-961ab89a1edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:33.043408 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d6d95-2cf6-4d23-994d-961ab89a1edf None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:33.043690 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d6d95-2cf6-4d23-994d-961ab89a1edf None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:33.044075 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d6d95-2cf6-4d23-994d-961ab89a1edf None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:33.045001 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432d6d95-2cf6-4d23-994d-961ab89a1edf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:33.045385 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432d6d95-2cf6-4d23-994d-961ab89a1edf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:33.047038 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432d6d95-2cf6-4d23-994d-961ab89a1edf None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:33.067126 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 475/950] 10.222.0.15 () {56 vars in 1149 bytes} [Tue Jun 21 20:09:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:33.072748 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d6d95-2cf6-4d23-994d-961ab89a1edf None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:33.074616 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 476/951] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:09:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 20:09:33.100225 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed79da-1973-4d70-a3c4-dd4dd762ab4c None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:33.108690 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:33.181164 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:33.190335 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d6d95-2cf6-4d23-994d-961ab89a1edf None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:33.226716 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed79da-1973-4d70-a3c4-dd4dd762ab4c None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:33.228330 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ecd0a1-785f-40d4-bd41-b7a5f978795b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:33.229144 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ecd0a1-785f-40d4-bd41-b7a5f978795b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:33.229544 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ecd0a1-785f-40d4-bd41-b7a5f978795b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:33.229824 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ecd0a1-785f-40d4-bd41-b7a5f978795b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:33.241066 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ecd0a1-785f-40d4-bd41-b7a5f978795b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:33.242689 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ecd0a1-785f-40d4-bd41-b7a5f978795b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:33.265124 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479684c8-9151-4397-861d-f7796076e959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:33.266093 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479684c8-9151-4397-861d-f7796076e959 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:33.266516 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479684c8-9151-4397-861d-f7796076e959 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:33.266891 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479684c8-9151-4397-861d-f7796076e959 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:33.267177 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-f0ecd0a1-785f-40d4-bd41-b7a5f978795b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:33.267177 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:33.267177 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:33.267177 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:33.267177 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:33.267177 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:33.267177 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:33.267177 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:33.267177 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:33.267177 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:33.267177 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:33.267177 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:33.267177 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:09:33.267177 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:09:33.267177 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:09:33.268227 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:09:33.268227 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:33.268227 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:33.268227 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:33.268227 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:33.268227 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:33.268227 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:33.268227 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:33.268227 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:33.268227 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:33.268227 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:33.268227 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:33.268227 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:33.268227 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:33.268227 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:33.268227 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:33.268227 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:33.269128 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:09:33.269128 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:09:33.269128 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:33.269128 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:33.269360 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479684c8-9151-4397-861d-f7796076e959 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:33.269434 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 476/952] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:09:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:33.271126 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479684c8-9151-4397-861d-f7796076e959 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:33.276485 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ecd0a1-785f-40d4-bd41-b7a5f978795b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:33.285917 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-479684c8-9151-4397-861d-f7796076e959 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 20:09:33.285917 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:33.285917 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 20:09:33.285917 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 20:09:33.285917 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 20:09:33.285917 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 20:09:33.285917 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 20:09:33.285917 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 20:09:33.285917 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 20:09:33.285917 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:33.285917 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 20:09:33.285917 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:33.285917 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:33.285917 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:33.285917 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:33.285917 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:33.285917 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:33.286963 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:33.286963 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:33.286963 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:33.286963 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:33.286963 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:33.286963 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:33.286963 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 20:09:33.286963 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 20:09:33.286963 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 20:09:33.286963 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 20:09:33.286963 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:33.286963 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:33.286963 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:33.286963 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:33.286963 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:33.286963 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:33.287805 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:33.287805 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:33.287805 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:33.287805 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:33.287805 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:33.287805 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:33.287805 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:33.287805 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:33.287805 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:33.287805 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:33.287805 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 20:09:33.287805 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 20:09:33.287805 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 20:09:33.287805 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:33.287805 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 477/953] 10.222.0.15 () {56 vars in 1126 bytes} [Tue Jun 21 20:09:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:09:33.295443 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479684c8-9151-4397-861d-f7796076e959 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:33.361211 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:33.380910 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ecd0a1-785f-40d4-bd41-b7a5f978795b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:33.403940 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479684c8-9151-4397-861d-f7796076e959 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:33.415983 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd5f8d3-80d2-45fc-872d-6d8f1016cb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:33.416687 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5f8d3-80d2-45fc-872d-6d8f1016cb03 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:33.416997 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5f8d3-80d2-45fc-872d-6d8f1016cb03 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:33.417243 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5f8d3-80d2-45fc-872d-6d8f1016cb03 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:33.417972 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd5f8d3-80d2-45fc-872d-6d8f1016cb03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:33.418337 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd5f8d3-80d2-45fc-872d-6d8f1016cb03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:33.419702 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd5f8d3-80d2-45fc-872d-6d8f1016cb03 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:33.436029 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 477/954] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:09:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:33.437921 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd5f8d3-80d2-45fc-872d-6d8f1016cb03 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:33.440238 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:33.452286 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3888500b-7730-4381-9ace-4a0c20a19d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:33.453370 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888500b-7730-4381-9ace-4a0c20a19d7d None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:33.453866 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888500b-7730-4381-9ace-4a0c20a19d7d None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:33.454374 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888500b-7730-4381-9ace-4a0c20a19d7d None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:33.455318 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3888500b-7730-4381-9ace-4a0c20a19d7d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:33.455967 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3888500b-7730-4381-9ace-4a0c20a19d7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:33.458261 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3888500b-7730-4381-9ace-4a0c20a19d7d None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:33.468694 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 478/955] 10.222.0.15 () {56 vars in 1122 bytes} [Tue Jun 21 20:09:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:09:33.469933 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3888500b-7730-4381-9ace-4a0c20a19d7d None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:33.556328 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd5f8d3-80d2-45fc-872d-6d8f1016cb03 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:33.581049 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3888500b-7730-4381-9ace-4a0c20a19d7d None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:33.596354 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a8a52-c5ac-44d5-a6b4-4311b212cb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:33.597277 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a8a52-c5ac-44d5-a6b4-4311b212cb8d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:33.597566 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a8a52-c5ac-44d5-a6b4-4311b212cb8d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:33.598050 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a8a52-c5ac-44d5-a6b4-4311b212cb8d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:33.605258 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a8a52-c5ac-44d5-a6b4-4311b212cb8d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:33.606707 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a8a52-c5ac-44d5-a6b4-4311b212cb8d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:33.615876 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756901b8-0fd9-46c5-a30e-ef7252960789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:33.616604 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756901b8-0fd9-46c5-a30e-ef7252960789 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:33.616932 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756901b8-0fd9-46c5-a30e-ef7252960789 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:33.617247 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756901b8-0fd9-46c5-a30e-ef7252960789 None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:33.618006 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756901b8-0fd9-46c5-a30e-ef7252960789 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:33.618322 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756901b8-0fd9-46c5-a30e-ef7252960789 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:33.619821 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756901b8-0fd9-46c5-a30e-ef7252960789 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:33.622371 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-4c5a8a52-c5ac-44d5-a6b4-4311b212cb8d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:09:33.622371 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:33.622371 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:33.622371 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:33.622371 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:33.622371 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:33.622371 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:33.622371 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:33.622371 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:33.622371 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:33.622371 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:33.622371 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:33.622371 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 20:09:33.622371 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 20:09:33.622371 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 20:09:33.623258 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 20:09:33.623258 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:33.623258 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:33.623258 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:33.623258 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:33.623258 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:33.623258 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:33.623258 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:33.623258 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:33.623258 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:33.623258 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:33.623258 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:33.623258 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:33.623258 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:33.623258 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:33.623258 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:33.623258 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:33.624782 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 20:09:33.624782 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 20:09:33.624782 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 20:09:33.624782 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 20:09:33.624782 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 20:09:33.624782 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 20:09:33.624782 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:09:33.624782 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:33.624782 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 478/956] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jun 21 20:09:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:33.624782 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb2d9d-c628-4ed3-a84d-ee0b8638c2a0 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:33.625343 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb2d9d-c628-4ed3-a84d-ee0b8638c2a0 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:33.625343 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb2d9d-c628-4ed3-a84d-ee0b8638c2a0 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:33.626751 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 479/957] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:09:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:09:33.629994 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb2d9d-c628-4ed3-a84d-ee0b8638c2a0 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:33.631462 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 479/958] 10.222.0.15 () {56 vars in 1122 bytes} [Tue Jun 21 20:09:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:33.632733 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc366d-6ab2-42bc-bbd9-9e3f4c6aa26d None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:33.633030 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc366d-6ab2-42bc-bbd9-9e3f4c6aa26d None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:33.633313 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc366d-6ab2-42bc-bbd9-9e3f4c6aa26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:33.634111 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:33.650798 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-49cc366d-6ab2-42bc-bbd9-9e3f4c6aa26d None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:09:33.652011 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-49cc366d-6ab2-42bc-bbd9-9e3f4c6aa26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:09:33.705944 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:33.735946 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 480/959] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:09:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 20:09:33.735946 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc366d-6ab2-42bc-bbd9-9e3f4c6aa26d None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:33.740517 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb2d9d-c628-4ed3-a84d-ee0b8638c2a0 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:33.777848 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3cb50-8181-4244-89a9-9d3b5c8fefd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:33.778512 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3cb50-8181-4244-89a9-9d3b5c8fefd1 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:33.778793 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3cb50-8181-4244-89a9-9d3b5c8fefd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:33.779069 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3cb50-8181-4244-89a9-9d3b5c8fefd1 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:33.779860 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb3cb50-8181-4244-89a9-9d3b5c8fefd1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:33.780212 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb3cb50-8181-4244-89a9-9d3b5c8fefd1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:33.781631 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb3cb50-8181-4244-89a9-9d3b5c8fefd1 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:33.798123 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 480/960] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jun 21 20:09:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:09:33.798123 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3cb50-8181-4244-89a9-9d3b5c8fefd1 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:33.853028 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc366d-6ab2-42bc-bbd9-9e3f4c6aa26d None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:33.865494 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:33.893345 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73171e5-f05c-49f7-93db-9e43f3a26dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:33.893935 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73171e5-f05c-49f7-93db-9e43f3a26dce None admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:33.894219 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73171e5-f05c-49f7-93db-9e43f3a26dce None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:33.894515 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73171e5-f05c-49f7-93db-9e43f3a26dce None admin] PATH_INFO: `/v3/endpoints` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:33.895262 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73171e5-f05c-49f7-93db-9e43f3a26dce None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:33.896718 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73171e5-f05c-49f7-93db-9e43f3a26dce None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:33.908783 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3cb50-8181-4244-89a9-9d3b5c8fefd1 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:33.923957 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 481/961] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Jun 21 20:09:33 2022] POST /identity/v3/endpoints => generated 349 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:09:33.923957 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73171e5-f05c-49f7-93db-9e43f3a26dce None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:33.968504 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:33.975759 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33aafcf-16b2-4965-bff1-2e84ef68d391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:33.976558 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33aafcf-16b2-4965-bff1-2e84ef68d391 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:33.977157 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33aafcf-16b2-4965-bff1-2e84ef68d391 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:33.977447 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33aafcf-16b2-4965-bff1-2e84ef68d391 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:33.978184 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33aafcf-16b2-4965-bff1-2e84ef68d391 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:33.980327 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33aafcf-16b2-4965-bff1-2e84ef68d391 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:33.981877 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: WARNING keystone.server.flask.common [None req-e33aafcf-16b2-4965-bff1-2e84ef68d391 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 21 20:09:34.000701 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.sql.core [None req-e33aafcf-16b2-4965-bff1-2e84ef68d391 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 21 20:09:34.000701 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 21 20:09:34.000701 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [parameters: {'user_id': 'b43bc0cf231e471a968040f494f3af32', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 21 20:09:34.000701 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80135) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 21 20:09:34.010984 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-e33aafcf-16b2-4965-bff1-2e84ef68d391 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 21 20:09:34.010984 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:34.010984 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 21 20:09:34.010984 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 21 20:09:34.010984 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 21 20:09:34.010984 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 21 20:09:34.010984 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 21 20:09:34.010984 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application result = self._query(query) Jun 21 20:09:34.010984 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 21 20:09:34.010984 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application conn.query(q) Jun 21 20:09:34.010984 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 21 20:09:34.010984 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 21 20:09:34.010984 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 21 20:09:34.010984 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application result.read() Jun 21 20:09:34.010984 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 21 20:09:34.012002 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 21 20:09:34.012002 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 21 20:09:34.012002 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 21 20:09:34.012002 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 21 20:09:34.012002 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 21 20:09:34.012002 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 21 20:09:34.012002 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 21 20:09:34.012002 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 21 20:09:34.012002 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:34.012002 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 21 20:09:34.012002 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:34.012002 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:34.012002 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 21 20:09:34.012002 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 21 20:09:34.012002 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 21 20:09:34.012002 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 21 20:09:34.012002 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 21 20:09:34.012002 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application next(self.gen) Jun 21 20:09:34.012996 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 21 20:09:34.012996 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application yield resource Jun 21 20:09:34.012996 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 21 20:09:34.012996 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application next(self.gen) Jun 21 20:09:34.012996 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 21 20:09:34.012996 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self.session.rollback() Jun 21 20:09:34.012996 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 21 20:09:34.012996 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self.force_reraise() Jun 21 20:09:34.012996 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 21 20:09:34.012996 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise self.value Jun 21 20:09:34.012996 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 21 20:09:34.012996 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 21 20:09:34.012996 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 21 20:09:34.012996 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application session.commit() Jun 21 20:09:34.012996 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 21 20:09:34.012996 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 21 20:09:34.012996 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 21 20:09:34.013922 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._prepare_impl() Jun 21 20:09:34.013922 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 21 20:09:34.013922 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self.session.flush() Jun 21 20:09:34.013922 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 21 20:09:34.013922 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._flush(objects) Jun 21 20:09:34.013922 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 21 20:09:34.013922 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 21 20:09:34.013922 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 21 20:09:34.013922 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application compat.raise_( Jun 21 20:09:34.013922 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 21 20:09:34.013922 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception Jun 21 20:09:34.013922 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 21 20:09:34.013922 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application flush_context.execute() Jun 21 20:09:34.013922 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 21 20:09:34.013922 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rec.execute(self) Jun 21 20:09:34.013922 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 21 20:09:34.013922 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 21 20:09:34.014930 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 21 20:09:34.014930 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 21 20:09:34.014930 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 21 20:09:34.014930 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 21 20:09:34.014930 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 21 20:09:34.014930 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 21 20:09:34.014930 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 21 20:09:34.014930 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 21 20:09:34.014930 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 21 20:09:34.014930 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 21 20:09:34.014930 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 21 20:09:34.014930 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 21 20:09:34.014930 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 21 20:09:34.014930 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 21 20:09:34.014930 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 21 20:09:34.014930 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception Jun 21 20:09:34.015815 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 21 20:09:34.015815 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 21 20:09:34.015815 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 21 20:09:34.015815 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 21 20:09:34.015815 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 21 20:09:34.015815 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application result = self._query(query) Jun 21 20:09:34.015815 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 21 20:09:34.015815 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application conn.query(q) Jun 21 20:09:34.015815 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 21 20:09:34.015815 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 21 20:09:34.015815 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 21 20:09:34.015815 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application result.read() Jun 21 20:09:34.015815 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 21 20:09:34.015815 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 21 20:09:34.015815 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 21 20:09:34.015815 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 21 20:09:34.018532 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 21 20:09:34.018532 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 21 20:09:34.018532 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 21 20:09:34.018532 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 21 20:09:34.018532 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 21 20:09:34.018532 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 21 20:09:34.018532 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [parameters: {'user_id': 'b43bc0cf231e471a968040f494f3af32', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 21 20:09:34.018532 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 21 20:09:34.018532 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:34.018532 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 20:09:34.018532 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:34.018532 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:34.018532 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:34.018532 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:34.018532 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:34.019621 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:34.019621 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:34.019621 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:34.019621 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:34.019621 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:34.019621 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:34.019621 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:34.019621 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 21 20:09:34.019621 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 21 20:09:34.019621 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:34.019621 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:34.019621 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 20:09:34.019621 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:09:34.019621 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 20:09:34.019621 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:09:34.019621 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 21 20:09:34.019621 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 21 20:09:34.025512 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 21 20:09:34.025512 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 21 20:09:34.025512 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 21 20:09:34.025512 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 21 20:09:34.025512 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 21 20:09:34.025512 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:34.025512 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 481/962] 10.222.0.15 () {60 vars in 1131 bytes} [Tue Jun 21 20:09:33 2022] POST /identity/v3/users => generated 160 bytes in 222 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:34.025512 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33aafcf-16b2-4965-bff1-2e84ef68d391 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:34.047773 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73171e5-f05c-49f7-93db-9e43f3a26dce None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:34.093744 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f8a53-7867-4f3f-ad97-b29068a63ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:34.095074 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f8a53-7867-4f3f-ad97-b29068a63ad4 None admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:34.095380 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f8a53-7867-4f3f-ad97-b29068a63ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:34.095668 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f8a53-7867-4f3f-ad97-b29068a63ad4 None admin] PATH_INFO: `/v3/projects/4dcb71ef7b6e49148edd61a1eb8da7bb/users/5cf067b8833f4596a1b91073a66768f0/roles/1db2217c34b945f19d47444f74970dd5` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:34.098926 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6f8a53-7867-4f3f-ad97-b29068a63ad4 None admin] RBAC: Authorizing `identity:create_grant(project_id=4dcb71ef7b6e49148edd61a1eb8da7bb, user_id=5cf067b8833f4596a1b91073a66768f0, role_id=1db2217c34b945f19d47444f74970dd5)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:34.100738 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6f8a53-7867-4f3f-ad97-b29068a63ad4 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:34.119115 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 482/963] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Jun 21 20:09:33 2022] PUT /identity/v3/projects/4dcb71ef7b6e49148edd61a1eb8da7bb/users/5cf067b8833f4596a1b91073a66768f0/roles/1db2217c34b945f19d47444f74970dd5 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:09:34.156653 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33aafcf-16b2-4965-bff1-2e84ef68d391 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:34.186605 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:34.208466 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473eb8db-2edd-403c-9e32-6c96902a4078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:34.209350 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473eb8db-2edd-403c-9e32-6c96902a4078 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:34.209637 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473eb8db-2edd-403c-9e32-6c96902a4078 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:34.209921 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473eb8db-2edd-403c-9e32-6c96902a4078 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:34.219396 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473eb8db-2edd-403c-9e32-6c96902a4078 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:34.221121 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473eb8db-2edd-403c-9e32-6c96902a4078 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:34.239731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-473eb8db-2edd-403c-9e32-6c96902a4078 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 20:09:34.239731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:34.239731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:34.239731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:34.239731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:34.239731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:34.239731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:34.239731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:34.239731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:34.239731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:34.239731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:34.239731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:34.239731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 20:09:34.239731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 20:09:34.239731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 20:09:34.239731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 20:09:34.240831 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:34.240831 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:34.240831 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 20:09:34.240831 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:09:34.240831 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 20:09:34.240831 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:09:34.240831 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:34.240831 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:34.240831 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:34.240831 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:34.240831 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:34.240831 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:34.240831 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:34.240831 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:34.240831 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:34.240831 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:34.240831 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:34.240831 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:34.241802 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:34.241802 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:34.241802 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 20:09:34.241802 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 20:09:34.241802 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 20:09:34.241802 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 20:09:34.241802 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 20:09:34.241802 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 20:09:34.241802 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 20:09:34.241802 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:34.242358 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 482/964] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:09:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:09:34.247726 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f8a53-7867-4f3f-ad97-b29068a63ad4 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:34.364371 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f8a53-7867-4f3f-ad97-b29068a63ad4 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:34.366227 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:34.401092 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359d8006-d1f4-40b0-93e3-cc0402681c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:34.401780 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d8006-d1f4-40b0-93e3-cc0402681c38 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:34.402068 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d8006-d1f4-40b0-93e3-cc0402681c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:34.402352 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d8006-d1f4-40b0-93e3-cc0402681c38 None admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:34.403167 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359d8006-d1f4-40b0-93e3-cc0402681c38 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:34.403480 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359d8006-d1f4-40b0-93e3-cc0402681c38 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:34.404952 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359d8006-d1f4-40b0-93e3-cc0402681c38 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:34.441407 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 483/965] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Jun 21 20:09:34 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:35.079941 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405fffee-580d-4725-a187-3ddc755e1b39 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:35.080488 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405fffee-580d-4725-a187-3ddc755e1b39 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:35.080488 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405fffee-580d-4725-a187-3ddc755e1b39 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:35.084836 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 483/966] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:09:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:09:35.089810 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c5163-bd5e-4d5a-85d1-d7a953ba7395 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:35.090109 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c5163-bd5e-4d5a-85d1-d7a953ba7395 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:35.090392 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c5163-bd5e-4d5a-85d1-d7a953ba7395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:35.107412 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-539c5163-bd5e-4d5a-85d1-d7a953ba7395 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:09:35.108551 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-539c5163-bd5e-4d5a-85d1-d7a953ba7395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:09:35.178356 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 484/967] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:09:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 20:09:35.201087 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405fffee-580d-4725-a187-3ddc755e1b39 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:35.313854 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405fffee-580d-4725-a187-3ddc755e1b39 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:35.346820 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65fe16-bbc1-4a4b-a43d-bc919ba475d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:35.347489 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65fe16-bbc1-4a4b-a43d-bc919ba475d3 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:35.347804 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65fe16-bbc1-4a4b-a43d-bc919ba475d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:35.348114 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65fe16-bbc1-4a4b-a43d-bc919ba475d3 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:35.348844 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea65fe16-bbc1-4a4b-a43d-bc919ba475d3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:35.350212 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea65fe16-bbc1-4a4b-a43d-bc919ba475d3 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:35.365419 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 484/968] 10.222.0.15 () {60 vars in 1141 bytes} [Tue Jun 21 20:09:35 2022] POST /identity/v3/services => generated 242 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:09:36.081124 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188a8f3-e6fd-4e77-914b-8d77bb5c023a None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:36.081664 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188a8f3-e6fd-4e77-914b-8d77bb5c023a None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:36.081744 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188a8f3-e6fd-4e77-914b-8d77bb5c023a None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:36.083637 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 485/969] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:09:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:09:36.088784 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f36f4-1977-4cb9-ae16-065148dfd1cd None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:36.089211 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f36f4-1977-4cb9-ae16-065148dfd1cd None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:36.089387 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f36f4-1977-4cb9-ae16-065148dfd1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:36.107050 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e55f36f4-1977-4cb9-ae16-065148dfd1cd None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:09:36.108513 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e55f36f4-1977-4cb9-ae16-065148dfd1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:09:36.142754 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:36.184662 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 485/970] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:09:36 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 20:09:36.189886 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd20a49-6837-4205-9690-4b907a223676 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:36.190181 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd20a49-6837-4205-9690-4b907a223676 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:36.190518 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd20a49-6837-4205-9690-4b907a223676 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:36.192493 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 486/971] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:09:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:09:36.197219 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c0845-23b6-4ec2-a253-42c2701d8593 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:36.197516 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c0845-23b6-4ec2-a253-42c2701d8593 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:36.197799 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c0845-23b6-4ec2-a253-42c2701d8593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:36.208054 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd20a49-6837-4205-9690-4b907a223676 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:36.214707 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-454c0845-23b6-4ec2-a253-42c2701d8593 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:09:36.215897 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-454c0845-23b6-4ec2-a253-42c2701d8593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:09:36.291160 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 486/972] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:09:36 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 20:09:36.305919 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:36.314644 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c0845-23b6-4ec2-a253-42c2701d8593 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:36.318068 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd20a49-6837-4205-9690-4b907a223676 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:36.357396 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adbe3d1-b31f-4404-8cc7-891a64192c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:36.358123 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adbe3d1-b31f-4404-8cc7-891a64192c96 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:36.358405 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adbe3d1-b31f-4404-8cc7-891a64192c96 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:36.358682 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adbe3d1-b31f-4404-8cc7-891a64192c96 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:36.359590 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adbe3d1-b31f-4404-8cc7-891a64192c96 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:36.360994 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adbe3d1-b31f-4404-8cc7-891a64192c96 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:36.373711 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-7adbe3d1-b31f-4404-8cc7-891a64192c96 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 20:09:36.373711 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:36.373711 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 20:09:36.373711 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 20:09:36.373711 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 20:09:36.373711 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 20:09:36.373711 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 20:09:36.373711 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 20:09:36.373711 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 20:09:36.373711 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:36.373711 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 20:09:36.373711 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:36.373711 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:36.373711 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:36.373711 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:36.373711 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:36.373711 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:36.374720 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:36.374720 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:36.374720 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:36.374720 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:36.374720 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:36.374720 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:36.374720 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 20:09:36.374720 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 20:09:36.374720 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 20:09:36.374720 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 20:09:36.374720 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:36.374720 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:36.374720 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:36.374720 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:36.374720 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:36.374720 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:36.375565 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:36.375565 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:36.375565 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:36.375565 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:36.375565 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:36.375565 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:36.375565 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:36.375565 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:36.375565 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:36.375565 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:36.375565 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 20:09:36.375565 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 20:09:36.375565 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 20:09:36.375565 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:36.375565 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 487/973] 10.222.0.15 () {56 vars in 1126 bytes} [Tue Jun 21 20:09:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:09:36.381152 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adbe3d1-b31f-4404-8cc7-891a64192c96 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:36.421996 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:36.428629 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c0845-23b6-4ec2-a253-42c2701d8593 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:36.473417 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5dd03b-c20a-4508-9e0d-1c3cb295eccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:36.474878 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5dd03b-c20a-4508-9e0d-1c3cb295eccb None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:36.475325 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5dd03b-c20a-4508-9e0d-1c3cb295eccb None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:36.475617 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5dd03b-c20a-4508-9e0d-1c3cb295eccb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:36.485215 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adbe3d1-b31f-4404-8cc7-891a64192c96 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:36.487531 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5dd03b-c20a-4508-9e0d-1c3cb295eccb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:09:36.495884 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-4b5dd03b-c20a-4508-9e0d-1c3cb295eccb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 20:09:36.495884 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:36.495884 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:36.495884 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:36.495884 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:36.495884 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:36.495884 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:36.495884 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:36.495884 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:36.495884 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:36.495884 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:36.495884 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:36.495884 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:09:36.495884 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:09:36.495884 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:09:36.495884 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:09:36.497041 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:09:36.497041 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:09:36.497041 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:09:36.497041 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:09:36.497041 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:36.497041 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:36.497041 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:36.497041 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:36.497041 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:36.497041 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:36.497041 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:36.497041 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:36.497041 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:36.497041 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:36.497041 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:36.497041 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:36.497919 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:36.497919 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:36.497919 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:36.497919 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:36.497919 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:09:36.497919 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:09:36.497919 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:09:36.497919 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:09:36.497919 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:09:36.497919 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:09:36.497919 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 20:09:36.497919 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:36.497919 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 487/974] 10.222.0.15 () {56 vars in 1120 bytes} [Tue Jun 21 20:09:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:09:36.502801 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5dd03b-c20a-4508-9e0d-1c3cb295eccb None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:36.525407 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48757bdd-50d5-4444-b0ad-0a4f4e53d161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:36.526076 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48757bdd-50d5-4444-b0ad-0a4f4e53d161 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:36.526370 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48757bdd-50d5-4444-b0ad-0a4f4e53d161 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:36.526655 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48757bdd-50d5-4444-b0ad-0a4f4e53d161 None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:36.527365 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48757bdd-50d5-4444-b0ad-0a4f4e53d161 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:36.527684 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48757bdd-50d5-4444-b0ad-0a4f4e53d161 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:36.529089 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48757bdd-50d5-4444-b0ad-0a4f4e53d161 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:36.534010 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 488/975] 10.222.0.15 () {56 vars in 1122 bytes} [Tue Jun 21 20:09:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:09:36.539494 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48757bdd-50d5-4444-b0ad-0a4f4e53d161 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:36.560079 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:36.610944 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5dd03b-c20a-4508-9e0d-1c3cb295eccb None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:36.647618 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f996f-d13c-4f56-b16b-9f605f72048c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:36.648385 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f996f-d13c-4f56-b16b-9f605f72048c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:36.648672 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f996f-d13c-4f56-b16b-9f605f72048c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:36.648952 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f996f-d13c-4f56-b16b-9f605f72048c None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:36.649702 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f996f-d13c-4f56-b16b-9f605f72048c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:36.650014 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f996f-d13c-4f56-b16b-9f605f72048c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:36.651378 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f996f-d13c-4f56-b16b-9f605f72048c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:36.652272 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48757bdd-50d5-4444-b0ad-0a4f4e53d161 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:36.660981 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 488/976] 10.222.0.15 () {56 vars in 1115 bytes} [Tue Jun 21 20:09:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:09:36.666367 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f996f-d13c-4f56-b16b-9f605f72048c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:36.687437 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:36.691083 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a35bf-d835-4ccf-976d-233a68a4ce33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:36.692327 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a35bf-d835-4ccf-976d-233a68a4ce33 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:36.692622 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a35bf-d835-4ccf-976d-233a68a4ce33 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:36.692895 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a35bf-d835-4ccf-976d-233a68a4ce33 None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:36.693609 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a35bf-d835-4ccf-976d-233a68a4ce33 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:36.694021 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a35bf-d835-4ccf-976d-233a68a4ce33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:36.695286 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a35bf-d835-4ccf-976d-233a68a4ce33 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:36.700397 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 489/977] 10.222.0.15 () {56 vars in 1122 bytes} [Tue Jun 21 20:09:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:09:36.705810 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a35bf-d835-4ccf-976d-233a68a4ce33 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:36.772991 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f996f-d13c-4f56-b16b-9f605f72048c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:36.798768 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:36.809702 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a317d-22ee-4711-8c4c-688e344f2de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:36.810561 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a317d-22ee-4711-8c4c-688e344f2de4 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:36.810852 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a317d-22ee-4711-8c4c-688e344f2de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:36.811133 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a317d-22ee-4711-8c4c-688e344f2de4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:36.818528 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a35bf-d835-4ccf-976d-233a68a4ce33 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:36.823320 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039a317d-22ee-4711-8c4c-688e344f2de4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:36.824773 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039a317d-22ee-4711-8c4c-688e344f2de4 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:36.842210 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-039a317d-22ee-4711-8c4c-688e344f2de4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:36.842210 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:36.842210 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:36.842210 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:36.842210 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:36.842210 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:36.842210 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:36.842210 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:36.842210 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:36.842210 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:36.842210 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:36.842210 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:36.842210 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:09:36.842210 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:09:36.842210 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:09:36.843140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:09:36.843140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:36.843140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:36.843140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:36.843140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:36.843140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:36.843140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:36.843140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:36.843140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:36.843140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:36.843140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:36.843140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:36.843140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:36.843140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:36.843140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:36.843140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:36.843140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:36.844842 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:09:36.844842 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:09:36.844842 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:36.844842 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:36.844842 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 489/978] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:09:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:36.848863 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a317d-22ee-4711-8c4c-688e344f2de4 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:36.863946 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a6873-51af-4dcd-90c7-b2b8dafbd5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:36.864242 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a6873-51af-4dcd-90c7-b2b8dafbd5e5 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:36.864529 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a6873-51af-4dcd-90c7-b2b8dafbd5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:36.864806 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a6873-51af-4dcd-90c7-b2b8dafbd5e5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:36.865621 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a6873-51af-4dcd-90c7-b2b8dafbd5e5 None admin] RBAC: Adding query filter params (interface=admin, service_id=67b495e61f314c5dbf4cd61185c7f6c8, region_id=RegionOne) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:36.865970 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a6873-51af-4dcd-90c7-b2b8dafbd5e5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:36.867313 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a6873-51af-4dcd-90c7-b2b8dafbd5e5 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:36.873076 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 490/979] 10.222.0.15 () {56 vars in 1249 bytes} [Tue Jun 21 20:09:36 2022] GET /identity/v3/endpoints?service_id=67b495e61f314c5dbf4cd61185c7f6c8&interface=admin®ion_id=RegionOne => generated 193 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:09:36.878496 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a6873-51af-4dcd-90c7-b2b8dafbd5e5 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:36.923811 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:36.959604 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a317d-22ee-4711-8c4c-688e344f2de4 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:36.992188 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a6873-51af-4dcd-90c7-b2b8dafbd5e5 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:36.996781 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69351bef-1bd1-4fdb-b06a-e9a9ba1d6a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:36.997454 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69351bef-1bd1-4fdb-b06a-e9a9ba1d6a3c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:36.997743 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69351bef-1bd1-4fdb-b06a-e9a9ba1d6a3c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:36.998023 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69351bef-1bd1-4fdb-b06a-e9a9ba1d6a3c None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:36.998748 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69351bef-1bd1-4fdb-b06a-e9a9ba1d6a3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:36.999058 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69351bef-1bd1-4fdb-b06a-e9a9ba1d6a3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:37.000462 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69351bef-1bd1-4fdb-b06a-e9a9ba1d6a3c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:37.013165 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 490/980] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:09:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:09:37.018557 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69351bef-1bd1-4fdb-b06a-e9a9ba1d6a3c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:37.027587 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e9fe34-21c9-4a03-b2fd-1fd77fd5fab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:37.028298 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e9fe34-21c9-4a03-b2fd-1fd77fd5fab2 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:37.028592 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e9fe34-21c9-4a03-b2fd-1fd77fd5fab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:37.028880 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e9fe34-21c9-4a03-b2fd-1fd77fd5fab2 None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:37.029571 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e9fe34-21c9-4a03-b2fd-1fd77fd5fab2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:37.030937 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e9fe34-21c9-4a03-b2fd-1fd77fd5fab2 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:37.037868 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 491/981] 10.222.0.15 () {56 vars in 1087 bytes} [Tue Jun 21 20:09:36 2022] GET /identity/v3/services => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 20:09:37.138885 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69351bef-1bd1-4fdb-b06a-e9a9ba1d6a3c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:37.169999 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:37.177910 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4bede-de46-4938-9392-2af98d2e363f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:37.178755 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4bede-de46-4938-9392-2af98d2e363f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:37.179045 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4bede-de46-4938-9392-2af98d2e363f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:37.179352 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4bede-de46-4938-9392-2af98d2e363f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:37.187130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c4bede-de46-4938-9392-2af98d2e363f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:37.188612 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c4bede-de46-4938-9392-2af98d2e363f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:37.204657 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-b3c4bede-de46-4938-9392-2af98d2e363f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 20:09:37.204657 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:37.204657 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:37.204657 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:37.204657 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:37.204657 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:37.204657 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:37.204657 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:37.204657 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:37.204657 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:37.204657 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:37.204657 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:37.204657 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 20:09:37.204657 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 20:09:37.204657 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 20:09:37.204657 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 20:09:37.205597 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:37.205597 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:37.205597 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 20:09:37.205597 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:09:37.205597 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 20:09:37.205597 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:09:37.205597 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:37.205597 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:37.205597 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:37.205597 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:37.205597 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:37.205597 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:37.205597 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:37.205597 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:37.205597 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:37.205597 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:37.205597 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:37.205597 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:37.206548 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:37.206548 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:37.206548 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 20:09:37.206548 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 20:09:37.206548 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 20:09:37.206548 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 20:09:37.206548 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 20:09:37.206548 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 20:09:37.206548 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 20:09:37.206548 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:37.210579 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 491/982] 10.222.0.15 () {56 vars in 1117 bytes} [Tue Jun 21 20:09:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:37.211931 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e9fe34-21c9-4a03-b2fd-1fd77fd5fab2 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:37.226255 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:37.316513 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e9fe34-21c9-4a03-b2fd-1fd77fd5fab2 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:37.350987 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6da24e-bf48-404e-a7df-a65f9e39c0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:37.351664 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6da24e-bf48-404e-a7df-a65f9e39c0ea None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:37.351974 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6da24e-bf48-404e-a7df-a65f9e39c0ea None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:37.352250 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6da24e-bf48-404e-a7df-a65f9e39c0ea None admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:37.353091 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6da24e-bf48-404e-a7df-a65f9e39c0ea None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:37.353406 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6da24e-bf48-404e-a7df-a65f9e39c0ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:37.354831 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6da24e-bf48-404e-a7df-a65f9e39c0ea None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:37.372849 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 492/983] 10.222.0.15 () {56 vars in 1149 bytes} [Tue Jun 21 20:09:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:09:37.378280 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4bede-de46-4938-9392-2af98d2e363f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:37.396690 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0498b-6d94-4559-bffe-f166cdabab98 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:37.396981 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0498b-6d94-4559-bffe-f166cdabab98 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:37.397151 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0498b-6d94-4559-bffe-f166cdabab98 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:37.398643 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 493/984] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:09:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 20:09:37.403284 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5ded1-1ba3-4a12-a664-bd4027bce025 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:37.403569 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5ded1-1ba3-4a12-a664-bd4027bce025 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:37.403842 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5ded1-1ba3-4a12-a664-bd4027bce025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:37.421315 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-5bc5ded1-1ba3-4a12-a664-bd4027bce025 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:09:37.422489 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-5bc5ded1-1ba3-4a12-a664-bd4027bce025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:09:37.487534 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:37.491995 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4bede-de46-4938-9392-2af98d2e363f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:37.494955 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 494/985] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:09:37 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 20:09:37.516521 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc5ded1-1ba3-4a12-a664-bd4027bce025 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:37.532451 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb544674-7ce1-4724-9557-b475cee9b098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:37.533110 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb544674-7ce1-4724-9557-b475cee9b098 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:37.533394 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb544674-7ce1-4724-9557-b475cee9b098 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:37.533670 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb544674-7ce1-4724-9557-b475cee9b098 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:37.593549 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:37.605045 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb544674-7ce1-4724-9557-b475cee9b098 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:37.606503 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb544674-7ce1-4724-9557-b475cee9b098 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:37.621900 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc5ded1-1ba3-4a12-a664-bd4027bce025 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:37.661272 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978078cc-1360-4f02-ac74-8175881e4f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:37.662435 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978078cc-1360-4f02-ac74-8175881e4f91 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:37.662762 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978078cc-1360-4f02-ac74-8175881e4f91 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:37.663009 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978078cc-1360-4f02-ac74-8175881e4f91 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:37.663672 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978078cc-1360-4f02-ac74-8175881e4f91 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:37.665145 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978078cc-1360-4f02-ac74-8175881e4f91 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:37.677559 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-978078cc-1360-4f02-ac74-8175881e4f91 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 20:09:37.677559 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:37.677559 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 20:09:37.677559 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 20:09:37.677559 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 20:09:37.677559 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 20:09:37.677559 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 20:09:37.677559 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 20:09:37.677559 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 20:09:37.677559 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:37.677559 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 20:09:37.677559 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:37.677559 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:37.677559 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:37.677559 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:37.677559 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:37.677559 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:37.678671 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:37.678671 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:37.678671 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:37.678671 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:37.678671 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:37.678671 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:37.678671 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 20:09:37.678671 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 20:09:37.678671 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 20:09:37.678671 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 20:09:37.678671 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:37.678671 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:37.678671 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:37.678671 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:37.678671 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:37.678671 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:37.679544 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:37.679544 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:37.679544 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:37.679544 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:37.679544 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:37.679544 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:37.679544 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:37.679544 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:37.679544 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:37.679544 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:37.679544 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 20:09:37.679544 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 20:09:37.679544 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 20:09:37.679544 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:37.679544 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 495/986] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jun 21 20:09:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:09:37.684430 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978078cc-1360-4f02-ac74-8175881e4f91 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:37.715976 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 492/987] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:09:37 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 20:09:37.720116 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb544674-7ce1-4724-9557-b475cee9b098 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:37.753140 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:37.795892 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978078cc-1360-4f02-ac74-8175881e4f91 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:37.812239 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:37.824306 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb544674-7ce1-4724-9557-b475cee9b098 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:37.831320 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a23e89-5c50-45b5-be1f-0a29b615ff22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:37.832630 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a23e89-5c50-45b5-be1f-0a29b615ff22 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:37.832924 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a23e89-5c50-45b5-be1f-0a29b615ff22 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:37.833206 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a23e89-5c50-45b5-be1f-0a29b615ff22 None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:37.833921 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a23e89-5c50-45b5-be1f-0a29b615ff22 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:37.834235 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a23e89-5c50-45b5-be1f-0a29b615ff22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:37.835617 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a23e89-5c50-45b5-be1f-0a29b615ff22 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:37.840767 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 496/988] 10.222.0.15 () {56 vars in 1112 bytes} [Tue Jun 21 20:09:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:09:37.845807 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a23e89-5c50-45b5-be1f-0a29b615ff22 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:37.870523 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd640d-1360-430a-8c7f-744cae24eb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:37.871329 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd640d-1360-430a-8c7f-744cae24eb1b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:37.871618 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd640d-1360-430a-8c7f-744cae24eb1b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:37.871903 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd640d-1360-430a-8c7f-744cae24eb1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:37.882677 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecd640d-1360-430a-8c7f-744cae24eb1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:37.884144 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecd640d-1360-430a-8c7f-744cae24eb1b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:37.902178 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-fecd640d-1360-430a-8c7f-744cae24eb1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:37.902178 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:37.902178 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:37.902178 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:37.902178 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:37.902178 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:37.902178 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:37.902178 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:37.902178 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:37.902178 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:37.902178 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:37.902178 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:37.902178 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:09:37.902178 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:09:37.902178 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:09:37.903078 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:09:37.903078 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:37.903078 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:37.903078 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:37.903078 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:37.903078 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:37.903078 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:37.903078 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:37.903078 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:37.903078 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:37.903078 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:37.903078 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:37.903078 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:37.903078 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:37.903078 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:37.903078 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:37.903078 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:37.904056 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:09:37.904056 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:09:37.904056 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:37.904056 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:37.904056 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 493/989] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:09:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:09:37.908770 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd640d-1360-430a-8c7f-744cae24eb1b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:37.956010 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a23e89-5c50-45b5-be1f-0a29b615ff22 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:37.983014 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:37.993304 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fff503-abe8-48ee-8d5a-f9350a594b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:37.994229 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fff503-abe8-48ee-8d5a-f9350a594b7c None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:37.994229 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fff503-abe8-48ee-8d5a-f9350a594b7c None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:37.994533 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fff503-abe8-48ee-8d5a-f9350a594b7c None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:37.995236 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fff503-abe8-48ee-8d5a-f9350a594b7c None admin] RBAC: Adding query filter params (type=compute) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:37.995633 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fff503-abe8-48ee-8d5a-f9350a594b7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:37.996956 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fff503-abe8-48ee-8d5a-f9350a594b7c None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:38.002133 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 497/990] 10.222.0.15 () {56 vars in 1112 bytes} [Tue Jun 21 20:09:37 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:09:38.008205 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fff503-abe8-48ee-8d5a-f9350a594b7c None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:38.016354 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd640d-1360-430a-8c7f-744cae24eb1b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:38.049533 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b35ff0-d597-4fbc-a66b-1bd1226bfd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:38.050229 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b35ff0-d597-4fbc-a66b-1bd1226bfd20 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:38.050512 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b35ff0-d597-4fbc-a66b-1bd1226bfd20 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:38.051275 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b35ff0-d597-4fbc-a66b-1bd1226bfd20 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:38.052015 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b35ff0-d597-4fbc-a66b-1bd1226bfd20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:38.052326 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b35ff0-d597-4fbc-a66b-1bd1226bfd20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:38.053670 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b35ff0-d597-4fbc-a66b-1bd1226bfd20 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:38.064517 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 494/991] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:09:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:09:38.070365 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b35ff0-d597-4fbc-a66b-1bd1226bfd20 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:38.072912 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:38.121983 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fff503-abe8-48ee-8d5a-f9350a594b7c None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:38.164925 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9645a8-c507-49ac-bc63-50e39a4509e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:38.165600 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9645a8-c507-49ac-bc63-50e39a4509e0 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:38.165889 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9645a8-c507-49ac-bc63-50e39a4509e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:38.166172 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9645a8-c507-49ac-bc63-50e39a4509e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:38.167531 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9645a8-c507-49ac-bc63-50e39a4509e0 None admin] RBAC: Adding query filter params (interface=public, service_id=07d031963b194d42992d702031a82241, region_id=RegionOne) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:38.167855 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9645a8-c507-49ac-bc63-50e39a4509e0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:38.169806 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9645a8-c507-49ac-bc63-50e39a4509e0 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:38.179441 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b35ff0-d597-4fbc-a66b-1bd1226bfd20 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:38.180201 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 498/992] 10.222.0.15 () {56 vars in 1251 bytes} [Tue Jun 21 20:09:38 2022] GET /identity/v3/endpoints?service_id=07d031963b194d42992d702031a82241&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:09:38.183661 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9645a8-c507-49ac-bc63-50e39a4509e0 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:38.217511 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2da15b-cc50-424c-ba49-cc0102b5c08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:38.218666 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2da15b-cc50-424c-ba49-cc0102b5c08e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:38.219142 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2da15b-cc50-424c-ba49-cc0102b5c08e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:38.219422 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2da15b-cc50-424c-ba49-cc0102b5c08e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:38.227005 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2da15b-cc50-424c-ba49-cc0102b5c08e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:38.228514 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2da15b-cc50-424c-ba49-cc0102b5c08e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:38.241929 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:38.243428 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-3c2da15b-cc50-424c-ba49-cc0102b5c08e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:09:38.243428 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:38.243428 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:38.243428 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:38.243428 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:38.243428 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:38.243428 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:38.243428 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:38.243428 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:38.243428 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:38.243428 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:38.243428 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:38.243428 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 20:09:38.243428 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 20:09:38.243428 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 20:09:38.244381 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 20:09:38.244381 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:38.244381 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:38.244381 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:38.244381 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:38.244381 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:38.244381 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:38.244381 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:38.244381 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:38.244381 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:38.244381 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:38.244381 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:38.244381 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:38.244381 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:38.244381 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:38.244381 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:38.244381 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:38.245876 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 20:09:38.245876 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 20:09:38.245876 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 20:09:38.245876 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 20:09:38.245876 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 20:09:38.245876 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 20:09:38.245876 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:09:38.245876 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:38.245876 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 495/993] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jun 21 20:09:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:09:38.250186 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2da15b-cc50-424c-ba49-cc0102b5c08e None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:38.291734 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9645a8-c507-49ac-bc63-50e39a4509e0 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:38.315610 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:38.326714 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67a417d-31b9-47be-970a-03ab4faeaadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:38.327386 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a417d-31b9-47be-970a-03ab4faeaadc None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:38.327678 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a417d-31b9-47be-970a-03ab4faeaadc None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:38.327985 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a417d-31b9-47be-970a-03ab4faeaadc None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:38.328676 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67a417d-31b9-47be-970a-03ab4faeaadc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:38.330042 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67a417d-31b9-47be-970a-03ab4faeaadc None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:38.336368 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 499/994] 10.222.0.15 () {56 vars in 1087 bytes} [Tue Jun 21 20:09:38 2022] GET /identity/v3/services => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:09:38.372951 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2da15b-cc50-424c-ba49-cc0102b5c08e None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:38.410454 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd62c8-ac4a-4a36-9b84-d9d46bbe47e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:38.411161 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd62c8-ac4a-4a36-9b84-d9d46bbe47e5 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:38.411451 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd62c8-ac4a-4a36-9b84-d9d46bbe47e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:38.411730 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd62c8-ac4a-4a36-9b84-d9d46bbe47e5 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:38.412565 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dd62c8-ac4a-4a36-9b84-d9d46bbe47e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:38.412878 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dd62c8-ac4a-4a36-9b84-d9d46bbe47e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:38.414326 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dd62c8-ac4a-4a36-9b84-d9d46bbe47e5 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:38.432508 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 496/995] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jun 21 20:09:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:38.434090 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67a417d-31b9-47be-970a-03ab4faeaadc None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:38.543902 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67a417d-31b9-47be-970a-03ab4faeaadc None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:38.561549 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:38.579322 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178816d5-9ccc-40a4-bf9a-9f23838d96c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:38.580017 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178816d5-9ccc-40a4-bf9a-9f23838d96c8 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:38.580308 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178816d5-9ccc-40a4-bf9a-9f23838d96c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:38.580589 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178816d5-9ccc-40a4-bf9a-9f23838d96c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:38.581428 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178816d5-9ccc-40a4-bf9a-9f23838d96c8 None admin] RBAC: Adding query filter params (role.id=1db2217c34b945f19d47444f74970dd5, scope.project.id=4dcb71ef7b6e49148edd61a1eb8da7bb, user.id=5cf067b8833f4596a1b91073a66768f0) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:38.581745 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178816d5-9ccc-40a4-bf9a-9f23838d96c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:38.583203 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178816d5-9ccc-40a4-bf9a-9f23838d96c8 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:38.589406 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 500/996] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jun 21 20:09:38 2022] GET /identity/v3/role_assignments?user.id=5cf067b8833f4596a1b91073a66768f0&scope.project.id=4dcb71ef7b6e49148edd61a1eb8da7bb&role.id=1db2217c34b945f19d47444f74970dd5 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:39.087269 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5481eb-4aa4-4557-b930-b3381c274531 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:39.087593 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5481eb-4aa4-4557-b930-b3381c274531 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:39.087835 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5481eb-4aa4-4557-b930-b3381c274531 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:39.089263 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 497/997] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:09:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:09:39.094623 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d006fd2-c01a-4712-baaa-279c714bb0ef None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:39.094996 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d006fd2-c01a-4712-baaa-279c714bb0ef None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:39.095352 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d006fd2-c01a-4712-baaa-279c714bb0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:39.113127 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-9d006fd2-c01a-4712-baaa-279c714bb0ef None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:09:39.114308 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-9d006fd2-c01a-4712-baaa-279c714bb0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:09:39.182764 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 501/998] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:09:39 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 20:09:39.205739 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5481eb-4aa4-4557-b930-b3381c274531 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:39.308776 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5481eb-4aa4-4557-b930-b3381c274531 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:39.331073 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:39.344531 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3096922-4b9f-4ad9-b10e-c4fb6aac3812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:39.345347 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3096922-4b9f-4ad9-b10e-c4fb6aac3812 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:39.345637 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3096922-4b9f-4ad9-b10e-c4fb6aac3812 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:39.345941 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3096922-4b9f-4ad9-b10e-c4fb6aac3812 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:39.346752 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3096922-4b9f-4ad9-b10e-c4fb6aac3812 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:39.348681 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3096922-4b9f-4ad9-b10e-c4fb6aac3812 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:39.361141 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-f3096922-4b9f-4ad9-b10e-c4fb6aac3812 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 20:09:39.361141 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:39.361141 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 20:09:39.361141 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 20:09:39.361141 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 20:09:39.361141 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 20:09:39.361141 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 20:09:39.361141 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 20:09:39.361141 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 20:09:39.361141 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:39.361141 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 20:09:39.361141 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:39.361141 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:39.361141 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:39.361141 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:39.361141 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:39.361141 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:39.362164 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:39.362164 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:39.362164 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:39.362164 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:39.362164 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:39.362164 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:39.362164 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 20:09:39.362164 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 20:09:39.362164 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 20:09:39.362164 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 20:09:39.362164 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:39.362164 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:39.362164 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:39.362164 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:39.362164 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:39.362164 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:39.363023 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:39.363023 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:39.363023 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:39.363023 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:39.363023 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:39.363023 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:39.363023 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:39.363023 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:39.363023 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:39.363023 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:39.363023 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 20:09:39.363023 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 20:09:39.363023 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 20:09:39.363023 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:39.363023 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 498/999] 10.222.0.15 () {56 vars in 1126 bytes} [Tue Jun 21 20:09:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:39.370349 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d006fd2-c01a-4712-baaa-279c714bb0ef None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:39.473128 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d006fd2-c01a-4712-baaa-279c714bb0ef None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:39.487116 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:39.509830 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a1f8b-c6d1-4621-913f-49450b65dc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:39.510784 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a1f8b-c6d1-4621-913f-49450b65dc1c None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:39.511290 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a1f8b-c6d1-4621-913f-49450b65dc1c None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:39.511797 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a1f8b-c6d1-4621-913f-49450b65dc1c None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:39.512762 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49a1f8b-c6d1-4621-913f-49450b65dc1c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:39.513270 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49a1f8b-c6d1-4621-913f-49450b65dc1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:39.514856 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49a1f8b-c6d1-4621-913f-49450b65dc1c None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:39.524238 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 502/1000] 10.222.0.15 () {56 vars in 1122 bytes} [Tue Jun 21 20:09:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:39.525965 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3096922-4b9f-4ad9-b10e-c4fb6aac3812 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:39.629622 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3096922-4b9f-4ad9-b10e-c4fb6aac3812 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:39.662999 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f3564b-d747-4b5d-8716-6c05be55b829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:39.663663 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3564b-d747-4b5d-8716-6c05be55b829 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:39.663972 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3564b-d747-4b5d-8716-6c05be55b829 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:39.664255 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3564b-d747-4b5d-8716-6c05be55b829 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:39.664954 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f3564b-d747-4b5d-8716-6c05be55b829 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:39.665265 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f3564b-d747-4b5d-8716-6c05be55b829 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:39.666650 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f3564b-d747-4b5d-8716-6c05be55b829 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:39.671775 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 499/1001] 10.222.0.15 () {56 vars in 1122 bytes} [Tue Jun 21 20:09:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:39.677283 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a1f8b-c6d1-4621-913f-49450b65dc1c None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:39.778442 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a1f8b-c6d1-4621-913f-49450b65dc1c None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:39.812112 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0113111-0318-4fbd-aae1-7400c094e750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:39.812773 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0113111-0318-4fbd-aae1-7400c094e750 None admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:39.813059 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0113111-0318-4fbd-aae1-7400c094e750 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:39.813338 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0113111-0318-4fbd-aae1-7400c094e750 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:39.814090 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0113111-0318-4fbd-aae1-7400c094e750 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:39.815572 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0113111-0318-4fbd-aae1-7400c094e750 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:39.835960 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 503/1002] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Jun 21 20:09:39 2022] POST /identity/v3/endpoints => generated 325 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:09:40.404309 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b19ae8-3e96-4b2f-95fd-5254d3d94c5a None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:40.404836 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b19ae8-3e96-4b2f-95fd-5254d3d94c5a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:40.404916 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b19ae8-3e96-4b2f-95fd-5254d3d94c5a None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:40.406265 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 500/1003] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:09:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:09:40.411322 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b1ad7-5aba-4908-bbe7-b3f51e1cc09c None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:40.411726 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b1ad7-5aba-4908-bbe7-b3f51e1cc09c None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:40.411895 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b1ad7-5aba-4908-bbe7-b3f51e1cc09c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:40.429080 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-442b1ad7-5aba-4908-bbe7-b3f51e1cc09c None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:09:40.430264 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-442b1ad7-5aba-4908-bbe7-b3f51e1cc09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:09:40.459292 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:40.506849 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 504/1004] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:09:40 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 20:09:40.529435 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b19ae8-3e96-4b2f-95fd-5254d3d94c5a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:40.582400 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:40.631412 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643da2ec-1d6a-4ed6-8160-6f76e4156b3a None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:40.631724 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643da2ec-1d6a-4ed6-8160-6f76e4156b3a None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:40.632023 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643da2ec-1d6a-4ed6-8160-6f76e4156b3a None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:40.633521 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 505/1005] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:09:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 20:09:40.636012 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b19ae8-3e96-4b2f-95fd-5254d3d94c5a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:40.638083 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b36201-c905-4901-b92b-ee0516fcc99c None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:40.638380 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b36201-c905-4901-b92b-ee0516fcc99c None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:40.638662 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b36201-c905-4901-b92b-ee0516fcc99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:40.656062 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-d9b36201-c905-4901-b92b-ee0516fcc99c None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:09:40.657177 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-d9b36201-c905-4901-b92b-ee0516fcc99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:09:40.670928 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee39a1-1b45-4fe2-b09b-ee1411b5fad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:40.671728 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee39a1-1b45-4fe2-b09b-ee1411b5fad2 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:40.672050 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee39a1-1b45-4fe2-b09b-ee1411b5fad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:40.672336 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee39a1-1b45-4fe2-b09b-ee1411b5fad2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:40.672991 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ee39a1-1b45-4fe2-b09b-ee1411b5fad2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:40.674349 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ee39a1-1b45-4fe2-b09b-ee1411b5fad2 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:40.686636 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-62ee39a1-1b45-4fe2-b09b-ee1411b5fad2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 20:09:40.686636 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:40.686636 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 20:09:40.686636 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 20:09:40.686636 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 20:09:40.686636 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 20:09:40.686636 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 20:09:40.686636 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 20:09:40.686636 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 20:09:40.686636 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:40.686636 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 20:09:40.686636 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:40.686636 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:40.686636 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:40.686636 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:40.686636 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:40.686636 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:40.687855 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:40.687855 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:40.687855 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:40.687855 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:40.687855 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:40.687855 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:40.687855 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 20:09:40.687855 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 20:09:40.687855 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 20:09:40.687855 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 20:09:40.687855 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:40.687855 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:40.687855 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:40.687855 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:40.687855 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:40.687855 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:40.688937 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:40.688937 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:40.688937 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:40.688937 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:40.688937 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:40.688937 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:40.688937 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:40.688937 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:40.688937 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:40.688937 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:40.688937 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 20:09:40.688937 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 20:09:40.688937 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 20:09:40.688937 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:40.693163 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 501/1006] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jun 21 20:09:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:40.694014 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee39a1-1b45-4fe2-b09b-ee1411b5fad2 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:40.731075 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 506/1007] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:09:40 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 20:09:40.753640 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b36201-c905-4901-b92b-ee0516fcc99c None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:40.798206 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee39a1-1b45-4fe2-b09b-ee1411b5fad2 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:40.812614 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:40.834445 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a99f5a3-2a84-44d1-b139-d9be847d9881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:40.835220 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a99f5a3-2a84-44d1-b139-d9be847d9881 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:40.835429 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a99f5a3-2a84-44d1-b139-d9be847d9881 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:40.835671 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a99f5a3-2a84-44d1-b139-d9be847d9881 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:40.839270 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a99f5a3-2a84-44d1-b139-d9be847d9881 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:40.839270 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a99f5a3-2a84-44d1-b139-d9be847d9881 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:40.839270 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a99f5a3-2a84-44d1-b139-d9be847d9881 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:40.843106 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 502/1008] 10.222.0.15 () {56 vars in 1112 bytes} [Tue Jun 21 20:09:40 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:09:40.848921 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a99f5a3-2a84-44d1-b139-d9be847d9881 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:40.855308 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:40.867021 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b36201-c905-4901-b92b-ee0516fcc99c None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:40.904352 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ad973-4504-4969-8b87-6ad59443703a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:40.905155 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ad973-4504-4969-8b87-6ad59443703a None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:40.905443 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ad973-4504-4969-8b87-6ad59443703a None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:40.906194 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ad973-4504-4969-8b87-6ad59443703a None admin] PATH_INFO: `/v3/services/image` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:40.906804 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360ad973-4504-4969-8b87-6ad59443703a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:40.908345 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360ad973-4504-4969-8b87-6ad59443703a None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:40.920578 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-360ad973-4504-4969-8b87-6ad59443703a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 20:09:40.920578 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:40.920578 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 20:09:40.920578 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 20:09:40.920578 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 20:09:40.920578 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 20:09:40.920578 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 20:09:40.920578 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 20:09:40.920578 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 20:09:40.920578 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:40.920578 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 20:09:40.920578 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:40.920578 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:40.920578 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:40.920578 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:40.920578 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:40.920578 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:40.921608 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:40.921608 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:40.921608 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:40.921608 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:40.921608 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:40.921608 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:40.921608 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 20:09:40.921608 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 20:09:40.921608 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 20:09:40.921608 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 20:09:40.921608 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:40.921608 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:40.921608 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:40.921608 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:40.921608 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:40.921608 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:40.922455 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:40.922455 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:40.922455 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:40.922455 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:40.922455 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:40.922455 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:40.922455 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:40.922455 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:40.922455 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:40.922455 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:40.922455 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 20:09:40.922455 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 20:09:40.922455 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 20:09:40.922455 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:40.922455 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 507/1009] 10.222.0.15 () {56 vars in 1105 bytes} [Tue Jun 21 20:09:40 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:09:40.928453 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ad973-4504-4969-8b87-6ad59443703a None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:40.960609 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a99f5a3-2a84-44d1-b139-d9be847d9881 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:40.996411 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50908f6f-86d9-47cd-be0c-c0f152b35d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:40.997079 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50908f6f-86d9-47cd-be0c-c0f152b35d21 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:40.997368 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50908f6f-86d9-47cd-be0c-c0f152b35d21 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:40.997644 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50908f6f-86d9-47cd-be0c-c0f152b35d21 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:40.998406 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50908f6f-86d9-47cd-be0c-c0f152b35d21 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:40.998710 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50908f6f-86d9-47cd-be0c-c0f152b35d21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:41.000198 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50908f6f-86d9-47cd-be0c-c0f152b35d21 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:41.006871 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 503/1010] 10.222.0.15 () {56 vars in 1112 bytes} [Tue Jun 21 20:09:40 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:09:41.012364 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50908f6f-86d9-47cd-be0c-c0f152b35d21 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:41.037945 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ad973-4504-4969-8b87-6ad59443703a None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:41.059465 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:41.074705 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc190bf3-74f0-4167-bd0d-fbc2492d3775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:41.075378 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc190bf3-74f0-4167-bd0d-fbc2492d3775 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:41.075671 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc190bf3-74f0-4167-bd0d-fbc2492d3775 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:41.075982 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc190bf3-74f0-4167-bd0d-fbc2492d3775 None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:41.076706 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc190bf3-74f0-4167-bd0d-fbc2492d3775 None admin] RBAC: Adding query filter params (name=image) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:41.077035 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc190bf3-74f0-4167-bd0d-fbc2492d3775 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:41.078396 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc190bf3-74f0-4167-bd0d-fbc2492d3775 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:41.083647 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 508/1011] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:09:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:09:41.089046 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc190bf3-74f0-4167-bd0d-fbc2492d3775 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:41.114117 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:41.125400 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50908f6f-86d9-47cd-be0c-c0f152b35d21 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:41.159230 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7e83c-260f-4214-be8d-73989c5c2456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:41.159816 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7e83c-260f-4214-be8d-73989c5c2456 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:41.160669 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7e83c-260f-4214-be8d-73989c5c2456 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:41.160945 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7e83c-260f-4214-be8d-73989c5c2456 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:41.161678 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba7e83c-260f-4214-be8d-73989c5c2456 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:41.163025 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba7e83c-260f-4214-be8d-73989c5c2456 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:41.184459 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 504/1012] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Jun 21 20:09:41 2022] POST /identity/v3/endpoints => generated 334 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 20:09:41.200281 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc190bf3-74f0-4167-bd0d-fbc2492d3775 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:41.245913 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe98f4-53bd-4635-93e1-87dcb5f99d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:41.246597 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe98f4-53bd-4635-93e1-87dcb5f99d18 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:41.246882 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe98f4-53bd-4635-93e1-87dcb5f99d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:41.247159 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe98f4-53bd-4635-93e1-87dcb5f99d18 None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:41.247888 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe98f4-53bd-4635-93e1-87dcb5f99d18 None admin] RBAC: Adding query filter params (type=image) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:41.248232 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe98f4-53bd-4635-93e1-87dcb5f99d18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:41.249645 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe98f4-53bd-4635-93e1-87dcb5f99d18 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:41.261382 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 509/1013] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:09:41 2022] GET /identity/v3/services?type=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:09:41.865040 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58311fde-7146-4e48-b787-851c24558450 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:41.865455 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58311fde-7146-4e48-b787-851c24558450 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:41.865656 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58311fde-7146-4e48-b787-851c24558450 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:41.867103 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 505/1014] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:09:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:09:41.872170 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38740dd6-bc5c-4f10-bad6-25c063c341ac None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:41.872568 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38740dd6-bc5c-4f10-bad6-25c063c341ac None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:41.872740 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38740dd6-bc5c-4f10-bad6-25c063c341ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:41.889963 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-38740dd6-bc5c-4f10-bad6-25c063c341ac None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:09:41.891137 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-38740dd6-bc5c-4f10-bad6-25c063c341ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:09:41.959677 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 510/1015] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:09:41 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 20:09:41.982425 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58311fde-7146-4e48-b787-851c24558450 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:42.078557 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:42.085888 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58311fde-7146-4e48-b787-851c24558450 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:42.118569 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa04c9-bf6b-4205-9f7a-55aa58db5c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:42.119359 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa04c9-bf6b-4205-9f7a-55aa58db5c8a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:42.119640 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa04c9-bf6b-4205-9f7a-55aa58db5c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:42.119944 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa04c9-bf6b-4205-9f7a-55aa58db5c8a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:42.121095 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa04c9-bf6b-4205-9f7a-55aa58db5c8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:42.122515 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa04c9-bf6b-4205-9f7a-55aa58db5c8a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:42.124411 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 506/1016] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:09:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:42.130539 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38740dd6-bc5c-4f10-bad6-25c063c341ac None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:42.142030 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:42.227929 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38740dd6-bc5c-4f10-bad6-25c063c341ac None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:42.261374 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b21b536-6558-4a90-a23d-7d11cd7d9f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:42.262033 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21b536-6558-4a90-a23d-7d11cd7d9f86 None admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:42.262318 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21b536-6558-4a90-a23d-7d11cd7d9f86 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:42.262593 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21b536-6558-4a90-a23d-7d11cd7d9f86 None admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:42.263307 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b21b536-6558-4a90-a23d-7d11cd7d9f86 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:42.264748 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b21b536-6558-4a90-a23d-7d11cd7d9f86 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:42.290718 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 511/1017] 10.222.0.15 () {60 vars in 1141 bytes} [Tue Jun 21 20:09:42 2022] POST /identity/v3/projects => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:09:43.290626 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b7d8a-63b1-4ce5-9bd2-519a2bf9a81e None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:43.291174 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b7d8a-63b1-4ce5-9bd2-519a2bf9a81e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:43.291174 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b7d8a-63b1-4ce5-9bd2-519a2bf9a81e None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:43.292740 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 507/1018] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:09:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:09:43.297669 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac725e-ffa7-4ea6-8ab1-00e500fdf24c None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:43.298059 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac725e-ffa7-4ea6-8ab1-00e500fdf24c None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:43.298241 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac725e-ffa7-4ea6-8ab1-00e500fdf24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:43.315580 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-42ac725e-ffa7-4ea6-8ab1-00e500fdf24c None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:09:43.317363 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-42ac725e-ffa7-4ea6-8ab1-00e500fdf24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:09:43.322834 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1077af-ccbb-4365-8c3c-4267ba9f0ca3 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:43.323125 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1077af-ccbb-4365-8c3c-4267ba9f0ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:43.323404 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1077af-ccbb-4365-8c3c-4267ba9f0ca3 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:43.324917 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 508/1019] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:09:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 20:09:43.329480 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3682bea-5561-4418-9735-06e8c72047e8 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:43.329785 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3682bea-5561-4418-9735-06e8c72047e8 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:43.330088 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3682bea-5561-4418-9735-06e8c72047e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:43.346583 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c3682bea-5561-4418-9735-06e8c72047e8 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:09:43.347823 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c3682bea-5561-4418-9735-06e8c72047e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:09:43.380526 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:43.394349 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 512/1020] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:09:43 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 20:09:43.416108 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 509/1021] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:09:43 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 20:09:43.417244 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac725e-ffa7-4ea6-8ab1-00e500fdf24c None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:43.440406 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3682bea-5561-4418-9735-06e8c72047e8 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:43.523928 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac725e-ffa7-4ea6-8ab1-00e500fdf24c None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:43.538486 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:43.545973 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3682bea-5561-4418-9735-06e8c72047e8 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:43.557589 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd7fff2-fb34-4c17-96b8-66dc93395d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:43.558326 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7fff2-fb34-4c17-96b8-66dc93395d2c None admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:43.558614 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7fff2-fb34-4c17-96b8-66dc93395d2c None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:43.558892 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7fff2-fb34-4c17-96b8-66dc93395d2c None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:43.559615 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd7fff2-fb34-4c17-96b8-66dc93395d2c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:43.561005 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd7fff2-fb34-4c17-96b8-66dc93395d2c None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:43.575765 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 513/1022] 10.222.0.15 () {60 vars in 1141 bytes} [Tue Jun 21 20:09:43 2022] POST /identity/v3/services => generated 242 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:09:43.597520 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e72c7-acf2-48f8-96b9-faccbcb14461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:43.598366 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e72c7-acf2-48f8-96b9-faccbcb14461 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:43.598655 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e72c7-acf2-48f8-96b9-faccbcb14461 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:43.598935 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e72c7-acf2-48f8-96b9-faccbcb14461 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:43.611367 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e72c7-acf2-48f8-96b9-faccbcb14461 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:09:43.620323 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-146e72c7-acf2-48f8-96b9-faccbcb14461 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 20:09:43.620323 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:43.620323 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:43.620323 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:43.620323 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:43.620323 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:43.620323 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:43.620323 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:43.620323 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:43.620323 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:43.620323 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:43.620323 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:43.620323 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:09:43.620323 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:09:43.620323 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:09:43.620323 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:09:43.621402 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:09:43.621402 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:09:43.621402 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:09:43.621402 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:09:43.621402 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:43.621402 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:43.621402 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:43.621402 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:43.621402 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:43.621402 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:43.621402 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:43.621402 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:43.621402 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:43.621402 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:43.621402 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:43.621402 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:43.622427 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:43.622427 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:43.622427 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:43.622427 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:43.622427 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:09:43.622427 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:09:43.622427 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:09:43.622427 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:09:43.622427 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:09:43.622427 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:09:43.622427 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 20:09:43.622427 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:43.622427 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 510/1023] 10.222.0.15 () {56 vars in 1120 bytes} [Tue Jun 21 20:09:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:09:43.627642 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd7fff2-fb34-4c17-96b8-66dc93395d2c None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:43.686152 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:43.740868 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd7fff2-fb34-4c17-96b8-66dc93395d2c None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:43.775540 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3677fd-444c-4ac9-8e56-ad88982a345e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:43.776275 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3677fd-444c-4ac9-8e56-ad88982a345e None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:43.776569 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3677fd-444c-4ac9-8e56-ad88982a345e None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:43.776854 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3677fd-444c-4ac9-8e56-ad88982a345e None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:43.777610 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3677fd-444c-4ac9-8e56-ad88982a345e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:43.777931 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3677fd-444c-4ac9-8e56-ad88982a345e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:43.779310 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3677fd-444c-4ac9-8e56-ad88982a345e None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:43.788566 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 514/1024] 10.222.0.15 () {56 vars in 1115 bytes} [Tue Jun 21 20:09:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:43.793984 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e72c7-acf2-48f8-96b9-faccbcb14461 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:43.904677 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e72c7-acf2-48f8-96b9-faccbcb14461 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:43.939794 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3bb8d0-efec-4148-a78d-3f7024c043c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:43.940631 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3bb8d0-efec-4148-a78d-3f7024c043c3 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:43.940918 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3bb8d0-efec-4148-a78d-3f7024c043c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:43.941228 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3bb8d0-efec-4148-a78d-3f7024c043c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:43.952760 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3bb8d0-efec-4148-a78d-3f7024c043c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:43.954249 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3bb8d0-efec-4148-a78d-3f7024c043c3 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:43.971495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-9a3bb8d0-efec-4148-a78d-3f7024c043c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:43.971495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:43.971495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:43.971495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:43.971495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:43.971495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:43.971495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:43.971495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:43.971495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:43.971495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:43.971495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:43.971495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:43.971495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:09:43.971495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:09:43.971495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:09:43.973223 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:09:43.973223 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:43.973223 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:43.973223 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:43.973223 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:43.973223 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:43.973223 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:43.973223 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:43.973223 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:43.973223 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:43.973223 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:43.973223 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:43.973223 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:43.973223 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:43.973223 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:43.973223 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:43.973223 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:43.974135 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:09:43.974135 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:09:43.974135 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:43.974135 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:43.974822 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 511/1025] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:09:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:43.979036 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3677fd-444c-4ac9-8e56-ad88982a345e None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:44.080080 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3677fd-444c-4ac9-8e56-ad88982a345e None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:44.094487 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:44.116600 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f05257-b8db-4326-9178-7c5d6e3e4e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:44.117262 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f05257-b8db-4326-9178-7c5d6e3e4e86 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:44.117547 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f05257-b8db-4326-9178-7c5d6e3e4e86 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:44.117825 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f05257-b8db-4326-9178-7c5d6e3e4e86 None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:44.118543 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f05257-b8db-4326-9178-7c5d6e3e4e86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:44.118851 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f05257-b8db-4326-9178-7c5d6e3e4e86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:44.120246 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f05257-b8db-4326-9178-7c5d6e3e4e86 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:44.136404 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 515/1026] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:09:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:44.137948 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3bb8d0-efec-4148-a78d-3f7024c043c3 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:44.142084 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:44.238298 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3bb8d0-efec-4148-a78d-3f7024c043c3 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:44.271617 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf16e81-fd83-4894-a97c-712d703569ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:44.272442 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf16e81-fd83-4894-a97c-712d703569ba None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:44.272725 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf16e81-fd83-4894-a97c-712d703569ba None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:44.272998 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf16e81-fd83-4894-a97c-712d703569ba None admin] PATH_INFO: `/v3/users/nova` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:44.280397 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf16e81-fd83-4894-a97c-712d703569ba None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:44.281833 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf16e81-fd83-4894-a97c-712d703569ba None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:44.296261 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-baf16e81-fd83-4894-a97c-712d703569ba None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 20:09:44.296261 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:44.296261 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:44.296261 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:44.296261 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:44.296261 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:44.296261 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:44.296261 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:44.296261 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:44.296261 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:44.296261 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:44.296261 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:44.296261 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 20:09:44.296261 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 20:09:44.296261 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 20:09:44.296261 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 20:09:44.297679 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:44.297679 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:44.297679 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 20:09:44.297679 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:09:44.297679 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 20:09:44.297679 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:09:44.297679 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:44.297679 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:44.297679 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:44.297679 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:44.297679 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:44.297679 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:44.297679 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:44.297679 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:44.297679 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:44.297679 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:44.297679 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:44.297679 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:44.303424 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:44.303424 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:44.303424 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 20:09:44.303424 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 20:09:44.303424 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 20:09:44.303424 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 20:09:44.303424 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 20:09:44.303424 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 20:09:44.303424 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 20:09:44.303424 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:44.303424 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 512/1027] 10.222.0.15 () {56 vars in 1093 bytes} [Tue Jun 21 20:09:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:44.305833 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f05257-b8db-4326-9178-7c5d6e3e4e86 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:44.386090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06735f52-5f91-4725-b046-165cd9911c97 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:44.386388 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06735f52-5f91-4725-b046-165cd9911c97 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:44.386577 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06735f52-5f91-4725-b046-165cd9911c97 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:44.387957 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 513/1028] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:09:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 20:09:44.392721 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d934795-0eb9-42b0-baa0-0e59129d227c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:44.394098 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d934795-0eb9-42b0-baa0-0e59129d227c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:44.394098 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d934795-0eb9-42b0-baa0-0e59129d227c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:44.410401 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-9d934795-0eb9-42b0-baa0-0e59129d227c None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:09:44.411575 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9d934795-0eb9-42b0-baa0-0e59129d227c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:09:44.413874 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f05257-b8db-4326-9178-7c5d6e3e4e86 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:44.450613 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324eace-3d4c-4870-93f9-63ee77440eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:44.451669 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324eace-3d4c-4870-93f9-63ee77440eaf None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:44.451984 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324eace-3d4c-4870-93f9-63ee77440eaf None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:44.452267 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324eace-3d4c-4870-93f9-63ee77440eaf None admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:44.453110 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6324eace-3d4c-4870-93f9-63ee77440eaf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:44.453420 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6324eace-3d4c-4870-93f9-63ee77440eaf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:44.455482 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6324eace-3d4c-4870-93f9-63ee77440eaf None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:44.471778 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:44.479075 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 516/1029] 10.222.0.15 () {56 vars in 1133 bytes} [Tue Jun 21 20:09:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:44.480179 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324eace-3d4c-4870-93f9-63ee77440eaf None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:44.485178 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 514/1030] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:09:44 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 20:09:44.509304 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d934795-0eb9-42b0-baa0-0e59129d227c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:44.512858 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:44.585308 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324eace-3d4c-4870-93f9-63ee77440eaf None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:44.612815 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d934795-0eb9-42b0-baa0-0e59129d227c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:44.619787 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1424e9-37a4-48a0-b77b-e99176b337df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:44.620585 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1424e9-37a4-48a0-b77b-e99176b337df None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:44.621060 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1424e9-37a4-48a0-b77b-e99176b337df None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:44.621350 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1424e9-37a4-48a0-b77b-e99176b337df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:44.650264 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf36080a-a940-45d5-ba64-892d44b675a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:44.650990 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36080a-a940-45d5-ba64-892d44b675a2 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:44.651275 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36080a-a940-45d5-ba64-892d44b675a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:44.651552 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36080a-a940-45d5-ba64-892d44b675a2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:44.652758 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf36080a-a940-45d5-ba64-892d44b675a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:44.654174 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf36080a-a940-45d5-ba64-892d44b675a2 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:44.655786 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 515/1031] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:09:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:09:44.661248 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf36080a-a940-45d5-ba64-892d44b675a2 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:44.698522 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1424e9-37a4-48a0-b77b-e99176b337df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:44.700029 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1424e9-37a4-48a0-b77b-e99176b337df None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:44.731048 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:44.735711 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:44.778999 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf36080a-a940-45d5-ba64-892d44b675a2 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:44.804316 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 517/1032] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:09:44 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 21 20:09:44.809727 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1424e9-37a4-48a0-b77b-e99176b337df None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:44.817229 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da3091-bc7d-458e-ae78-e9383d81b84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:44.818400 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da3091-bc7d-458e-ae78-e9383d81b84d None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:44.818685 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da3091-bc7d-458e-ae78-e9383d81b84d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:44.818960 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da3091-bc7d-458e-ae78-e9383d81b84d None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:44.820130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08da3091-bc7d-458e-ae78-e9383d81b84d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:44.822103 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08da3091-bc7d-458e-ae78-e9383d81b84d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:44.847973 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 516/1033] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Jun 21 20:09:44 2022] POST /identity/v3/users => generated 285 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 20:09:44.923069 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1424e9-37a4-48a0-b77b-e99176b337df None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:44.956021 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:44.962401 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b7ea6-2c7f-411d-b701-b50b80cab248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:44.963204 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b7ea6-2c7f-411d-b701-b50b80cab248 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:44.963484 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b7ea6-2c7f-411d-b701-b50b80cab248 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:44.963757 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b7ea6-2c7f-411d-b701-b50b80cab248 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:44.974877 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5b7ea6-2c7f-411d-b701-b50b80cab248 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:44.976456 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5b7ea6-2c7f-411d-b701-b50b80cab248 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:44.995288 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-1f5b7ea6-2c7f-411d-b701-b50b80cab248 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:44.995288 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:44.995288 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:44.995288 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:44.995288 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:44.995288 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:44.995288 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:44.995288 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:44.995288 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:44.995288 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:44.995288 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:44.995288 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:44.995288 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:09:44.995288 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:09:44.995288 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:09:44.996284 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:09:44.996284 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:44.996284 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:44.996284 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:44.996284 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:44.996284 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:44.996284 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:44.996284 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:44.996284 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:44.996284 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:44.996284 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:44.996284 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:44.996284 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:44.996284 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:44.996284 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:44.996284 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:44.996284 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:44.997186 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:09:44.997186 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:09:44.997186 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:44.997186 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:44.997186 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 518/1034] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:09:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:09:45.002683 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da3091-bc7d-458e-ae78-e9383d81b84d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:45.111263 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da3091-bc7d-458e-ae78-e9383d81b84d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:45.129515 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:45.149138 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b8d422-ed6f-4893-8982-9cd65faffa75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:45.149807 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b8d422-ed6f-4893-8982-9cd65faffa75 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:45.150091 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b8d422-ed6f-4893-8982-9cd65faffa75 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:45.150365 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b8d422-ed6f-4893-8982-9cd65faffa75 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:45.151081 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b8d422-ed6f-4893-8982-9cd65faffa75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:45.151393 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b8d422-ed6f-4893-8982-9cd65faffa75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:45.152759 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b8d422-ed6f-4893-8982-9cd65faffa75 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:45.170095 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 517/1035] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:09:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:45.171235 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b7ea6-2c7f-411d-b701-b50b80cab248 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:45.336551 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b7ea6-2c7f-411d-b701-b50b80cab248 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:45.392024 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4bb5e0-e4ca-4c94-952b-a0a66377423e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:45.393386 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4bb5e0-e4ca-4c94-952b-a0a66377423e None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:45.393893 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4bb5e0-e4ca-4c94-952b-a0a66377423e None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:45.394425 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4bb5e0-e4ca-4c94-952b-a0a66377423e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:45.405837 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4bb5e0-e4ca-4c94-952b-a0a66377423e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:45.408546 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4bb5e0-e4ca-4c94-952b-a0a66377423e None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:45.434452 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-5f4bb5e0-e4ca-4c94-952b-a0a66377423e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:09:45.434452 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:45.434452 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:45.434452 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:45.434452 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:45.434452 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:45.434452 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:45.434452 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:45.434452 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:45.434452 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:45.434452 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:45.434452 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:45.434452 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 20:09:45.434452 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 20:09:45.434452 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 20:09:45.435330 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 20:09:45.435330 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:45.435330 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:45.435330 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:45.435330 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:45.435330 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:45.435330 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:45.435330 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:45.435330 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:45.435330 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:45.435330 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:45.435330 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:45.435330 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:45.435330 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:45.435330 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:45.435330 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:45.435330 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:45.436722 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 20:09:45.436722 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 20:09:45.436722 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 20:09:45.436722 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 20:09:45.436722 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 20:09:45.436722 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 20:09:45.436722 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:09:45.436722 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:45.437463 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 519/1036] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jun 21 20:09:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:45.445385 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b8d422-ed6f-4893-8982-9cd65faffa75 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:45.580357 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b8d422-ed6f-4893-8982-9cd65faffa75 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:45.614725 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340bf4da-dd94-4bed-ad6c-e44ce056865d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:45.615395 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bf4da-dd94-4bed-ad6c-e44ce056865d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:45.615681 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bf4da-dd94-4bed-ad6c-e44ce056865d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:45.615987 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bf4da-dd94-4bed-ad6c-e44ce056865d None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:45.616823 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340bf4da-dd94-4bed-ad6c-e44ce056865d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:45.617119 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340bf4da-dd94-4bed-ad6c-e44ce056865d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:45.618531 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340bf4da-dd94-4bed-ad6c-e44ce056865d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:45.630348 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 518/1037] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jun 21 20:09:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:45.636103 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4bb5e0-e4ca-4c94-952b-a0a66377423e None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:45.650131 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515932a-4ba4-4fe1-9e89-f48f43cbc77b None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:45.650548 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515932a-4ba4-4fe1-9e89-f48f43cbc77b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:45.650930 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515932a-4ba4-4fe1-9e89-f48f43cbc77b None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:45.652362 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 519/1038] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:09:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 20:09:45.657909 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2353a-54fa-4a38-b88d-2bfad3a33296 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:45.658261 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2353a-54fa-4a38-b88d-2bfad3a33296 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:45.658608 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2353a-54fa-4a38-b88d-2bfad3a33296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:45.675539 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-26a2353a-54fa-4a38-b88d-2bfad3a33296 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:09:45.676845 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-26a2353a-54fa-4a38-b88d-2bfad3a33296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:09:45.683500 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:45.707495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:45.739874 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4bb5e0-e4ca-4c94-952b-a0a66377423e None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:45.750316 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 520/1039] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:09:45 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 20:09:45.773432 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a2353a-54fa-4a38-b88d-2bfad3a33296 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:45.773794 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a8b5e-b737-41d4-b861-6418f18eae51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:45.774618 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a8b5e-b737-41d4-b861-6418f18eae51 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:45.774969 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a8b5e-b737-41d4-b861-6418f18eae51 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:45.775311 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a8b5e-b737-41d4-b861-6418f18eae51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:45.776252 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a8b5e-b737-41d4-b861-6418f18eae51 None admin] RBAC: Adding query filter params (role.id=1db2217c34b945f19d47444f74970dd5, scope.project.id=4dcb71ef7b6e49148edd61a1eb8da7bb, user.id=3918fe05c8634bc39f3e295374701465) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:45.776635 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a8b5e-b737-41d4-b861-6418f18eae51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:45.778114 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a8b5e-b737-41d4-b861-6418f18eae51 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:45.791949 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 520/1040] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jun 21 20:09:45 2022] GET /identity/v3/role_assignments?user.id=3918fe05c8634bc39f3e295374701465&scope.project.id=4dcb71ef7b6e49148edd61a1eb8da7bb&role.id=1db2217c34b945f19d47444f74970dd5 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:45.892577 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a2353a-54fa-4a38-b88d-2bfad3a33296 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:45.929782 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b5e19e-613c-410f-bd0e-333a59f53d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:45.930585 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5e19e-613c-410f-bd0e-333a59f53d5e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:45.930869 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5e19e-613c-410f-bd0e-333a59f53d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:45.931146 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5e19e-613c-410f-bd0e-333a59f53d5e None admin] PATH_INFO: `/v3/services/image` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:45.931804 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b5e19e-613c-410f-bd0e-333a59f53d5e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:45.933212 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b5e19e-613c-410f-bd0e-333a59f53d5e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:45.945843 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-10b5e19e-613c-410f-bd0e-333a59f53d5e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 20:09:45.945843 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:45.945843 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 20:09:45.945843 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 20:09:45.945843 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 20:09:45.945843 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 20:09:45.945843 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 20:09:45.945843 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 20:09:45.945843 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 20:09:45.945843 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:45.945843 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 20:09:45.945843 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:45.945843 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:45.945843 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:45.945843 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:45.945843 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:45.945843 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:45.947046 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:45.947046 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:45.947046 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:45.947046 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:45.947046 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:45.947046 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:45.947046 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 20:09:45.947046 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 20:09:45.947046 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 20:09:45.947046 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 20:09:45.947046 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:45.947046 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:45.947046 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:45.947046 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:45.947046 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:45.947046 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:45.948099 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:45.948099 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:45.948099 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:45.948099 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:45.948099 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:45.948099 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:45.948099 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:45.948099 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:45.948099 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:45.948099 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:45.948099 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 20:09:45.948099 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 20:09:45.948099 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 20:09:45.948099 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:45.948099 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 521/1041] 10.222.0.15 () {56 vars in 1105 bytes} [Tue Jun 21 20:09:45 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:09:45.953040 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a8b5e-b737-41d4-b861-6418f18eae51 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:46.056756 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a8b5e-b737-41d4-b861-6418f18eae51 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:46.065729 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:46.093081 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fecc97-6b77-410f-9c15-6d9eb9a5075e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:46.093915 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fecc97-6b77-410f-9c15-6d9eb9a5075e None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:46.094298 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fecc97-6b77-410f-9c15-6d9eb9a5075e None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:46.094669 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fecc97-6b77-410f-9c15-6d9eb9a5075e None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:46.095518 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fecc97-6b77-410f-9c15-6d9eb9a5075e None admin] RBAC: Adding query filter params (name=image) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:46.095947 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fecc97-6b77-410f-9c15-6d9eb9a5075e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:46.097483 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fecc97-6b77-410f-9c15-6d9eb9a5075e None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:46.107293 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 521/1042] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:09:45 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:46.109017 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b5e19e-613c-410f-bd0e-333a59f53d5e None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:46.142011 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:46.213054 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b5e19e-613c-410f-bd0e-333a59f53d5e None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:46.246984 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514e53a-3a0c-4dca-8a3f-7658855309a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:46.247785 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514e53a-3a0c-4dca-8a3f-7658855309a3 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:46.248189 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514e53a-3a0c-4dca-8a3f-7658855309a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:46.248563 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514e53a-3a0c-4dca-8a3f-7658855309a3 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:46.249365 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f514e53a-3a0c-4dca-8a3f-7658855309a3 None admin] RBAC: Adding query filter params (type=image) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:46.249768 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f514e53a-3a0c-4dca-8a3f-7658855309a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:46.251207 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f514e53a-3a0c-4dca-8a3f-7658855309a3 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:46.256809 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 522/1043] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:09:46 2022] GET /identity/v3/services?type=image => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:09:46.262517 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fecc97-6b77-410f-9c15-6d9eb9a5075e None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:46.361865 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fecc97-6b77-410f-9c15-6d9eb9a5075e None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:46.395483 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c7e77-50ff-4a2c-9ba7-13408523f9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:46.396170 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c7e77-50ff-4a2c-9ba7-13408523f9e1 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:46.396454 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c7e77-50ff-4a2c-9ba7-13408523f9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:46.396729 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c7e77-50ff-4a2c-9ba7-13408523f9e1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:46.397563 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3c7e77-50ff-4a2c-9ba7-13408523f9e1 None admin] RBAC: Adding query filter params (interface=public, service_id=41cfeabcf1a848078b1e7fddfbc5b9ff, region_id=RegionOne) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:46.397875 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3c7e77-50ff-4a2c-9ba7-13408523f9e1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:46.399305 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3c7e77-50ff-4a2c-9ba7-13408523f9e1 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:46.408218 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 522/1044] 10.222.0.15 () {56 vars in 1251 bytes} [Tue Jun 21 20:09:46 2022] GET /identity/v3/endpoints?service_id=41cfeabcf1a848078b1e7fddfbc5b9ff&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:46.411474 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514e53a-3a0c-4dca-8a3f-7658855309a3 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:46.507644 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:46.515328 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514e53a-3a0c-4dca-8a3f-7658855309a3 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:46.547858 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e208f-8a3e-43bc-9035-dd59d83c3605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:46.548547 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e208f-8a3e-43bc-9035-dd59d83c3605 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:46.548832 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e208f-8a3e-43bc-9035-dd59d83c3605 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:46.549110 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e208f-8a3e-43bc-9035-dd59d83c3605 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:46.549788 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4e208f-8a3e-43bc-9035-dd59d83c3605 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:46.551658 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4e208f-8a3e-43bc-9035-dd59d83c3605 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:46.564175 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 523/1045] 10.222.0.15 () {56 vars in 1087 bytes} [Tue Jun 21 20:09:46 2022] GET /identity/v3/services => generated 1957 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:09:47.067298 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246487c2-7735-4d49-a0d0-1175069b8b5d None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:47.067589 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246487c2-7735-4d49-a0d0-1175069b8b5d None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:47.067874 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246487c2-7735-4d49-a0d0-1175069b8b5d None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:47.069283 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 523/1046] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:09:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:09:47.074359 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d84960-f416-4b00-a586-71d94932a485 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:47.074657 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d84960-f416-4b00-a586-71d94932a485 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:47.074940 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d84960-f416-4b00-a586-71d94932a485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:47.095393 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-a2d84960-f416-4b00-a586-71d94932a485 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:09:47.096590 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a2d84960-f416-4b00-a586-71d94932a485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:09:47.163609 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 524/1047] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:09:47 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 20:09:47.186130 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246487c2-7735-4d49-a0d0-1175069b8b5d None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:47.223085 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:47.289921 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246487c2-7735-4d49-a0d0-1175069b8b5d None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:47.322613 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2affa751-5fb3-4bb2-a957-892bb47a3c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:47.323405 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affa751-5fb3-4bb2-a957-892bb47a3c92 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:47.323688 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affa751-5fb3-4bb2-a957-892bb47a3c92 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:47.323986 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affa751-5fb3-4bb2-a957-892bb47a3c92 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:47.335715 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2affa751-5fb3-4bb2-a957-892bb47a3c92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:09:47.343177 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-2affa751-5fb3-4bb2-a957-892bb47a3c92 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 20:09:47.343177 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:47.343177 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:47.343177 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:47.343177 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:47.343177 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:47.343177 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:47.343177 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:47.343177 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:47.343177 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:47.343177 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:47.343177 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:47.343177 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:09:47.343177 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:09:47.343177 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:09:47.343177 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:09:47.344186 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:09:47.344186 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:09:47.344186 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:09:47.344186 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:09:47.344186 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:47.344186 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:47.344186 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:47.344186 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:47.344186 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:47.344186 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:47.344186 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:47.344186 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:47.344186 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:47.344186 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:47.344186 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:47.344186 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:47.345083 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:47.345083 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:47.345083 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:47.345083 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:47.345083 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:09:47.345083 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:09:47.345083 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:09:47.345083 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:09:47.345083 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:09:47.345083 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:09:47.345083 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 20:09:47.345083 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:47.348236 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 524/1048] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jun 21 20:09:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:47.351054 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d84960-f416-4b00-a586-71d94932a485 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:47.443693 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:47.454820 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d84960-f416-4b00-a586-71d94932a485 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:47.492459 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70415405-3470-4158-b374-696005bd5945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:47.493131 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70415405-3470-4158-b374-696005bd5945 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:47.493418 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70415405-3470-4158-b374-696005bd5945 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:47.493694 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70415405-3470-4158-b374-696005bd5945 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:47.494439 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70415405-3470-4158-b374-696005bd5945 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:47.494748 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70415405-3470-4158-b374-696005bd5945 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:47.496123 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70415405-3470-4158-b374-696005bd5945 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:47.509618 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 525/1049] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:09:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:47.510652 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2affa751-5fb3-4bb2-a957-892bb47a3c92 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:47.608120 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:47.615570 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2affa751-5fb3-4bb2-a957-892bb47a3c92 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:47.654402 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3962c7-57f2-4756-88e5-a4dc06cf2751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:47.655309 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3962c7-57f2-4756-88e5-a4dc06cf2751 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:47.655588 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3962c7-57f2-4756-88e5-a4dc06cf2751 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:47.655859 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3962c7-57f2-4756-88e5-a4dc06cf2751 None admin] PATH_INFO: `/v3/users/8c6bc346e5334c19a09fbf1667bc789b` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:47.671439 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3962c7-57f2-4756-88e5-a4dc06cf2751 None admin] RBAC: Authorizing `identity:get_user(user_id=8c6bc346e5334c19a09fbf1667bc789b)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:47.672928 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3962c7-57f2-4756-88e5-a4dc06cf2751 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:47.679492 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 525/1050] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jun 21 20:09:47 2022] GET /identity/v3/users/8c6bc346e5334c19a09fbf1667bc789b => generated 285 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:09:47.680726 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70415405-3470-4158-b374-696005bd5945 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:47.783547 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70415405-3470-4158-b374-696005bd5945 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:47.806267 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1329f2-adbd-430e-a007-e4b54672ce1b None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:47.806563 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1329f2-adbd-430e-a007-e4b54672ce1b None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:47.806851 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1329f2-adbd-430e-a007-e4b54672ce1b None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:47.808386 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 526/1051] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:09:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 20:09:47.813010 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69abc2f5-d963-4cf7-9d37-d226cd6ea961 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:47.813304 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69abc2f5-d963-4cf7-9d37-d226cd6ea961 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:47.813588 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69abc2f5-d963-4cf7-9d37-d226cd6ea961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:47.817666 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be17295f-abba-44b6-b7f7-b8d2b8152bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:47.818321 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be17295f-abba-44b6-b7f7-b8d2b8152bfb None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:47.818602 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be17295f-abba-44b6-b7f7-b8d2b8152bfb None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:47.819087 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be17295f-abba-44b6-b7f7-b8d2b8152bfb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:47.830299 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-69abc2f5-d963-4cf7-9d37-d226cd6ea961 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:09:47.831529 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-69abc2f5-d963-4cf7-9d37-d226cd6ea961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:09:47.845742 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:47.900388 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be17295f-abba-44b6-b7f7-b8d2b8152bfb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:47.901835 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be17295f-abba-44b6-b7f7-b8d2b8152bfb None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:47.907180 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 527/1052] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:09:47 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 20:09:47.929994 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69abc2f5-d963-4cf7-9d37-d226cd6ea961 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:48.009291 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 526/1053] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:09:47 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 21 20:09:48.014904 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be17295f-abba-44b6-b7f7-b8d2b8152bfb None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:48.018949 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:48.036174 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69abc2f5-d963-4cf7-9d37-d226cd6ea961 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:48.070018 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:48.074253 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2383cf-bb31-4107-829d-d8b8a4a58f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:48.075179 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2383cf-bb31-4107-829d-d8b8a4a58f7f None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:48.075473 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2383cf-bb31-4107-829d-d8b8a4a58f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:48.075744 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2383cf-bb31-4107-829d-d8b8a4a58f7f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:48.086000 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2383cf-bb31-4107-829d-d8b8a4a58f7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:09:48.094018 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-0a2383cf-bb31-4107-829d-d8b8a4a58f7f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 20:09:48.094018 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:48.094018 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:48.094018 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:48.094018 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:48.094018 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:48.094018 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:48.094018 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:48.094018 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:48.094018 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:48.094018 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:48.094018 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:48.094018 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:09:48.094018 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:09:48.094018 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:09:48.094018 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:09:48.095080 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:09:48.095080 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:09:48.095080 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:09:48.095080 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:09:48.095080 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:48.095080 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:48.095080 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:48.095080 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:48.095080 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:48.095080 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:48.095080 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:48.095080 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:48.095080 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:48.095080 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:48.095080 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:48.095080 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:48.095947 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:48.095947 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:48.095947 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:48.095947 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:48.095947 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:09:48.095947 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:09:48.095947 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:09:48.095947 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:09:48.095947 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:09:48.095947 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:09:48.095947 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 20:09:48.095947 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:48.100069 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 528/1054] 10.222.0.15 () {56 vars in 1120 bytes} [Tue Jun 21 20:09:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:09:48.101436 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2383cf-bb31-4107-829d-d8b8a4a58f7f None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:48.123015 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be17295f-abba-44b6-b7f7-b8d2b8152bfb None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:48.159767 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58aa83b-c6ef-4eb7-830e-4995dfd44e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:48.160932 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58aa83b-c6ef-4eb7-830e-4995dfd44e02 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:48.161224 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58aa83b-c6ef-4eb7-830e-4995dfd44e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:48.161548 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58aa83b-c6ef-4eb7-830e-4995dfd44e02 None admin] PATH_INFO: `/v3/projects/b5c900d23c744637981e326323ed86f6` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:48.162710 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58aa83b-c6ef-4eb7-830e-4995dfd44e02 None admin] RBAC: Authorizing `identity:get_project(project_id=b5c900d23c744637981e326323ed86f6)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:48.164418 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58aa83b-c6ef-4eb7-830e-4995dfd44e02 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:48.166204 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 527/1055] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jun 21 20:09:48 2022] GET /identity/v3/projects/b5c900d23c744637981e326323ed86f6 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:09:48.171882 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58aa83b-c6ef-4eb7-830e-4995dfd44e02 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:48.218021 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2383cf-bb31-4107-829d-d8b8a4a58f7f None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:48.254865 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f7f6bf-2cb4-4e0e-8528-b89b9c85b707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:48.255538 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7f6bf-2cb4-4e0e-8528-b89b9c85b707 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:48.255822 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7f6bf-2cb4-4e0e-8528-b89b9c85b707 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:48.256129 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7f6bf-2cb4-4e0e-8528-b89b9c85b707 None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:48.256879 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f7f6bf-2cb4-4e0e-8528-b89b9c85b707 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:48.257189 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f7f6bf-2cb4-4e0e-8528-b89b9c85b707 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:48.258565 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f7f6bf-2cb4-4e0e-8528-b89b9c85b707 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:48.266685 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 529/1056] 10.222.0.15 () {56 vars in 1115 bytes} [Tue Jun 21 20:09:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:09:48.272170 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f7f6bf-2cb4-4e0e-8528-b89b9c85b707 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:48.281099 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:48.283211 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58aa83b-c6ef-4eb7-830e-4995dfd44e02 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:48.304959 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:48.322367 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b7216-2c43-40ec-a35b-e067c52545cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:48.323026 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b7216-2c43-40ec-a35b-e067c52545cc None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:48.323311 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b7216-2c43-40ec-a35b-e067c52545cc None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:48.323590 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b7216-2c43-40ec-a35b-e067c52545cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:48.324470 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7b7216-2c43-40ec-a35b-e067c52545cc None admin] RBAC: Adding query filter params (role.id=1f5332f48d9e4c2aac866d0d546c94d5, scope.project.id=b5c900d23c744637981e326323ed86f6, user.id=8c6bc346e5334c19a09fbf1667bc789b) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:48.324844 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7b7216-2c43-40ec-a35b-e067c52545cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:48.326361 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7b7216-2c43-40ec-a35b-e067c52545cc None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:48.332024 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 528/1057] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jun 21 20:09:48 2022] GET /identity/v3/role_assignments?user.id=8c6bc346e5334c19a09fbf1667bc789b&scope.project.id=b5c900d23c744637981e326323ed86f6&role.id=1f5332f48d9e4c2aac866d0d546c94d5 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:09:48.396218 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f7f6bf-2cb4-4e0e-8528-b89b9c85b707 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:48.437831 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc56eb87-0c36-4ac7-a977-d82d80aa3a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:48.438916 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56eb87-0c36-4ac7-a977-d82d80aa3a66 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:48.439354 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56eb87-0c36-4ac7-a977-d82d80aa3a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:48.439808 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56eb87-0c36-4ac7-a977-d82d80aa3a66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:48.452980 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc56eb87-0c36-4ac7-a977-d82d80aa3a66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:48.454757 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc56eb87-0c36-4ac7-a977-d82d80aa3a66 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:48.474341 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-fc56eb87-0c36-4ac7-a977-d82d80aa3a66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:48.474341 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:48.474341 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:48.474341 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:48.474341 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:48.474341 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:48.474341 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:48.474341 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:48.474341 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:48.474341 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:48.474341 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:48.474341 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:48.474341 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:09:48.474341 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:09:48.474341 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:09:48.475391 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:09:48.475391 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:48.475391 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:48.475391 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:48.475391 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:48.475391 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:48.475391 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:48.475391 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:48.475391 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:48.475391 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:48.475391 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:48.475391 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:48.475391 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:48.475391 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:48.475391 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:48.475391 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:48.475391 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:48.476757 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:09:48.476757 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:09:48.476757 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:48.476757 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:48.480101 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 530/1058] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:09:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:09:48.482351 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b7216-2c43-40ec-a35b-e067c52545cc None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:48.584557 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b7216-2c43-40ec-a35b-e067c52545cc None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:48.603790 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646331d5-d7f7-4b63-86ee-17f169413656 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:48.604433 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646331d5-d7f7-4b63-86ee-17f169413656 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:48.604433 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646331d5-d7f7-4b63-86ee-17f169413656 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:48.605939 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 531/1059] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:09:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 20:09:48.611032 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317ab85-3081-4dac-a774-fda7bd254dc2 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:48.611354 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317ab85-3081-4dac-a774-fda7bd254dc2 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:48.611613 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317ab85-3081-4dac-a774-fda7bd254dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:48.621102 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af35b5a-0369-4bc6-95c0-0575f7572215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:48.622147 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af35b5a-0369-4bc6-95c0-0575f7572215 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:48.622443 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af35b5a-0369-4bc6-95c0-0575f7572215 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:48.622730 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af35b5a-0369-4bc6-95c0-0575f7572215 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:48.623472 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af35b5a-0369-4bc6-95c0-0575f7572215 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:48.623788 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af35b5a-0369-4bc6-95c0-0575f7572215 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:48.625206 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af35b5a-0369-4bc6-95c0-0575f7572215 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:48.631177 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-5317ab85-3081-4dac-a774-fda7bd254dc2 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:09:48.632386 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-5317ab85-3081-4dac-a774-fda7bd254dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:09:48.642578 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 529/1060] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:09:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:48.643681 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af35b5a-0369-4bc6-95c0-0575f7572215 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:48.695830 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:48.696279 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:48.713254 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 532/1061] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:09:48 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 20:09:48.737116 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317ab85-3081-4dac-a774-fda7bd254dc2 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:48.760764 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af35b5a-0369-4bc6-95c0-0575f7572215 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:48.801161 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b453ae5-204d-4f1a-a1d1-bfb563d1c269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:48.801994 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b453ae5-204d-4f1a-a1d1-bfb563d1c269 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:48.802285 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b453ae5-204d-4f1a-a1d1-bfb563d1c269 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:48.802577 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b453ae5-204d-4f1a-a1d1-bfb563d1c269 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:48.809852 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b453ae5-204d-4f1a-a1d1-bfb563d1c269 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:48.811356 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b453ae5-204d-4f1a-a1d1-bfb563d1c269 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:48.825929 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-1b453ae5-204d-4f1a-a1d1-bfb563d1c269 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 20:09:48.825929 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:48.825929 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:48.825929 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:48.825929 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:48.825929 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:48.825929 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:48.825929 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:48.825929 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:48.825929 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:48.825929 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:48.825929 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:48.825929 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 20:09:48.825929 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 20:09:48.825929 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 20:09:48.825929 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 20:09:48.826924 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:48.826924 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:48.826924 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 20:09:48.826924 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:09:48.826924 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 20:09:48.826924 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:09:48.826924 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:48.826924 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:48.826924 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:48.826924 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:48.826924 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:48.826924 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:48.826924 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:48.826924 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:48.826924 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:48.826924 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:48.826924 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:48.826924 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:48.827860 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:48.827860 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:48.827860 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 20:09:48.827860 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 20:09:48.827860 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 20:09:48.827860 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 20:09:48.827860 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 20:09:48.827860 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 20:09:48.827860 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 20:09:48.827860 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:48.827860 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 530/1062] 10.222.0.15 () {56 vars in 1093 bytes} [Tue Jun 21 20:09:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:48.833639 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b453ae5-204d-4f1a-a1d1-bfb563d1c269 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:48.850927 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317ab85-3081-4dac-a774-fda7bd254dc2 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:48.891386 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701e724-5271-46e7-8e41-3e212fa18629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:48.892207 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701e724-5271-46e7-8e41-3e212fa18629 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:48.892498 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701e724-5271-46e7-8e41-3e212fa18629 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:48.892779 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701e724-5271-46e7-8e41-3e212fa18629 None admin] PATH_INFO: `/v3/services/image` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:48.893452 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4701e724-5271-46e7-8e41-3e212fa18629 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:48.894848 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4701e724-5271-46e7-8e41-3e212fa18629 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:48.906827 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-4701e724-5271-46e7-8e41-3e212fa18629 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 20:09:48.906827 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:48.906827 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 20:09:48.906827 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 20:09:48.906827 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 20:09:48.906827 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 20:09:48.906827 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 20:09:48.906827 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 20:09:48.906827 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 20:09:48.906827 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:48.906827 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 20:09:48.906827 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:48.906827 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:48.906827 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:48.906827 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:48.906827 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:48.906827 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:48.908179 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:48.908179 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:48.908179 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:48.908179 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:48.908179 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:48.908179 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:48.908179 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 20:09:48.908179 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 20:09:48.908179 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 20:09:48.908179 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 20:09:48.908179 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:48.908179 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:48.908179 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:48.908179 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:48.908179 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:48.908179 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:48.909237 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:48.909237 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:48.909237 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:48.909237 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:48.909237 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:48.909237 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:48.909237 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:48.909237 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:48.909237 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:48.909237 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:48.909237 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 20:09:48.909237 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 20:09:48.909237 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 20:09:48.909237 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:48.909237 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 533/1063] 10.222.0.15 () {56 vars in 1105 bytes} [Tue Jun 21 20:09:48 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:09:48.914664 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701e724-5271-46e7-8e41-3e212fa18629 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:48.947803 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b453ae5-204d-4f1a-a1d1-bfb563d1c269 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:48.950263 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:48.971174 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:48.989326 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09604238-046c-4a72-b4f1-681e9b5cbe01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:48.990011 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09604238-046c-4a72-b4f1-681e9b5cbe01 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:48.990396 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09604238-046c-4a72-b4f1-681e9b5cbe01 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:48.990575 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09604238-046c-4a72-b4f1-681e9b5cbe01 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:48.991415 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09604238-046c-4a72-b4f1-681e9b5cbe01 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:48.991807 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09604238-046c-4a72-b4f1-681e9b5cbe01 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:48.993294 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09604238-046c-4a72-b4f1-681e9b5cbe01 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:49.011646 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 531/1064] 10.222.0.15 () {56 vars in 1133 bytes} [Tue Jun 21 20:09:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:49.017228 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09604238-046c-4a72-b4f1-681e9b5cbe01 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:49.023403 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701e724-5271-46e7-8e41-3e212fa18629 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:49.058243 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27438293-4ebe-4964-890f-1cf5edd5d0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:49.059014 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27438293-4ebe-4964-890f-1cf5edd5d0c1 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:49.059373 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27438293-4ebe-4964-890f-1cf5edd5d0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:49.059729 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27438293-4ebe-4964-890f-1cf5edd5d0c1 None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:49.060558 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27438293-4ebe-4964-890f-1cf5edd5d0c1 None admin] RBAC: Adding query filter params (name=image) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:49.060938 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27438293-4ebe-4964-890f-1cf5edd5d0c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:49.062396 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27438293-4ebe-4964-890f-1cf5edd5d0c1 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:49.067838 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 534/1065] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:09:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:09:49.073120 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27438293-4ebe-4964-890f-1cf5edd5d0c1 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:49.128176 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09604238-046c-4a72-b4f1-681e9b5cbe01 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:49.162310 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001149c-989e-4d0d-a35a-5c3f9ec00ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:49.163181 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001149c-989e-4d0d-a35a-5c3f9ec00ee2 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:49.163536 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001149c-989e-4d0d-a35a-5c3f9ec00ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:49.163886 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001149c-989e-4d0d-a35a-5c3f9ec00ee2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:49.173755 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5001149c-989e-4d0d-a35a-5c3f9ec00ee2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:49.175191 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5001149c-989e-4d0d-a35a-5c3f9ec00ee2 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:49.181203 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27438293-4ebe-4964-890f-1cf5edd5d0c1 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:49.193305 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-5001149c-989e-4d0d-a35a-5c3f9ec00ee2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:49.193305 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:49.193305 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:49.193305 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:49.193305 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:49.193305 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:49.193305 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:49.193305 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:49.193305 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:49.193305 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:49.193305 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:49.193305 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:49.193305 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:09:49.193305 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:09:49.193305 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:09:49.194393 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:09:49.194393 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:49.194393 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:49.194393 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:49.194393 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:49.194393 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:49.194393 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:49.194393 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:49.194393 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:49.194393 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:49.194393 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:49.194393 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:49.194393 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:49.194393 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:49.194393 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:49.194393 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:49.194393 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:49.195781 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:09:49.195781 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:09:49.195781 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:49.195781 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:49.195781 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 532/1066] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:09:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:49.199689 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:49.199960 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001149c-989e-4d0d-a35a-5c3f9ec00ee2 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:49.215451 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:49.220861 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309221b1-167b-48d5-831d-5fea6a0e05c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:49.221532 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309221b1-167b-48d5-831d-5fea6a0e05c1 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:49.221824 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309221b1-167b-48d5-831d-5fea6a0e05c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:49.222610 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309221b1-167b-48d5-831d-5fea6a0e05c1 None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:49.223327 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309221b1-167b-48d5-831d-5fea6a0e05c1 None admin] RBAC: Adding query filter params (type=image) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:49.223641 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309221b1-167b-48d5-831d-5fea6a0e05c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:49.225071 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309221b1-167b-48d5-831d-5fea6a0e05c1 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:49.230107 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 535/1067] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:09:49 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:09:49.235675 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309221b1-167b-48d5-831d-5fea6a0e05c1 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:49.305686 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001149c-989e-4d0d-a35a-5c3f9ec00ee2 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:49.334992 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309221b1-167b-48d5-831d-5fea6a0e05c1 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:49.341998 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7a9ad-56c9-449b-a2b9-96dee53c33ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:49.342708 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7a9ad-56c9-449b-a2b9-96dee53c33ec None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:49.343058 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7a9ad-56c9-449b-a2b9-96dee53c33ec None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:49.343398 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7a9ad-56c9-449b-a2b9-96dee53c33ec None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:49.344392 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb7a9ad-56c9-449b-a2b9-96dee53c33ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:49.345070 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb7a9ad-56c9-449b-a2b9-96dee53c33ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:49.346443 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb7a9ad-56c9-449b-a2b9-96dee53c33ec None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:49.363959 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 533/1068] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:09:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:09:49.366758 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7a9ad-56c9-449b-a2b9-96dee53c33ec None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:49.386425 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070948e2-b69a-4f22-a39e-45c1d42f845d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:49.387027 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070948e2-b69a-4f22-a39e-45c1d42f845d None admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:49.387317 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070948e2-b69a-4f22-a39e-45c1d42f845d None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:49.387601 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070948e2-b69a-4f22-a39e-45c1d42f845d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:49.388417 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070948e2-b69a-4f22-a39e-45c1d42f845d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:49.389804 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070948e2-b69a-4f22-a39e-45c1d42f845d None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:49.424133 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 536/1069] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Jun 21 20:09:49 2022] POST /identity/v3/endpoints => generated 327 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 20:09:49.461347 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:49.491050 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7a9ad-56c9-449b-a2b9-96dee53c33ec None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:49.534234 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d0242-9f15-4590-9340-7629083b39d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:49.535637 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d0242-9f15-4590-9340-7629083b39d4 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:49.535911 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d0242-9f15-4590-9340-7629083b39d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:49.536216 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d0242-9f15-4590-9340-7629083b39d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:49.543573 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1d0242-9f15-4590-9340-7629083b39d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:49.545133 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1d0242-9f15-4590-9340-7629083b39d4 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:49.559981 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-9a1d0242-9f15-4590-9340-7629083b39d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:09:49.559981 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:49.559981 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:49.559981 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:49.559981 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:49.559981 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:49.559981 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:49.559981 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:49.559981 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:49.559981 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:49.559981 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:49.559981 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:49.559981 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 20:09:49.559981 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 20:09:49.559981 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 20:09:49.560945 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 20:09:49.560945 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:49.560945 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:49.560945 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:49.560945 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:49.560945 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:49.560945 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:49.560945 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:49.560945 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:49.560945 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:49.560945 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:49.560945 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:49.560945 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:49.560945 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:49.560945 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:49.560945 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:49.560945 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:49.561863 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 20:09:49.561863 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 20:09:49.561863 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 20:09:49.561863 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 20:09:49.561863 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 20:09:49.561863 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 20:09:49.561863 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:09:49.561863 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:49.561863 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 534/1070] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jun 21 20:09:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:49.567173 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070948e2-b69a-4f22-a39e-45c1d42f845d None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:49.605525 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:49.675337 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070948e2-b69a-4f22-a39e-45c1d42f845d None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:49.709159 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf749c98-450b-451e-8914-11a4b9fd330c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:49.709821 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf749c98-450b-451e-8914-11a4b9fd330c None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:49.710111 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf749c98-450b-451e-8914-11a4b9fd330c None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:49.710392 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf749c98-450b-451e-8914-11a4b9fd330c None admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:49.711186 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf749c98-450b-451e-8914-11a4b9fd330c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:49.711503 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf749c98-450b-451e-8914-11a4b9fd330c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:49.712966 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf749c98-450b-451e-8914-11a4b9fd330c None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:49.725310 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 537/1071] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jun 21 20:09:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:09:49.731284 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d0242-9f15-4590-9340-7629083b39d4 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:49.830478 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d0242-9f15-4590-9340-7629083b39d4 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:49.861930 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:49.868718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60739c5e-81d2-4e74-bb78-969b34bfc3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:49.869612 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60739c5e-81d2-4e74-bb78-969b34bfc3d4 None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:49.869899 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60739c5e-81d2-4e74-bb78-969b34bfc3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:49.870172 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60739c5e-81d2-4e74-bb78-969b34bfc3d4 None admin] PATH_INFO: `/v3/projects/4dcb71ef7b6e49148edd61a1eb8da7bb/users/3918fe05c8634bc39f3e295374701465/roles/1db2217c34b945f19d47444f74970dd5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:49.872377 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60739c5e-81d2-4e74-bb78-969b34bfc3d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=4dcb71ef7b6e49148edd61a1eb8da7bb, user_id=3918fe05c8634bc39f3e295374701465, role_id=1db2217c34b945f19d47444f74970dd5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:49.873793 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60739c5e-81d2-4e74-bb78-969b34bfc3d4 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:49.887142 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 535/1072] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Jun 21 20:09:49 2022] PUT /identity/v3/projects/4dcb71ef7b6e49148edd61a1eb8da7bb/users/3918fe05c8634bc39f3e295374701465/roles/1db2217c34b945f19d47444f74970dd5 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:09:50.399035 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa3988-7138-40e0-8a7e-ea10815ab6c2 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:50.399390 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa3988-7138-40e0-8a7e-ea10815ab6c2 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:50.399605 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa3988-7138-40e0-8a7e-ea10815ab6c2 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:50.401154 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 538/1073] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:09:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:09:50.406185 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b0a27-a99a-4380-badd-92d3ddba2815 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:50.406484 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b0a27-a99a-4380-badd-92d3ddba2815 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:50.406769 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b0a27-a99a-4380-badd-92d3ddba2815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:50.423266 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-a18b0a27-a99a-4380-badd-92d3ddba2815 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:09:50.424485 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a18b0a27-a99a-4380-badd-92d3ddba2815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:09:50.493026 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 536/1074] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:09:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 20:09:50.515656 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa3988-7138-40e0-8a7e-ea10815ab6c2 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:50.616114 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:50.624887 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa3988-7138-40e0-8a7e-ea10815ab6c2 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:50.658287 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2250dc01-4387-4e72-82cd-b025cd8f3e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:50.659015 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250dc01-4387-4e72-82cd-b025cd8f3e75 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:50.659303 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250dc01-4387-4e72-82cd-b025cd8f3e75 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:50.660213 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250dc01-4387-4e72-82cd-b025cd8f3e75 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:50.670196 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2250dc01-4387-4e72-82cd-b025cd8f3e75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:09:50.678305 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-2250dc01-4387-4e72-82cd-b025cd8f3e75 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 20:09:50.678305 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:50.678305 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:50.678305 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:50.678305 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:50.678305 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:50.678305 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:50.678305 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:50.678305 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:50.678305 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:50.678305 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:50.678305 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:50.678305 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:09:50.678305 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:09:50.678305 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:09:50.678305 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:09:50.679247 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:09:50.679247 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:09:50.679247 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:09:50.679247 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:09:50.679247 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:50.679247 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:50.679247 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:50.679247 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:50.679247 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:50.679247 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:50.679247 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:50.679247 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:50.679247 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:50.679247 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:50.679247 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:50.679247 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:50.680567 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:50.680567 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:50.680567 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:50.680567 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:50.680567 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:09:50.680567 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:09:50.680567 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:09:50.680567 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:09:50.680567 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:09:50.680567 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:09:50.680567 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 20:09:50.680567 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:50.681532 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 539/1075] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jun 21 20:09:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:50.685608 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b0a27-a99a-4380-badd-92d3ddba2815 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:50.783597 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b0a27-a99a-4380-badd-92d3ddba2815 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:50.803975 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:50.820118 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e144c80-ccc2-48ce-b3d5-1795e1adf4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:50.820785 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e144c80-ccc2-48ce-b3d5-1795e1adf4f2 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:50.821068 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e144c80-ccc2-48ce-b3d5-1795e1adf4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:50.821341 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e144c80-ccc2-48ce-b3d5-1795e1adf4f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:50.822075 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e144c80-ccc2-48ce-b3d5-1795e1adf4f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:50.822381 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e144c80-ccc2-48ce-b3d5-1795e1adf4f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:50.823729 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e144c80-ccc2-48ce-b3d5-1795e1adf4f2 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:50.837288 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 537/1076] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:09:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:09:50.840424 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2250dc01-4387-4e72-82cd-b025cd8f3e75 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:50.943022 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2250dc01-4387-4e72-82cd-b025cd8f3e75 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:50.978150 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcce4df-7ea3-4e04-8dad-96890cd91692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:50.979043 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcce4df-7ea3-4e04-8dad-96890cd91692 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:50.979324 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcce4df-7ea3-4e04-8dad-96890cd91692 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:50.979598 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcce4df-7ea3-4e04-8dad-96890cd91692 None admin] PATH_INFO: `/v3/users/8c6bc346e5334c19a09fbf1667bc789b` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:50.980838 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcce4df-7ea3-4e04-8dad-96890cd91692 None admin] RBAC: Authorizing `identity:get_user(user_id=8c6bc346e5334c19a09fbf1667bc789b)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:50.982266 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcce4df-7ea3-4e04-8dad-96890cd91692 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:50.989336 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 540/1077] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jun 21 20:09:50 2022] GET /identity/v3/users/8c6bc346e5334c19a09fbf1667bc789b => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:50.990308 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e144c80-ccc2-48ce-b3d5-1795e1adf4f2 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:51.090316 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e144c80-ccc2-48ce-b3d5-1795e1adf4f2 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:51.123909 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89bcae9-42bf-4b71-87d2-f489854156e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:51.124789 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89bcae9-42bf-4b71-87d2-f489854156e7 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:51.125071 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89bcae9-42bf-4b71-87d2-f489854156e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:51.125346 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89bcae9-42bf-4b71-87d2-f489854156e7 None admin] PATH_INFO: `/v3/projects/b5c900d23c744637981e326323ed86f6` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:51.126608 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89bcae9-42bf-4b71-87d2-f489854156e7 None admin] RBAC: Authorizing `identity:get_project(project_id=b5c900d23c744637981e326323ed86f6)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:51.128171 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89bcae9-42bf-4b71-87d2-f489854156e7 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:51.134688 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 538/1078] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jun 21 20:09:50 2022] GET /identity/v3/projects/b5c900d23c744637981e326323ed86f6 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:09:51.135794 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcce4df-7ea3-4e04-8dad-96890cd91692 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:51.162654 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:51.236974 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcce4df-7ea3-4e04-8dad-96890cd91692 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:51.270536 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8f3abf-e44e-4102-a151-7e968873108c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:51.271425 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f3abf-e44e-4102-a151-7e968873108c None admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:51.271708 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f3abf-e44e-4102-a151-7e968873108c None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:51.272012 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f3abf-e44e-4102-a151-7e968873108c None admin] PATH_INFO: `/v3/projects/b5c900d23c744637981e326323ed86f6/users/8c6bc346e5334c19a09fbf1667bc789b/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:51.273949 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8f3abf-e44e-4102-a151-7e968873108c None admin] RBAC: Authorizing `identity:create_grant(project_id=b5c900d23c744637981e326323ed86f6, user_id=8c6bc346e5334c19a09fbf1667bc789b, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:51.275364 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8f3abf-e44e-4102-a151-7e968873108c None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:51.288095 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 541/1079] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Jun 21 20:09:51 2022] PUT /identity/v3/projects/b5c900d23c744637981e326323ed86f6/users/8c6bc346e5334c19a09fbf1667bc789b/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:09:51.477176 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf3968-9bc5-44fc-ac7d-4d048b021b8f None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:51.477501 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf3968-9bc5-44fc-ac7d-4d048b021b8f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:51.477781 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf3968-9bc5-44fc-ac7d-4d048b021b8f None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:51.479287 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 539/1080] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:09:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:09:51.484602 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ff313-5b7c-4ad4-a2dc-883a67710708 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:51.484903 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ff313-5b7c-4ad4-a2dc-883a67710708 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:51.485190 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ff313-5b7c-4ad4-a2dc-883a67710708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:51.502007 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-f48ff313-5b7c-4ad4-a2dc-883a67710708 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:09:51.503117 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-f48ff313-5b7c-4ad4-a2dc-883a67710708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:09:51.572939 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 542/1081] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:09:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 20:09:51.595307 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf3968-9bc5-44fc-ac7d-4d048b021b8f None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:51.647173 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:51.703149 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf3968-9bc5-44fc-ac7d-4d048b021b8f None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:51.736374 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaba357-da1d-49ac-a454-9b134e729221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:51.737031 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaba357-da1d-49ac-a454-9b134e729221 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:51.737318 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaba357-da1d-49ac-a454-9b134e729221 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:51.738113 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaba357-da1d-49ac-a454-9b134e729221 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:51.806330 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaba357-da1d-49ac-a454-9b134e729221 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:51.807697 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaba357-da1d-49ac-a454-9b134e729221 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:51.864569 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:51.909029 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32232904-c3a9-4f98-98f4-5cae145867fd None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:51.909595 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32232904-c3a9-4f98-98f4-5cae145867fd None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:51.909920 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32232904-c3a9-4f98-98f4-5cae145867fd None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:51.911963 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 543/1082] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:09:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 20:09:51.916304 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999259db-0190-4ad4-b27d-0f550c1badba None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:51.916685 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999259db-0190-4ad4-b27d-0f550c1badba None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:51.916800 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 540/1083] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:09:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 20:09:51.920243 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999259db-0190-4ad4-b27d-0f550c1badba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:51.922349 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaba357-da1d-49ac-a454-9b134e729221 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:51.937449 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-999259db-0190-4ad4-b27d-0f550c1badba None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:09:51.938621 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-999259db-0190-4ad4-b27d-0f550c1badba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:09:51.948831 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:52.014489 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 544/1084] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:09:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 20:09:52.028744 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaba357-da1d-49ac-a454-9b134e729221 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:52.038367 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999259db-0190-4ad4-b27d-0f550c1badba None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:52.067627 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2e20b-01ae-48e6-aa12-ef0e80f33939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:52.068379 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2e20b-01ae-48e6-aa12-ef0e80f33939 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:52.068674 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2e20b-01ae-48e6-aa12-ef0e80f33939 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:52.068958 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2e20b-01ae-48e6-aa12-ef0e80f33939 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:52.079385 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f2e20b-01ae-48e6-aa12-ef0e80f33939 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:52.080851 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f2e20b-01ae-48e6-aa12-ef0e80f33939 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:52.098317 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-c2f2e20b-01ae-48e6-aa12-ef0e80f33939 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:52.098317 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:52.098317 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:52.098317 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:52.098317 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:52.098317 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:52.098317 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:52.098317 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:52.098317 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:52.098317 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:52.098317 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:52.098317 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:52.098317 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:09:52.098317 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:09:52.098317 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:09:52.099190 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:09:52.099190 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:52.099190 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:52.099190 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:52.099190 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:52.099190 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:52.099190 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:52.099190 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:52.099190 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:52.099190 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:52.099190 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:52.099190 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:52.099190 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:52.099190 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:52.099190 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:52.099190 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:52.099190 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:52.100156 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:09:52.100156 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:09:52.100156 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:52.100156 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:52.100156 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 541/1085] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:09:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:09:52.105231 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2e20b-01ae-48e6-aa12-ef0e80f33939 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:52.107756 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:52.144654 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999259db-0190-4ad4-b27d-0f550c1badba None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:52.181586 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d6735-1a67-4f63-aa9d-d65903e7a80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:52.182394 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d6735-1a67-4f63-aa9d-d65903e7a80f None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:52.182680 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d6735-1a67-4f63-aa9d-d65903e7a80f None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:52.182960 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d6735-1a67-4f63-aa9d-d65903e7a80f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:52.193761 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017d6735-1a67-4f63-aa9d-d65903e7a80f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:09:52.202556 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-017d6735-1a67-4f63-aa9d-d65903e7a80f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 20:09:52.202556 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:52.202556 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:52.202556 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:52.202556 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:52.202556 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:52.202556 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:52.202556 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:52.202556 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:52.202556 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:52.202556 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:52.202556 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:52.202556 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:09:52.202556 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:09:52.202556 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:09:52.202556 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:09:52.203512 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:09:52.203512 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:09:52.203512 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:09:52.203512 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:09:52.203512 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:52.203512 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:52.203512 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:52.203512 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:52.203512 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:52.203512 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:52.203512 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:52.203512 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:52.203512 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:52.203512 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:52.203512 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:52.203512 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:52.208921 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:52.208921 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:52.208921 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:52.208921 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:52.208921 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:09:52.208921 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:09:52.208921 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:09:52.208921 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:09:52.208921 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:09:52.208921 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:09:52.208921 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 20:09:52.208921 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:52.209610 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2e20b-01ae-48e6-aa12-ef0e80f33939 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:52.209702 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 545/1086] 10.222.0.15 () {56 vars in 1120 bytes} [Tue Jun 21 20:09:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:09:52.210938 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d6735-1a67-4f63-aa9d-d65903e7a80f None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:52.214472 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:52.243639 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d2e16-e182-4811-8689-4e20d0fe0dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:52.244349 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d2e16-e182-4811-8689-4e20d0fe0dc7 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:52.244640 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d2e16-e182-4811-8689-4e20d0fe0dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:52.244925 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d2e16-e182-4811-8689-4e20d0fe0dc7 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:52.245655 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6d2e16-e182-4811-8689-4e20d0fe0dc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:52.245952 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6d2e16-e182-4811-8689-4e20d0fe0dc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:52.247313 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6d2e16-e182-4811-8689-4e20d0fe0dc7 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:52.267953 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 542/1087] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:09:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:52.320772 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d6735-1a67-4f63-aa9d-d65903e7a80f None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:52.358119 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98888d3-51cc-439c-b08c-e7a382bb3647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:52.359056 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98888d3-51cc-439c-b08c-e7a382bb3647 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:52.359344 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98888d3-51cc-439c-b08c-e7a382bb3647 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:52.359620 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98888d3-51cc-439c-b08c-e7a382bb3647 None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:52.360578 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98888d3-51cc-439c-b08c-e7a382bb3647 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:52.360893 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98888d3-51cc-439c-b08c-e7a382bb3647 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:52.362318 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98888d3-51cc-439c-b08c-e7a382bb3647 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:52.371612 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 546/1088] 10.222.0.15 () {56 vars in 1115 bytes} [Tue Jun 21 20:09:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:52.377617 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d2e16-e182-4811-8689-4e20d0fe0dc7 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:52.444110 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:52.486384 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d2e16-e182-4811-8689-4e20d0fe0dc7 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:52.524018 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05f94c9-1ed8-4407-a8b5-f016c20545eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:52.524850 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f94c9-1ed8-4407-a8b5-f016c20545eb None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:52.525119 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f94c9-1ed8-4407-a8b5-f016c20545eb None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:52.525400 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f94c9-1ed8-4407-a8b5-f016c20545eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:52.536308 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05f94c9-1ed8-4407-a8b5-f016c20545eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:52.537757 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05f94c9-1ed8-4407-a8b5-f016c20545eb None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:52.555315 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-c05f94c9-1ed8-4407-a8b5-f016c20545eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:52.555315 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:52.555315 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:52.555315 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:52.555315 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:52.555315 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:52.555315 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:52.555315 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:52.555315 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:52.555315 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:52.555315 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:52.555315 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:52.555315 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:09:52.555315 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:09:52.555315 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:09:52.556311 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:09:52.556311 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:52.556311 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:52.556311 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:52.556311 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:52.556311 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:52.556311 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:52.556311 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:52.556311 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:52.556311 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:52.556311 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:52.556311 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:52.556311 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:52.556311 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:52.556311 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:52.556311 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:52.556311 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:52.557609 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:09:52.557609 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:09:52.557609 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:52.557609 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:52.557609 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 543/1089] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:09:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:52.562547 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98888d3-51cc-439c-b08c-e7a382bb3647 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:52.627769 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:52.662885 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98888d3-51cc-439c-b08c-e7a382bb3647 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:52.696417 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c18dec-94b0-4bb5-b8b7-bd2d99231ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:52.697073 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c18dec-94b0-4bb5-b8b7-bd2d99231ae8 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:52.697363 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c18dec-94b0-4bb5-b8b7-bd2d99231ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:52.697642 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c18dec-94b0-4bb5-b8b7-bd2d99231ae8 None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:52.698362 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c18dec-94b0-4bb5-b8b7-bd2d99231ae8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:52.698673 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c18dec-94b0-4bb5-b8b7-bd2d99231ae8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:52.700058 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c18dec-94b0-4bb5-b8b7-bd2d99231ae8 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:52.711722 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 547/1090] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:09:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:52.717327 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05f94c9-1ed8-4407-a8b5-f016c20545eb None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:52.815291 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05f94c9-1ed8-4407-a8b5-f016c20545eb None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:52.828540 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:52.849776 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9e624-ae4e-430a-8342-eb3945ca9481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:52.850582 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9e624-ae4e-430a-8342-eb3945ca9481 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:52.850869 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9e624-ae4e-430a-8342-eb3945ca9481 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:52.851148 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9e624-ae4e-430a-8342-eb3945ca9481 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:52.861569 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece9e624-ae4e-430a-8342-eb3945ca9481 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:52.863581 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece9e624-ae4e-430a-8342-eb3945ca9481 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:52.877506 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-ece9e624-ae4e-430a-8342-eb3945ca9481 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 20:09:52.877506 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:52.877506 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:52.877506 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:52.877506 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:52.877506 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:52.877506 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:52.877506 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:52.877506 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:52.877506 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:52.877506 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:52.877506 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:52.877506 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 20:09:52.877506 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 20:09:52.877506 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 20:09:52.877506 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 20:09:52.878739 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:52.878739 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:52.878739 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 20:09:52.878739 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:09:52.878739 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 20:09:52.878739 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:09:52.878739 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:52.878739 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:52.878739 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:52.878739 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:52.878739 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:52.878739 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:52.878739 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:52.878739 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:52.878739 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:52.878739 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:52.878739 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:52.878739 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:52.879707 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:52.879707 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:52.879707 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 20:09:52.879707 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 20:09:52.879707 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 20:09:52.879707 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 20:09:52.879707 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 20:09:52.879707 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 20:09:52.879707 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 20:09:52.879707 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:52.879707 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 544/1091] 10.222.0.15 () {56 vars in 1093 bytes} [Tue Jun 21 20:09:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:09:52.884416 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c18dec-94b0-4bb5-b8b7-bd2d99231ae8 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:52.980554 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c18dec-94b0-4bb5-b8b7-bd2d99231ae8 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:53.006079 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:53.015209 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1859dc35-813a-4009-8140-366bda234225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:53.015880 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1859dc35-813a-4009-8140-366bda234225 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:53.016343 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1859dc35-813a-4009-8140-366bda234225 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:53.016624 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1859dc35-813a-4009-8140-366bda234225 None admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:53.017463 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1859dc35-813a-4009-8140-366bda234225 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:53.017776 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1859dc35-813a-4009-8140-366bda234225 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:53.019186 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1859dc35-813a-4009-8140-366bda234225 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:53.036427 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 548/1092] 10.222.0.15 () {56 vars in 1133 bytes} [Tue Jun 21 20:09:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:53.041924 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9e624-ae4e-430a-8342-eb3945ca9481 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:53.137958 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9e624-ae4e-430a-8342-eb3945ca9481 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:53.170878 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac35e8-f8a2-4a42-a68a-c6e12e18e02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:53.171526 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac35e8-f8a2-4a42-a68a-c6e12e18e02b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:53.171809 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac35e8-f8a2-4a42-a68a-c6e12e18e02b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:53.172119 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac35e8-f8a2-4a42-a68a-c6e12e18e02b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:53.212983 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:53.238290 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fac35e8-f8a2-4a42-a68a-c6e12e18e02b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:53.239735 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fac35e8-f8a2-4a42-a68a-c6e12e18e02b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:53.298316 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d9996-e05f-49a3-929d-95f4efe9b4df None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:53.298611 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d9996-e05f-49a3-929d-95f4efe9b4df None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:53.298894 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d9996-e05f-49a3-929d-95f4efe9b4df None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:53.300299 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 549/1093] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:09:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 20:09:53.305069 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7694f-89c8-4ea2-998b-a3a1d8622512 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:53.305353 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7694f-89c8-4ea2-998b-a3a1d8622512 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:53.305629 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7694f-89c8-4ea2-998b-a3a1d8622512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:53.321393 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-22e7694f-89c8-4ea2-998b-a3a1d8622512 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:09:53.322579 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-22e7694f-89c8-4ea2-998b-a3a1d8622512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:09:53.336612 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 545/1094] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:09:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 21 20:09:53.342096 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac35e8-f8a2-4a42-a68a-c6e12e18e02b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:53.388572 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 550/1095] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:09:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 20:09:53.412661 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7694f-89c8-4ea2-998b-a3a1d8622512 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:53.421498 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:53.448502 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac35e8-f8a2-4a42-a68a-c6e12e18e02b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:53.481796 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd990354-6e91-4ee9-a937-f058c92993b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:53.482585 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd990354-6e91-4ee9-a937-f058c92993b7 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:53.482871 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd990354-6e91-4ee9-a937-f058c92993b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:53.483149 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd990354-6e91-4ee9-a937-f058c92993b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:53.493190 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd990354-6e91-4ee9-a937-f058c92993b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:53.494614 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd990354-6e91-4ee9-a937-f058c92993b7 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:53.510629 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7694f-89c8-4ea2-998b-a3a1d8622512 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:53.512911 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-dd990354-6e91-4ee9-a937-f058c92993b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:53.512911 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:53.512911 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:53.512911 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:53.512911 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:53.512911 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:53.512911 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:53.512911 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:53.512911 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:53.512911 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:53.512911 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:53.512911 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:53.512911 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:09:53.512911 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:09:53.512911 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:09:53.513844 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:09:53.513844 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:53.513844 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:53.513844 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:53.513844 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:53.513844 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:53.513844 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:53.513844 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:53.513844 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:53.513844 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:53.513844 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:53.513844 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:53.513844 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:53.513844 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:53.513844 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:53.513844 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:53.513844 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:53.514747 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:09:53.514747 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:09:53.514747 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:09:53.514747 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:53.514747 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 546/1096] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:09:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:09:53.520147 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd990354-6e91-4ee9-a937-f058c92993b7 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:53.526234 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:53.546592 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2292708-b10f-481b-819c-58342f7c03e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:53.547383 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2292708-b10f-481b-819c-58342f7c03e9 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:53.547668 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2292708-b10f-481b-819c-58342f7c03e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:53.547963 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2292708-b10f-481b-819c-58342f7c03e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:53.557653 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2292708-b10f-481b-819c-58342f7c03e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:09:53.565111 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-d2292708-b10f-481b-819c-58342f7c03e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 20:09:53.565111 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:53.565111 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:53.565111 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:53.565111 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:53.565111 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:53.565111 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:53.565111 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:53.565111 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:53.565111 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:53.565111 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:53.565111 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:53.565111 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:09:53.565111 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:09:53.565111 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:09:53.565111 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:09:53.566750 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:09:53.566750 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:09:53.566750 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:09:53.566750 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:09:53.566750 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:53.566750 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:53.566750 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:53.566750 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:53.566750 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:53.566750 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:53.566750 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:53.566750 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:53.566750 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:53.566750 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:53.566750 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:53.566750 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:53.568196 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:53.568196 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:53.568196 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:53.568196 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:53.568196 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:09:53.568196 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:09:53.568196 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:09:53.568196 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:09:53.568196 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:09:53.568196 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:09:53.568196 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 20:09:53.568196 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:09:53.568196 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 551/1097] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jun 21 20:09:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:09:53.572537 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2292708-b10f-481b-819c-58342f7c03e9 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:53.615925 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd990354-6e91-4ee9-a937-f058c92993b7 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:53.641132 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:53.650658 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5181c-5743-41ff-b206-5dbbc87986e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:53.651320 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5181c-5743-41ff-b206-5dbbc87986e3 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:53.651604 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5181c-5743-41ff-b206-5dbbc87986e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:53.651882 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5181c-5743-41ff-b206-5dbbc87986e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:53.652639 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c5181c-5743-41ff-b206-5dbbc87986e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:53.652948 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c5181c-5743-41ff-b206-5dbbc87986e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:53.654302 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c5181c-5743-41ff-b206-5dbbc87986e3 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:53.665427 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 547/1098] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:09:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:09:53.670700 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5181c-5743-41ff-b206-5dbbc87986e3 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:53.672748 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2292708-b10f-481b-819c-58342f7c03e9 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:53.707889 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c83b4-98d2-4bd3-81ed-4ae8cfbf841f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:53.708583 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c83b4-98d2-4bd3-81ed-4ae8cfbf841f None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:53.709266 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c83b4-98d2-4bd3-81ed-4ae8cfbf841f None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:53.709551 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c83b4-98d2-4bd3-81ed-4ae8cfbf841f None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:53.710301 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252c83b4-98d2-4bd3-81ed-4ae8cfbf841f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:53.710613 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252c83b4-98d2-4bd3-81ed-4ae8cfbf841f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:53.712357 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252c83b4-98d2-4bd3-81ed-4ae8cfbf841f None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:53.720270 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 552/1099] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:09:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:09:53.725800 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c83b4-98d2-4bd3-81ed-4ae8cfbf841f None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:53.763806 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:53.771328 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5181c-5743-41ff-b206-5dbbc87986e3 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:53.804845 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee15b3b-6773-45be-9a75-8856befb7446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:53.805714 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee15b3b-6773-45be-9a75-8856befb7446 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:53.806001 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee15b3b-6773-45be-9a75-8856befb7446 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:53.806278 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee15b3b-6773-45be-9a75-8856befb7446 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:53.812807 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee15b3b-6773-45be-9a75-8856befb7446 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:53.814225 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee15b3b-6773-45be-9a75-8856befb7446 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:53.828493 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-3ee15b3b-6773-45be-9a75-8856befb7446 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:09:53.828493 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:09:53.828493 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:09:53.828493 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:09:53.828493 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:09:53.828493 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:09:53.828493 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:09:53.828493 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:09:53.828493 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:09:53.828493 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:09:53.828493 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:09:53.828493 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:09:53.828493 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 20:09:53.828493 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 20:09:53.828493 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 20:09:53.830105 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 20:09:53.830105 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:09:53.830105 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:09:53.830105 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:09:53.830105 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:09:53.830105 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:09:53.830105 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:09:53.830105 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:09:53.830105 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:09:53.830105 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:09:53.830105 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:09:53.830105 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:09:53.830105 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:09:53.830105 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:09:53.830105 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:09:53.830105 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:09:53.830105 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:09:53.831341 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 20:09:53.831341 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 20:09:53.831341 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 20:09:53.831341 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 20:09:53.831341 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 20:09:53.831341 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 20:09:53.831341 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:09:53.831341 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:09:53.831882 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c83b4-98d2-4bd3-81ed-4ae8cfbf841f None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:53.832011 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 548/1100] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jun 21 20:09:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:09:53.835275 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee15b3b-6773-45be-9a75-8856befb7446 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:53.867338 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f83b2-cedd-4ab1-9482-823e5737efa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:53.868253 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f83b2-cedd-4ab1-9482-823e5737efa8 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:53.868538 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f83b2-cedd-4ab1-9482-823e5737efa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:53.868816 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f83b2-cedd-4ab1-9482-823e5737efa8 None admin] PATH_INFO: `/v3/users/8c6bc346e5334c19a09fbf1667bc789b` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:53.870016 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875f83b2-cedd-4ab1-9482-823e5737efa8 None admin] RBAC: Authorizing `identity:get_user(user_id=8c6bc346e5334c19a09fbf1667bc789b)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:53.871434 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875f83b2-cedd-4ab1-9482-823e5737efa8 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:53.873097 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 553/1101] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jun 21 20:09:53 2022] GET /identity/v3/users/8c6bc346e5334c19a09fbf1667bc789b => generated 285 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:09:53.879259 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f83b2-cedd-4ab1-9482-823e5737efa8 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:53.881917 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:53.934867 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee15b3b-6773-45be-9a75-8856befb7446 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:53.968231 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde357b-6396-45d3-81f0-17e4326dbd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:53.969112 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde357b-6396-45d3-81f0-17e4326dbd85 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:53.969401 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde357b-6396-45d3-81f0-17e4326dbd85 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:53.969684 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde357b-6396-45d3-81f0-17e4326dbd85 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:53.970467 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fde357b-6396-45d3-81f0-17e4326dbd85 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:53.970783 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fde357b-6396-45d3-81f0-17e4326dbd85 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:53.972236 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fde357b-6396-45d3-81f0-17e4326dbd85 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:53.977845 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f83b2-cedd-4ab1-9482-823e5737efa8 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:53.981275 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:53.984135 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 549/1102] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jun 21 20:09:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:09:53.990625 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde357b-6396-45d3-81f0-17e4326dbd85 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:54.013836 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ee6e2-1758-4c01-828e-ff4386772782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:54.014495 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ee6e2-1758-4c01-828e-ff4386772782 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:54.014780 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ee6e2-1758-4c01-828e-ff4386772782 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:54.015064 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ee6e2-1758-4c01-828e-ff4386772782 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:54.080915 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108ee6e2-1758-4c01-828e-ff4386772782 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:54.082372 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108ee6e2-1758-4c01-828e-ff4386772782 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:54.087034 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde357b-6396-45d3-81f0-17e4326dbd85 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:54.094347 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:54.121860 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b7469-0193-4c1a-9837-282edeb19a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:54.122515 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b7469-0193-4c1a-9837-282edeb19a01 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:54.122803 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b7469-0193-4c1a-9837-282edeb19a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:54.123084 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b7469-0193-4c1a-9837-282edeb19a01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:54.123912 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98b7469-0193-4c1a-9837-282edeb19a01 None admin] RBAC: Adding query filter params (role.id=1db2217c34b945f19d47444f74970dd5, scope.project.id=4dcb71ef7b6e49148edd61a1eb8da7bb, user.id=3918fe05c8634bc39f3e295374701465) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:54.124250 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98b7469-0193-4c1a-9837-282edeb19a01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:54.125659 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98b7469-0193-4c1a-9837-282edeb19a01 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:54.132191 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 550/1103] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jun 21 20:09:53 2022] GET /identity/v3/role_assignments?user.id=3918fe05c8634bc39f3e295374701465&scope.project.id=4dcb71ef7b6e49148edd61a1eb8da7bb&role.id=1db2217c34b945f19d47444f74970dd5 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:09:54.182490 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 554/1104] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:09:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 21 20:09:54.188573 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b7469-0193-4c1a-9837-282edeb19a01 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:54.293795 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b7469-0193-4c1a-9837-282edeb19a01 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:54.329262 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fdc470-8597-4f66-be9a-cc2a77fb0dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:54.330125 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fdc470-8597-4f66-be9a-cc2a77fb0dc9 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:54.330415 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fdc470-8597-4f66-be9a-cc2a77fb0dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:54.330700 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fdc470-8597-4f66-be9a-cc2a77fb0dc9 None admin] PATH_INFO: `/v3/projects/b5c900d23c744637981e326323ed86f6` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:54.331942 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fdc470-8597-4f66-be9a-cc2a77fb0dc9 None admin] RBAC: Authorizing `identity:get_project(project_id=b5c900d23c744637981e326323ed86f6)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:54.333376 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fdc470-8597-4f66-be9a-cc2a77fb0dc9 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:54.335089 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 551/1105] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jun 21 20:09:54 2022] GET /identity/v3/projects/b5c900d23c744637981e326323ed86f6 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:54.341265 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ee6e2-1758-4c01-828e-ff4386772782 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:54.344374 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:54.443996 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ee6e2-1758-4c01-828e-ff4386772782 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:54.480076 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8f73d-9864-4c4f-97aa-498c3b837933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:54.480736 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8f73d-9864-4c4f-97aa-498c3b837933 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:54.481024 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8f73d-9864-4c4f-97aa-498c3b837933 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:54.481304 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8f73d-9864-4c4f-97aa-498c3b837933 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:54.482149 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc8f73d-9864-4c4f-97aa-498c3b837933 None admin] RBAC: Adding query filter params (role.id=1f5332f48d9e4c2aac866d0d546c94d5, scope.project.id=b5c900d23c744637981e326323ed86f6, user.id=8c6bc346e5334c19a09fbf1667bc789b) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:54.482465 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc8f73d-9864-4c4f-97aa-498c3b837933 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:54.484196 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc8f73d-9864-4c4f-97aa-498c3b837933 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:54.490738 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 555/1106] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jun 21 20:09:54 2022] GET /identity/v3/role_assignments?user.id=8c6bc346e5334c19a09fbf1667bc789b&scope.project.id=b5c900d23c744637981e326323ed86f6&role.id=1f5332f48d9e4c2aac866d0d546c94d5 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:56.523023 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3752c59-3afd-48f0-9874-7733cc9bfd13 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:56.523552 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3752c59-3afd-48f0-9874-7733cc9bfd13 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:56.523646 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3752c59-3afd-48f0-9874-7733cc9bfd13 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:56.525040 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 552/1107] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:09:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:09:56.530171 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398685f-3ef1-45f9-b4d9-d0350b3b75d1 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:56.530577 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398685f-3ef1-45f9-b4d9-d0350b3b75d1 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:56.530739 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398685f-3ef1-45f9-b4d9-d0350b3b75d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:56.547455 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-c398685f-3ef1-45f9-b4d9-d0350b3b75d1 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:09:56.548655 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-c398685f-3ef1-45f9-b4d9-d0350b3b75d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:09:56.607732 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:56.614212 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 556/1108] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:09:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 20:09:56.638759 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3752c59-3afd-48f0-9874-7733cc9bfd13 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:56.679631 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:56.738963 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3752c59-3afd-48f0-9874-7733cc9bfd13 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:56.770445 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74a8ac-2e9e-4f83-8cc1-c7ca53c84f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:56.771228 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74a8ac-2e9e-4f83-8cc1-c7ca53c84f94 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:56.771513 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74a8ac-2e9e-4f83-8cc1-c7ca53c84f94 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:56.771792 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74a8ac-2e9e-4f83-8cc1-c7ca53c84f94 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:56.772981 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f74a8ac-2e9e-4f83-8cc1-c7ca53c84f94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:56.774440 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f74a8ac-2e9e-4f83-8cc1-c7ca53c84f94 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:56.775994 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 553/1109] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:09:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:56.781425 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c398685f-3ef1-45f9-b4d9-d0350b3b75d1 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:56.876301 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c398685f-3ef1-45f9-b4d9-d0350b3b75d1 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:56.908445 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95baf5bd-b59a-4d75-971d-395c9d6b0ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:56.909103 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95baf5bd-b59a-4d75-971d-395c9d6b0ae0 None admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:56.909967 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95baf5bd-b59a-4d75-971d-395c9d6b0ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:56.910243 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95baf5bd-b59a-4d75-971d-395c9d6b0ae0 None admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:56.910941 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95baf5bd-b59a-4d75-971d-395c9d6b0ae0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:56.912374 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95baf5bd-b59a-4d75-971d-395c9d6b0ae0 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:56.930942 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 557/1110] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Jun 21 20:09:56 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:09:58.984164 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67414a-7583-485e-a35b-423ba93392f0 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:58.984658 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67414a-7583-485e-a35b-423ba93392f0 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:58.984771 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67414a-7583-485e-a35b-423ba93392f0 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:58.986107 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 554/1111] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:09:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:09:58.991877 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0da0d0-42f8-4600-81fd-f77449671be7 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:58.992524 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0da0d0-42f8-4600-81fd-f77449671be7 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:58.992811 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0da0d0-42f8-4600-81fd-f77449671be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:59.009127 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-df0da0d0-42f8-4600-81fd-f77449671be7 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:09:59.010288 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-df0da0d0-42f8-4600-81fd-f77449671be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:09:59.057427 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:59.075037 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 558/1112] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:09:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 20:09:59.101004 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe67414a-7583-485e-a35b-423ba93392f0 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:59.204798 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe67414a-7583-485e-a35b-423ba93392f0 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:59.211901 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:59.238551 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc820d-1fb1-476b-a7c1-2b5ebccb11f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:59.239400 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc820d-1fb1-476b-a7c1-2b5ebccb11f3 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:59.239681 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc820d-1fb1-476b-a7c1-2b5ebccb11f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:59.239987 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc820d-1fb1-476b-a7c1-2b5ebccb11f3 None admin] PATH_INFO: `/v3/roles/141a45d0143342f2ac0eafc233c9b6c3` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:59.241448 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc820d-1fb1-476b-a7c1-2b5ebccb11f3 None admin] RBAC: Authorizing `identity:get_role(role_id=141a45d0143342f2ac0eafc233c9b6c3)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:59.242805 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc820d-1fb1-476b-a7c1-2b5ebccb11f3 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:59.244200 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 555/1113] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jun 21 20:09:59 2022] GET /identity/v3/roles/141a45d0143342f2ac0eafc233c9b6c3 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:59.249862 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0da0d0-42f8-4600-81fd-f77449671be7 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:59.345138 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0da0d0-42f8-4600-81fd-f77449671be7 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:59.377877 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac596f9b-c64d-4fc5-b403-d2dcfe9c9dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:59.378750 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac596f9b-c64d-4fc5-b403-d2dcfe9c9dd1 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:59.379037 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac596f9b-c64d-4fc5-b403-d2dcfe9c9dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:59.379314 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac596f9b-c64d-4fc5-b403-d2dcfe9c9dd1 None admin] PATH_INFO: `/v3/users/822a5ba01cbb45d381b444b970d098c6` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:59.391833 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac596f9b-c64d-4fc5-b403-d2dcfe9c9dd1 None admin] RBAC: Authorizing `identity:get_user(user_id=822a5ba01cbb45d381b444b970d098c6)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:59.393286 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac596f9b-c64d-4fc5-b403-d2dcfe9c9dd1 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:59.395404 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 559/1114] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jun 21 20:09:59 2022] GET /identity/v3/users/822a5ba01cbb45d381b444b970d098c6 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:59.401011 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc820d-1fb1-476b-a7c1-2b5ebccb11f3 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:59.497209 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc820d-1fb1-476b-a7c1-2b5ebccb11f3 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:59.530104 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529214c-1cbe-4304-9753-35aa4ba58318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:59.530747 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529214c-1cbe-4304-9753-35aa4ba58318 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:59.531035 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529214c-1cbe-4304-9753-35aa4ba58318 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:59.531315 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529214c-1cbe-4304-9753-35aa4ba58318 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:59.571420 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:59.596058 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529214c-1cbe-4304-9753-35aa4ba58318 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:59.597514 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529214c-1cbe-4304-9753-35aa4ba58318 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:59.692351 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 556/1115] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:09:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 21 20:09:59.698256 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac596f9b-c64d-4fc5-b403-d2dcfe9c9dd1 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:59.739999 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:59.795614 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac596f9b-c64d-4fc5-b403-d2dcfe9c9dd1 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:59.829083 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87536c0b-be82-46d3-a823-8a96a95689cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:59.829930 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87536c0b-be82-46d3-a823-8a96a95689cd None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:59.830219 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87536c0b-be82-46d3-a823-8a96a95689cd None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:59.830502 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87536c0b-be82-46d3-a823-8a96a95689cd None admin] PATH_INFO: `/v3/projects/b5c900d23c744637981e326323ed86f6` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:59.831692 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87536c0b-be82-46d3-a823-8a96a95689cd None admin] RBAC: Authorizing `identity:get_project(project_id=b5c900d23c744637981e326323ed86f6)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:59.833172 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87536c0b-be82-46d3-a823-8a96a95689cd None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:59.834856 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 560/1116] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jun 21 20:09:59 2022] GET /identity/v3/projects/b5c900d23c744637981e326323ed86f6 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:09:59.840877 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529214c-1cbe-4304-9753-35aa4ba58318 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:09:59.912594 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:09:59.937018 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529214c-1cbe-4304-9753-35aa4ba58318 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:09:59.969442 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c45a34-d695-4fe0-8c9b-1586e08911a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:09:59.970084 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c45a34-d695-4fe0-8c9b-1586e08911a6 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:09:59.970366 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c45a34-d695-4fe0-8c9b-1586e08911a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:09:59.970641 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c45a34-d695-4fe0-8c9b-1586e08911a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:09:59.971455 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c45a34-d695-4fe0-8c9b-1586e08911a6 None admin] RBAC: Adding query filter params (role.id=141a45d0143342f2ac0eafc233c9b6c3, scope.project.id=b5c900d23c744637981e326323ed86f6, user.id=822a5ba01cbb45d381b444b970d098c6) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:09:59.971801 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c45a34-d695-4fe0-8c9b-1586e08911a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:09:59.973239 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c45a34-d695-4fe0-8c9b-1586e08911a6 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:09:59.978484 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 557/1117] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jun 21 20:09:59 2022] GET /identity/v3/role_assignments?user.id=822a5ba01cbb45d381b444b970d098c6&scope.project.id=b5c900d23c744637981e326323ed86f6&role.id=141a45d0143342f2ac0eafc233c9b6c3 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:10:01.954737 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dee1b8-6160-4984-b89b-845818c03d88 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:01.955277 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dee1b8-6160-4984-b89b-845818c03d88 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:01.955277 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dee1b8-6160-4984-b89b-845818c03d88 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:01.957302 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 561/1118] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:10:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:10:01.962504 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209d619-c6ba-4f96-8a58-f3842304bb6a None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:01.962950 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209d619-c6ba-4f96-8a58-f3842304bb6a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:01.963061 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209d619-c6ba-4f96-8a58-f3842304bb6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:01.980174 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-7209d619-c6ba-4f96-8a58-f3842304bb6a None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:10:01.981358 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7209d619-c6ba-4f96-8a58-f3842304bb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:10:02.045493 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 558/1119] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:10:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 20:10:02.068391 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dee1b8-6160-4984-b89b-845818c03d88 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:10:02.165758 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dee1b8-6160-4984-b89b-845818c03d88 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:10:02.176551 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:10:02.199438 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95bd5f-dcf0-4966-8256-7f8d5c4f3cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:10:02.200312 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95bd5f-dcf0-4966-8256-7f8d5c4f3cb1 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:02.200594 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95bd5f-dcf0-4966-8256-7f8d5c4f3cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:02.200869 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95bd5f-dcf0-4966-8256-7f8d5c4f3cb1 None admin] PATH_INFO: `/v3/roles/141a45d0143342f2ac0eafc233c9b6c3` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:02.202310 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb95bd5f-dcf0-4966-8256-7f8d5c4f3cb1 None admin] RBAC: Authorizing `identity:get_role(role_id=141a45d0143342f2ac0eafc233c9b6c3)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:10:02.203708 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb95bd5f-dcf0-4966-8256-7f8d5c4f3cb1 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:10:02.205090 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 562/1120] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jun 21 20:10:02 2022] GET /identity/v3/roles/141a45d0143342f2ac0eafc233c9b6c3 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:10:02.211108 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209d619-c6ba-4f96-8a58-f3842304bb6a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:10:02.274075 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:10:02.305538 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209d619-c6ba-4f96-8a58-f3842304bb6a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:10:02.337596 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ed94a-cbdb-4c2b-a647-5e3556b4eeaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:10:02.338446 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ed94a-cbdb-4c2b-a647-5e3556b4eeaa None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:02.338724 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ed94a-cbdb-4c2b-a647-5e3556b4eeaa None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:02.338993 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ed94a-cbdb-4c2b-a647-5e3556b4eeaa None admin] PATH_INFO: `/v3/users/822a5ba01cbb45d381b444b970d098c6` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:02.340178 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ed94a-cbdb-4c2b-a647-5e3556b4eeaa None admin] RBAC: Authorizing `identity:get_user(user_id=822a5ba01cbb45d381b444b970d098c6)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:10:02.341591 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ed94a-cbdb-4c2b-a647-5e3556b4eeaa None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:10:02.343174 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 559/1121] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jun 21 20:10:02 2022] GET /identity/v3/users/822a5ba01cbb45d381b444b970d098c6 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:10:02.348903 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95bd5f-dcf0-4966-8256-7f8d5c4f3cb1 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:10:02.444168 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95bd5f-dcf0-4966-8256-7f8d5c4f3cb1 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:10:02.476348 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66365543-8d8c-4d72-b328-bc7280f1cc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:10:02.477190 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66365543-8d8c-4d72-b328-bc7280f1cc19 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:02.477471 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66365543-8d8c-4d72-b328-bc7280f1cc19 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:02.477746 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66365543-8d8c-4d72-b328-bc7280f1cc19 None admin] PATH_INFO: `/v3/projects/b5c900d23c744637981e326323ed86f6` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:02.478893 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66365543-8d8c-4d72-b328-bc7280f1cc19 None admin] RBAC: Authorizing `identity:get_project(project_id=b5c900d23c744637981e326323ed86f6)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:10:02.480320 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66365543-8d8c-4d72-b328-bc7280f1cc19 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:10:02.481960 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 563/1122] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jun 21 20:10:02 2022] GET /identity/v3/projects/b5c900d23c744637981e326323ed86f6 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:10:02.488617 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ed94a-cbdb-4c2b-a647-5e3556b4eeaa None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:10:02.583537 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ed94a-cbdb-4c2b-a647-5e3556b4eeaa None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:10:02.617045 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de749332-f546-4589-b5a8-34ef30260ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:10:02.617917 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de749332-f546-4589-b5a8-34ef30260ee1 None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:02.618200 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de749332-f546-4589-b5a8-34ef30260ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:02.618477 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de749332-f546-4589-b5a8-34ef30260ee1 None admin] PATH_INFO: `/v3/projects/b5c900d23c744637981e326323ed86f6/users/822a5ba01cbb45d381b444b970d098c6/roles/141a45d0143342f2ac0eafc233c9b6c3` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:02.620672 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de749332-f546-4589-b5a8-34ef30260ee1 None admin] RBAC: Authorizing `identity:create_grant(project_id=b5c900d23c744637981e326323ed86f6, user_id=822a5ba01cbb45d381b444b970d098c6, role_id=141a45d0143342f2ac0eafc233c9b6c3)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:10:02.622081 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de749332-f546-4589-b5a8-34ef30260ee1 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:10:02.625006 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:10:02.635531 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 560/1123] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Jun 21 20:10:02 2022] PUT /identity/v3/projects/b5c900d23c744637981e326323ed86f6/users/822a5ba01cbb45d381b444b970d098c6/roles/141a45d0143342f2ac0eafc233c9b6c3 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:10:04.617825 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41900d-82db-4564-b2b1-73c60effccf6 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:04.618403 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41900d-82db-4564-b2b1-73c60effccf6 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:04.618403 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41900d-82db-4564-b2b1-73c60effccf6 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:04.619996 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 564/1124] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:10:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:10:04.625221 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323dd6c7-5721-449e-83b9-772a9efcc8d0 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:04.625614 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323dd6c7-5721-449e-83b9-772a9efcc8d0 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:04.625863 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323dd6c7-5721-449e-83b9-772a9efcc8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:04.642031 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-323dd6c7-5721-449e-83b9-772a9efcc8d0 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:10:04.643199 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-323dd6c7-5721-449e-83b9-772a9efcc8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:10:04.708173 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 561/1125] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:10:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 20:10:04.731448 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41900d-82db-4564-b2b1-73c60effccf6 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:10:04.778089 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:10:04.829376 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41900d-82db-4564-b2b1-73c60effccf6 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:10:04.862329 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d021630a-bb1c-40f9-92e3-b3ef98d445d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:10:04.863276 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021630a-bb1c-40f9-92e3-b3ef98d445d4 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:04.863562 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021630a-bb1c-40f9-92e3-b3ef98d445d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:04.863836 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021630a-bb1c-40f9-92e3-b3ef98d445d4 None admin] PATH_INFO: `/v3/roles/141a45d0143342f2ac0eafc233c9b6c3` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:04.865311 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d021630a-bb1c-40f9-92e3-b3ef98d445d4 None admin] RBAC: Authorizing `identity:get_role(role_id=141a45d0143342f2ac0eafc233c9b6c3)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:10:04.866666 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d021630a-bb1c-40f9-92e3-b3ef98d445d4 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:10:04.868111 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 565/1126] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jun 21 20:10:04 2022] GET /identity/v3/roles/141a45d0143342f2ac0eafc233c9b6c3 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:10:04.873656 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323dd6c7-5721-449e-83b9-772a9efcc8d0 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:10:04.968408 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323dd6c7-5721-449e-83b9-772a9efcc8d0 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:10:04.992916 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:10:05.001778 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd9d5cb-e9df-4fe2-a9dd-4f10bc1156fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:10:05.002644 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9d5cb-e9df-4fe2-a9dd-4f10bc1156fb None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:05.003419 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9d5cb-e9df-4fe2-a9dd-4f10bc1156fb None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:05.003697 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9d5cb-e9df-4fe2-a9dd-4f10bc1156fb None admin] PATH_INFO: `/v3/users/822a5ba01cbb45d381b444b970d098c6` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:05.004908 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd9d5cb-e9df-4fe2-a9dd-4f10bc1156fb None admin] RBAC: Authorizing `identity:get_user(user_id=822a5ba01cbb45d381b444b970d098c6)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:10:05.006334 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd9d5cb-e9df-4fe2-a9dd-4f10bc1156fb None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:10:05.007980 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 562/1127] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jun 21 20:10:04 2022] GET /identity/v3/users/822a5ba01cbb45d381b444b970d098c6 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:10:05.013471 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d021630a-bb1c-40f9-92e3-b3ef98d445d4 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:10:05.108718 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d021630a-bb1c-40f9-92e3-b3ef98d445d4 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:10:05.122553 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:10:05.142362 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b1a61-814c-4125-b8e1-9d70d8fffb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:10:05.142998 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b1a61-814c-4125-b8e1-9d70d8fffb6d None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:05.143284 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b1a61-814c-4125-b8e1-9d70d8fffb6d None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:05.143609 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b1a61-814c-4125-b8e1-9d70d8fffb6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:05.207636 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b1a61-814c-4125-b8e1-9d70d8fffb6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:10:05.209088 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b1a61-814c-4125-b8e1-9d70d8fffb6d None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:10:05.302451 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 566/1128] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:10:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 20:10:05.308167 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd9d5cb-e9df-4fe2-a9dd-4f10bc1156fb None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:10:05.403898 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd9d5cb-e9df-4fe2-a9dd-4f10bc1156fb None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:10:05.436727 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6244ec14-a300-4a7c-b437-fee81daeeb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:10:05.437577 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244ec14-a300-4a7c-b437-fee81daeeb35 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:05.437862 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244ec14-a300-4a7c-b437-fee81daeeb35 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:05.438142 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244ec14-a300-4a7c-b437-fee81daeeb35 None admin] PATH_INFO: `/v3/projects/b5c900d23c744637981e326323ed86f6` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:05.439308 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6244ec14-a300-4a7c-b437-fee81daeeb35 None admin] RBAC: Authorizing `identity:get_project(project_id=b5c900d23c744637981e326323ed86f6)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:10:05.441366 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6244ec14-a300-4a7c-b437-fee81daeeb35 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:10:05.443044 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 563/1129] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jun 21 20:10:05 2022] GET /identity/v3/projects/b5c900d23c744637981e326323ed86f6 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:10:05.448976 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b1a61-814c-4125-b8e1-9d70d8fffb6d None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:10:05.463346 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:10:05.544361 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b1a61-814c-4125-b8e1-9d70d8fffb6d None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:10:05.577331 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161dd07-69d4-4f18-9ae2-39c54c97d9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:10:05.577966 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161dd07-69d4-4f18-9ae2-39c54c97d9a5 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:05.578250 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161dd07-69d4-4f18-9ae2-39c54c97d9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:05.578524 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161dd07-69d4-4f18-9ae2-39c54c97d9a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:05.579340 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9161dd07-69d4-4f18-9ae2-39c54c97d9a5 None admin] RBAC: Adding query filter params (role.id=141a45d0143342f2ac0eafc233c9b6c3, scope.project.id=b5c900d23c744637981e326323ed86f6, user.id=822a5ba01cbb45d381b444b970d098c6) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:10:05.579650 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9161dd07-69d4-4f18-9ae2-39c54c97d9a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:10:05.581121 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9161dd07-69d4-4f18-9ae2-39c54c97d9a5 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:10:05.586681 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 567/1130] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jun 21 20:10:05 2022] GET /identity/v3/role_assignments?user.id=822a5ba01cbb45d381b444b970d098c6&scope.project.id=b5c900d23c744637981e326323ed86f6&role.id=141a45d0143342f2ac0eafc233c9b6c3 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:10:07.600020 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7a1e4-590a-4eb8-af8c-f3082b1c80f5 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:07.600555 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7a1e4-590a-4eb8-af8c-f3082b1c80f5 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:07.600555 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7a1e4-590a-4eb8-af8c-f3082b1c80f5 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:07.601946 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 564/1131] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:10:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:10:07.606974 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36c005-9984-4c9c-bf77-9f3b13b31463 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:07.607422 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36c005-9984-4c9c-bf77-9f3b13b31463 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:07.607522 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36c005-9984-4c9c-bf77-9f3b13b31463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:07.625712 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-7b36c005-9984-4c9c-bf77-9f3b13b31463 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:10:07.626917 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-7b36c005-9984-4c9c-bf77-9f3b13b31463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:10:07.692370 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 568/1132] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:10:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 20:10:07.715439 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c7a1e4-590a-4eb8-af8c-f3082b1c80f5 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:10:07.776419 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:10:07.815035 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c7a1e4-590a-4eb8-af8c-f3082b1c80f5 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:10:07.847241 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e64c0-a395-4196-9832-aaae750a1d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:10:07.848054 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e64c0-a395-4196-9832-aaae750a1d3f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:07.848340 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e64c0-a395-4196-9832-aaae750a1d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:07.848612 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e64c0-a395-4196-9832-aaae750a1d3f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:07.849755 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1e64c0-a395-4196-9832-aaae750a1d3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:10:07.851217 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1e64c0-a395-4196-9832-aaae750a1d3f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:10:07.852795 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 565/1133] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:10:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:10:07.858697 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36c005-9984-4c9c-bf77-9f3b13b31463 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:10:07.869255 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:10:07.953861 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36c005-9984-4c9c-bf77-9f3b13b31463 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:10:07.986119 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c53e095-cd6a-4781-9691-354351049b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:10:07.986762 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53e095-cd6a-4781-9691-354351049b30 None admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:07.987714 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53e095-cd6a-4781-9691-354351049b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:07.988021 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53e095-cd6a-4781-9691-354351049b30 None admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:07.988723 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c53e095-cd6a-4781-9691-354351049b30 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:10:07.990135 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c53e095-cd6a-4781-9691-354351049b30 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:10:08.014354 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 569/1134] 10.222.0.15 () {60 vars in 1141 bytes} [Tue Jun 21 20:10:07 2022] POST /identity/v3/projects => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:10:10.044969 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89b8ac-1f2f-4515-a389-ba0ea287d6fc None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:10.045509 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89b8ac-1f2f-4515-a389-ba0ea287d6fc None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:10.045509 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89b8ac-1f2f-4515-a389-ba0ea287d6fc None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:10.046865 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 566/1135] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:10:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:10:10.052594 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cbe70d-ed67-4965-add2-e64a07316703 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:10.053013 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cbe70d-ed67-4965-add2-e64a07316703 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:10.053162 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cbe70d-ed67-4965-add2-e64a07316703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:10.069568 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-72cbe70d-ed67-4965-add2-e64a07316703 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:10:10.070752 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-72cbe70d-ed67-4965-add2-e64a07316703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:10:10.125118 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:10:10.137083 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 570/1136] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:10:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 20:10:10.161551 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a89b8ac-1f2f-4515-a389-ba0ea287d6fc None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:10:10.258836 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a89b8ac-1f2f-4515-a389-ba0ea287d6fc None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:10:10.286154 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:10:10.292087 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad32dcef-7102-467f-8cfa-031486417386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:10:10.292868 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32dcef-7102-467f-8cfa-031486417386 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:10.293154 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32dcef-7102-467f-8cfa-031486417386 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:10.293429 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32dcef-7102-467f-8cfa-031486417386 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:10.294588 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad32dcef-7102-467f-8cfa-031486417386 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:10:10.296029 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad32dcef-7102-467f-8cfa-031486417386 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:10:10.297610 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 567/1137] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:10:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:10:10.303661 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cbe70d-ed67-4965-add2-e64a07316703 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:10:10.398827 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cbe70d-ed67-4965-add2-e64a07316703 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:10:10.431482 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84abc852-60d8-4c08-933c-321c7d2c3d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:10:10.432170 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84abc852-60d8-4c08-933c-321c7d2c3d45 None admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:10.432460 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84abc852-60d8-4c08-933c-321c7d2c3d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:10.432741 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84abc852-60d8-4c08-933c-321c7d2c3d45 None admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:10.433463 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84abc852-60d8-4c08-933c-321c7d2c3d45 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:10:10.434882 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84abc852-60d8-4c08-933c-321c7d2c3d45 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:10:10.453770 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 571/1138] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Jun 21 20:10:10 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:10:12.479738 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c0699-cf7f-4bf3-91ca-68e38936a657 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:12.480299 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c0699-cf7f-4bf3-91ca-68e38936a657 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:12.480414 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c0699-cf7f-4bf3-91ca-68e38936a657 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:12.481678 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 568/1139] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:10:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:10:12.486996 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b11a7-19e5-4173-ab33-326b63361574 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:12.487431 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b11a7-19e5-4173-ab33-326b63361574 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:12.487558 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b11a7-19e5-4173-ab33-326b63361574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:12.503882 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-8a5b11a7-19e5-4173-ab33-326b63361574 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:10:12.505584 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-8a5b11a7-19e5-4173-ab33-326b63361574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:10:12.545885 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:10:12.571455 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 572/1140] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:10:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 20:10:12.594268 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c0699-cf7f-4bf3-91ca-68e38936a657 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:10:12.692463 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c0699-cf7f-4bf3-91ca-68e38936a657 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:10:12.724010 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e1be1-e25b-4501-81f9-3e739146294f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:10:12.724785 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e1be1-e25b-4501-81f9-3e739146294f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:12.725069 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e1be1-e25b-4501-81f9-3e739146294f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:12.725343 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e1be1-e25b-4501-81f9-3e739146294f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:12.735253 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e1be1-e25b-4501-81f9-3e739146294f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:10:12.743186 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-9d4e1be1-e25b-4501-81f9-3e739146294f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 20:10:12.743186 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:10:12.743186 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:10:12.743186 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:10:12.743186 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:10:12.743186 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:10:12.743186 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:10:12.743186 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:10:12.743186 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:10:12.743186 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:10:12.743186 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:10:12.743186 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:10:12.743186 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:10:12.743186 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:10:12.743186 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:10:12.743186 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:10:12.744558 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:10:12.744558 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:10:12.744558 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:10:12.744558 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:10:12.744558 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:10:12.744558 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:10:12.744558 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:10:12.744558 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:10:12.744558 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:10:12.744558 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:10:12.744558 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:10:12.744558 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:10:12.744558 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:10:12.744558 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:10:12.744558 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:10:12.744558 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:10:12.745696 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:10:12.745696 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:10:12.745696 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:10:12.745696 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:10:12.745696 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:10:12.745696 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:10:12.745696 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:10:12.745696 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:10:12.745696 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:10:12.745696 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:10:12.745696 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 20:10:12.745696 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:10:12.745696 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 569/1141] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jun 21 20:10:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:10:12.750256 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5b11a7-19e5-4173-ab33-326b63361574 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:10:12.844752 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5b11a7-19e5-4173-ab33-326b63361574 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:10:12.881433 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad9a32-d46b-42ea-acfb-a4d6da4d5aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:10:12.882093 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad9a32-d46b-42ea-acfb-a4d6da4d5aff None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:12.882379 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad9a32-d46b-42ea-acfb-a4d6da4d5aff None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:12.882656 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad9a32-d46b-42ea-acfb-a4d6da4d5aff None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:12.883396 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ad9a32-d46b-42ea-acfb-a4d6da4d5aff None admin] RBAC: Adding query filter params (name=admin) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:10:12.883705 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ad9a32-d46b-42ea-acfb-a4d6da4d5aff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:10:12.885107 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ad9a32-d46b-42ea-acfb-a4d6da4d5aff None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:10:12.892960 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 573/1142] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:10:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:10:12.898621 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e1be1-e25b-4501-81f9-3e739146294f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:10:12.954708 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:10:12.995736 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e1be1-e25b-4501-81f9-3e739146294f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:10:13.027840 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b42c29-1839-4319-9906-20a1e6b47138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:10:13.028733 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b42c29-1839-4319-9906-20a1e6b47138 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:13.029019 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b42c29-1839-4319-9906-20a1e6b47138 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:13.029299 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b42c29-1839-4319-9906-20a1e6b47138 None admin] PATH_INFO: `/v3/users/3dd16a51eb2545c9bf451cf7350ea3a6` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:13.042497 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b42c29-1839-4319-9906-20a1e6b47138 None admin] RBAC: Authorizing `identity:get_user(user_id=3dd16a51eb2545c9bf451cf7350ea3a6)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:10:13.043936 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b42c29-1839-4319-9906-20a1e6b47138 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:10:13.045566 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 570/1143] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jun 21 20:10:12 2022] GET /identity/v3/users/3dd16a51eb2545c9bf451cf7350ea3a6 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:10:13.051779 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad9a32-d46b-42ea-acfb-a4d6da4d5aff None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:10:13.089697 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:10:13.147775 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad9a32-d46b-42ea-acfb-a4d6da4d5aff None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:10:13.180260 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7397917-4668-4c6f-8448-ced5baae342f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:10:13.180890 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7397917-4668-4c6f-8448-ced5baae342f None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:13.181176 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7397917-4668-4c6f-8448-ced5baae342f None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:13.181453 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7397917-4668-4c6f-8448-ced5baae342f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:13.245442 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7397917-4668-4c6f-8448-ced5baae342f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:10:13.246912 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7397917-4668-4c6f-8448-ced5baae342f None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:10:13.282798 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:10:13.340904 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 574/1144] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:10:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 20:10:13.346626 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b42c29-1839-4319-9906-20a1e6b47138 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:10:13.441842 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b42c29-1839-4319-9906-20a1e6b47138 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:10:13.457946 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:10:13.475948 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff85b5e-3e14-4173-8984-ebe18dfc5d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:10:13.476799 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff85b5e-3e14-4173-8984-ebe18dfc5d37 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:13.477089 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff85b5e-3e14-4173-8984-ebe18dfc5d37 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:13.477373 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff85b5e-3e14-4173-8984-ebe18dfc5d37 None admin] PATH_INFO: `/v3/projects/7b593556bdf24a4da06182e8b9616841` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:13.478548 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff85b5e-3e14-4173-8984-ebe18dfc5d37 None admin] RBAC: Authorizing `identity:get_project(project_id=7b593556bdf24a4da06182e8b9616841)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:10:13.480009 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff85b5e-3e14-4173-8984-ebe18dfc5d37 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:10:13.481722 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 571/1145] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jun 21 20:10:13 2022] GET /identity/v3/projects/7b593556bdf24a4da06182e8b9616841 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:10:13.487946 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7397917-4668-4c6f-8448-ced5baae342f None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:10:13.583461 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7397917-4668-4c6f-8448-ced5baae342f None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:10:13.616055 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62f5b5-670e-47ec-bc77-658ee2b04b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:10:13.616696 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62f5b5-670e-47ec-bc77-658ee2b04b18 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:13.616978 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62f5b5-670e-47ec-bc77-658ee2b04b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:13.617254 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62f5b5-670e-47ec-bc77-658ee2b04b18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:13.618075 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf62f5b5-670e-47ec-bc77-658ee2b04b18 None admin] RBAC: Adding query filter params (role.id=1f5332f48d9e4c2aac866d0d546c94d5, scope.project.id=7b593556bdf24a4da06182e8b9616841, user.id=3dd16a51eb2545c9bf451cf7350ea3a6) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:10:13.618386 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf62f5b5-670e-47ec-bc77-658ee2b04b18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:10:13.619792 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf62f5b5-670e-47ec-bc77-658ee2b04b18 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:10:13.625100 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 575/1146] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jun 21 20:10:13 2022] GET /identity/v3/role_assignments?user.id=3dd16a51eb2545c9bf451cf7350ea3a6&scope.project.id=7b593556bdf24a4da06182e8b9616841&role.id=1f5332f48d9e4c2aac866d0d546c94d5 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:10:15.616632 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad33600-c467-4cd8-b8fc-c270f75fde6d None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:15.617196 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad33600-c467-4cd8-b8fc-c270f75fde6d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:15.617196 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad33600-c467-4cd8-b8fc-c270f75fde6d None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:15.618530 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 572/1147] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:10:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:10:15.623704 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b47e1-85e2-400c-af23-2e4d08ce513c None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:15.624164 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b47e1-85e2-400c-af23-2e4d08ce513c None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:15.624273 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b47e1-85e2-400c-af23-2e4d08ce513c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:15.629826 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:10:15.642144 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-bb7b47e1-85e2-400c-af23-2e4d08ce513c None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:10:15.643312 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-bb7b47e1-85e2-400c-af23-2e4d08ce513c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:10:15.706714 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 576/1148] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:10:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 20:10:15.728755 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad33600-c467-4cd8-b8fc-c270f75fde6d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:10:15.826524 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad33600-c467-4cd8-b8fc-c270f75fde6d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:10:15.859243 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f053b1-514c-4f9d-8148-cf759011a9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:10:15.860049 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f053b1-514c-4f9d-8148-cf759011a9c1 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:15.860330 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f053b1-514c-4f9d-8148-cf759011a9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:15.860603 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f053b1-514c-4f9d-8148-cf759011a9c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:15.870834 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f053b1-514c-4f9d-8148-cf759011a9c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:10:15.878165 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-f1f053b1-514c-4f9d-8148-cf759011a9c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 20:10:15.878165 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:10:15.878165 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:10:15.878165 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:10:15.878165 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:10:15.878165 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:10:15.878165 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:10:15.878165 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:10:15.878165 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:10:15.878165 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:10:15.878165 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:10:15.878165 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:10:15.878165 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:10:15.878165 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:10:15.878165 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:10:15.878165 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:10:15.880695 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:10:15.880695 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:10:15.880695 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:10:15.880695 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:10:15.880695 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:10:15.880695 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:10:15.880695 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:10:15.880695 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:10:15.880695 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:10:15.880695 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:10:15.880695 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:10:15.880695 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:10:15.880695 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:10:15.880695 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:10:15.880695 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:10:15.880695 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:10:15.881946 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:10:15.881946 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:10:15.881946 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:10:15.881946 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:10:15.881946 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:10:15.881946 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:10:15.881946 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:10:15.881946 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:10:15.881946 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:10:15.881946 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:10:15.881946 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 20:10:15.881946 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:10:15.881946 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 573/1149] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jun 21 20:10:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:10:15.885929 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7b47e1-85e2-400c-af23-2e4d08ce513c None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:10:15.981627 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7b47e1-85e2-400c-af23-2e4d08ce513c None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:10:16.009885 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:10:16.014958 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32c644-4cf0-4698-8bc8-e0ba8b706e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:10:16.015611 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32c644-4cf0-4698-8bc8-e0ba8b706e86 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:16.015895 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32c644-4cf0-4698-8bc8-e0ba8b706e86 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:16.016203 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32c644-4cf0-4698-8bc8-e0ba8b706e86 None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:16.016944 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32c644-4cf0-4698-8bc8-e0ba8b706e86 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:10:16.017250 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32c644-4cf0-4698-8bc8-e0ba8b706e86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:10:16.018624 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32c644-4cf0-4698-8bc8-e0ba8b706e86 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:10:16.026488 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 577/1150] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:10:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:10:16.032087 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f053b1-514c-4f9d-8148-cf759011a9c1 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:10:16.076632 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:10:16.129643 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f053b1-514c-4f9d-8148-cf759011a9c1 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:10:16.161576 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1399c2bd-7731-4d66-b9e7-ddb3cea4f217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:10:16.162432 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399c2bd-7731-4d66-b9e7-ddb3cea4f217 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:16.162716 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399c2bd-7731-4d66-b9e7-ddb3cea4f217 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:16.162995 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399c2bd-7731-4d66-b9e7-ddb3cea4f217 None admin] PATH_INFO: `/v3/users/3dd16a51eb2545c9bf451cf7350ea3a6` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:16.164197 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1399c2bd-7731-4d66-b9e7-ddb3cea4f217 None admin] RBAC: Authorizing `identity:get_user(user_id=3dd16a51eb2545c9bf451cf7350ea3a6)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:10:16.165615 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1399c2bd-7731-4d66-b9e7-ddb3cea4f217 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:10:16.167206 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 574/1151] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jun 21 20:10:16 2022] GET /identity/v3/users/3dd16a51eb2545c9bf451cf7350ea3a6 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:10:16.172746 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32c644-4cf0-4698-8bc8-e0ba8b706e86 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:10:16.268839 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32c644-4cf0-4698-8bc8-e0ba8b706e86 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:10:16.301313 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2e1e83-b414-4180-8aab-a4cdd308cffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:10:16.302160 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e1e83-b414-4180-8aab-a4cdd308cffb None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:16.302443 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e1e83-b414-4180-8aab-a4cdd308cffb None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:16.302717 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e1e83-b414-4180-8aab-a4cdd308cffb None admin] PATH_INFO: `/v3/projects/7b593556bdf24a4da06182e8b9616841` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:16.303880 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2e1e83-b414-4180-8aab-a4cdd308cffb None admin] RBAC: Authorizing `identity:get_project(project_id=7b593556bdf24a4da06182e8b9616841)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:10:16.305440 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2e1e83-b414-4180-8aab-a4cdd308cffb None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:10:16.307099 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 578/1152] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jun 21 20:10:16 2022] GET /identity/v3/projects/7b593556bdf24a4da06182e8b9616841 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:10:16.312668 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1399c2bd-7731-4d66-b9e7-ddb3cea4f217 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:10:16.409480 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1399c2bd-7731-4d66-b9e7-ddb3cea4f217 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:10:16.422331 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:10:16.443049 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f8c656-c9c5-42d8-88bb-b7f8ae29a57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:10:16.443938 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8c656-c9c5-42d8-88bb-b7f8ae29a57a None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:16.444234 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8c656-c9c5-42d8-88bb-b7f8ae29a57a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:16.444509 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8c656-c9c5-42d8-88bb-b7f8ae29a57a None admin] PATH_INFO: `/v3/projects/7b593556bdf24a4da06182e8b9616841/users/3dd16a51eb2545c9bf451cf7350ea3a6/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:16.446443 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f8c656-c9c5-42d8-88bb-b7f8ae29a57a None admin] RBAC: Authorizing `identity:create_grant(project_id=7b593556bdf24a4da06182e8b9616841, user_id=3dd16a51eb2545c9bf451cf7350ea3a6, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:10:16.447849 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f8c656-c9c5-42d8-88bb-b7f8ae29a57a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:10:16.465965 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 575/1153] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Jun 21 20:10:16 2022] PUT /identity/v3/projects/7b593556bdf24a4da06182e8b9616841/users/3dd16a51eb2545c9bf451cf7350ea3a6/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:10:18.457581 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99cefa-2ec9-4d76-99a8-ecd31aa382b4 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:18.458112 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99cefa-2ec9-4d76-99a8-ecd31aa382b4 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:18.458112 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99cefa-2ec9-4d76-99a8-ecd31aa382b4 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:18.459494 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 579/1154] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:10:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:10:18.464679 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09807099-2002-4038-9994-6c04cf407860 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:18.465119 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09807099-2002-4038-9994-6c04cf407860 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:18.465253 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09807099-2002-4038-9994-6c04cf407860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:18.482165 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-09807099-2002-4038-9994-6c04cf407860 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:10:18.483611 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-09807099-2002-4038-9994-6c04cf407860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:10:18.548777 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 576/1155] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:10:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 20:10:18.572038 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af99cefa-2ec9-4d76-99a8-ecd31aa382b4 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:10:18.632088 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:10:18.671076 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af99cefa-2ec9-4d76-99a8-ecd31aa382b4 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:10:18.702221 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bffe699-3b0f-4d83-b7e2-80e998e5dd65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:10:18.702993 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bffe699-3b0f-4d83-b7e2-80e998e5dd65 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:18.703277 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bffe699-3b0f-4d83-b7e2-80e998e5dd65 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:18.703553 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bffe699-3b0f-4d83-b7e2-80e998e5dd65 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:18.714135 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bffe699-3b0f-4d83-b7e2-80e998e5dd65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:10:18.721477 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-4bffe699-3b0f-4d83-b7e2-80e998e5dd65 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 20:10:18.721477 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:10:18.721477 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:10:18.721477 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:10:18.721477 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:10:18.721477 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:10:18.721477 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:10:18.721477 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:10:18.721477 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:10:18.721477 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:10:18.721477 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:10:18.721477 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:10:18.721477 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:10:18.721477 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:10:18.721477 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:10:18.721477 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:10:18.722387 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:10:18.722387 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:10:18.722387 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:10:18.722387 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:10:18.722387 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:10:18.722387 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:10:18.722387 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:10:18.722387 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:10:18.722387 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:10:18.722387 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:10:18.722387 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:10:18.722387 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:10:18.722387 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:10:18.722387 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:10:18.722387 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:10:18.722387 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:10:18.723839 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:10:18.723839 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:10:18.723839 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:10:18.723839 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:10:18.723839 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:10:18.723839 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:10:18.723839 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:10:18.723839 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:10:18.723839 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:10:18.723839 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:10:18.723839 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 20:10:18.723839 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:10:18.723839 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 580/1156] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jun 21 20:10:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:10:18.729092 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09807099-2002-4038-9994-6c04cf407860 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:10:18.823928 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09807099-2002-4038-9994-6c04cf407860 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:10:18.825421 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:10:18.859777 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07785e3c-0772-457a-8418-e28f5c228a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:10:18.860481 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07785e3c-0772-457a-8418-e28f5c228a8f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:18.860770 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07785e3c-0772-457a-8418-e28f5c228a8f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:18.861051 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07785e3c-0772-457a-8418-e28f5c228a8f None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:18.861796 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07785e3c-0772-457a-8418-e28f5c228a8f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:10:18.862108 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07785e3c-0772-457a-8418-e28f5c228a8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:10:18.863477 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07785e3c-0772-457a-8418-e28f5c228a8f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:10:18.871358 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 577/1157] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:10:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:10:18.876965 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bffe699-3b0f-4d83-b7e2-80e998e5dd65 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:10:18.972049 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bffe699-3b0f-4d83-b7e2-80e998e5dd65 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:10:18.993462 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:10:19.005132 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93369e8-98ca-4cba-9ce0-58396fed2e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:10:19.005987 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93369e8-98ca-4cba-9ce0-58396fed2e01 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:19.006271 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93369e8-98ca-4cba-9ce0-58396fed2e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:19.006548 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93369e8-98ca-4cba-9ce0-58396fed2e01 None admin] PATH_INFO: `/v3/users/3dd16a51eb2545c9bf451cf7350ea3a6` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:19.007706 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93369e8-98ca-4cba-9ce0-58396fed2e01 None admin] RBAC: Authorizing `identity:get_user(user_id=3dd16a51eb2545c9bf451cf7350ea3a6)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:10:19.009150 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93369e8-98ca-4cba-9ce0-58396fed2e01 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:10:19.010738 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 581/1158] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jun 21 20:10:18 2022] GET /identity/v3/users/3dd16a51eb2545c9bf451cf7350ea3a6 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:10:19.016487 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07785e3c-0772-457a-8418-e28f5c228a8f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:10:19.112529 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07785e3c-0772-457a-8418-e28f5c228a8f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:10:19.145481 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908fe831-6388-4eb4-bbd5-f9f54dc41dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:10:19.146115 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908fe831-6388-4eb4-bbd5-f9f54dc41dee None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:19.146399 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908fe831-6388-4eb4-bbd5-f9f54dc41dee None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:19.146677 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908fe831-6388-4eb4-bbd5-f9f54dc41dee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:19.175587 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:10:19.211334 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908fe831-6388-4eb4-bbd5-f9f54dc41dee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:10:19.212800 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908fe831-6388-4eb4-bbd5-f9f54dc41dee None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:10:19.306858 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 578/1159] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:10:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 20:10:19.312593 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93369e8-98ca-4cba-9ce0-58396fed2e01 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:10:19.407769 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93369e8-98ca-4cba-9ce0-58396fed2e01 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:10:19.439875 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37151e9e-74f6-433c-90ad-a957dd40c055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:10:19.440741 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37151e9e-74f6-433c-90ad-a957dd40c055 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:19.441026 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37151e9e-74f6-433c-90ad-a957dd40c055 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:19.441296 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37151e9e-74f6-433c-90ad-a957dd40c055 None admin] PATH_INFO: `/v3/projects/7b593556bdf24a4da06182e8b9616841` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:19.443000 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37151e9e-74f6-433c-90ad-a957dd40c055 None admin] RBAC: Authorizing `identity:get_project(project_id=7b593556bdf24a4da06182e8b9616841)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:10:19.444438 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37151e9e-74f6-433c-90ad-a957dd40c055 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:10:19.446078 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 582/1160] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jun 21 20:10:19 2022] GET /identity/v3/projects/7b593556bdf24a4da06182e8b9616841 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:10:19.451831 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908fe831-6388-4eb4-bbd5-f9f54dc41dee None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:10:19.511260 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:10:19.547199 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908fe831-6388-4eb4-bbd5-f9f54dc41dee None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:10:19.580530 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfdbb9f-dd6d-4feb-83ad-ffd4158913c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:10:19.581119 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfdbb9f-dd6d-4feb-83ad-ffd4158913c5 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:19.581404 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfdbb9f-dd6d-4feb-83ad-ffd4158913c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:19.581685 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfdbb9f-dd6d-4feb-83ad-ffd4158913c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:19.582547 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfdbb9f-dd6d-4feb-83ad-ffd4158913c5 None admin] RBAC: Adding query filter params (role.id=1f5332f48d9e4c2aac866d0d546c94d5, scope.project.id=7b593556bdf24a4da06182e8b9616841, user.id=3dd16a51eb2545c9bf451cf7350ea3a6) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:10:19.582862 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfdbb9f-dd6d-4feb-83ad-ffd4158913c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:10:19.584304 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfdbb9f-dd6d-4feb-83ad-ffd4158913c5 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:10:19.589941 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 579/1161] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jun 21 20:10:19 2022] GET /identity/v3/role_assignments?user.id=3dd16a51eb2545c9bf451cf7350ea3a6&scope.project.id=7b593556bdf24a4da06182e8b9616841&role.id=1f5332f48d9e4c2aac866d0d546c94d5 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:10:21.606247 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848bdf8-6e32-414e-80ee-c9f8f18d9b81 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:21.606820 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848bdf8-6e32-414e-80ee-c9f8f18d9b81 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:21.606820 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848bdf8-6e32-414e-80ee-c9f8f18d9b81 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:21.608449 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 583/1162] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:10:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:10:21.613578 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f0112-113f-4a46-9048-bacd80820f2e None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:21.613999 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f0112-113f-4a46-9048-bacd80820f2e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:21.614136 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f0112-113f-4a46-9048-bacd80820f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:21.630399 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c37f0112-113f-4a46-9048-bacd80820f2e None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:10:21.631561 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c37f0112-113f-4a46-9048-bacd80820f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:10:21.695452 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 580/1163] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:10:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 20:10:21.717761 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b848bdf8-6e32-414e-80ee-c9f8f18d9b81 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:10:21.775076 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:10:21.815850 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b848bdf8-6e32-414e-80ee-c9f8f18d9b81 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:10:21.849414 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f892063-1111-4df1-8eb4-7ee0cef21969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:10:21.850059 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f892063-1111-4df1-8eb4-7ee0cef21969 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:21.850345 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f892063-1111-4df1-8eb4-7ee0cef21969 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:21.850625 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f892063-1111-4df1-8eb4-7ee0cef21969 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:21.915229 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f892063-1111-4df1-8eb4-7ee0cef21969 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:10:21.916700 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f892063-1111-4df1-8eb4-7ee0cef21969 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:10:21.971195 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:10:22.012230 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 584/1164] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:10:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 20:10:22.018168 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f0112-113f-4a46-9048-bacd80820f2e None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:10:22.073906 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:10:22.114241 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f0112-113f-4a46-9048-bacd80820f2e None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:10:22.147364 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b839c2d-574c-43aa-97c9-892eeb9a617b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:10:22.148189 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b839c2d-574c-43aa-97c9-892eeb9a617b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:22.148476 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b839c2d-574c-43aa-97c9-892eeb9a617b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:22.148753 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b839c2d-574c-43aa-97c9-892eeb9a617b None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:22.155215 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b839c2d-574c-43aa-97c9-892eeb9a617b None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:10:22.156671 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b839c2d-574c-43aa-97c9-892eeb9a617b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:10:22.170489 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-9b839c2d-574c-43aa-97c9-892eeb9a617b None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 21 20:10:22.170489 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:10:22.170489 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 21 20:10:22.170489 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 21 20:10:22.170489 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 20:10:22.170489 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 20:10:22.170489 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 20:10:22.170489 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 20:10:22.170489 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 21 20:10:22.170489 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:10:22.170489 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 20:10:22.170489 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:10:22.170489 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:10:22.170489 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:10:22.170489 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:10:22.170489 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:10:22.170489 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:10:22.171671 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:10:22.171671 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:10:22.171671 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:10:22.171671 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:10:22.171671 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:10:22.171671 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:10:22.171671 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:10:22.171671 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:10:22.171671 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:10:22.171671 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:10:22.171671 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:10:22.171671 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:10:22.171671 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:10:22.171671 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:10:22.171671 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:10:22.171671 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:10:22.172931 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:10:22.172931 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:10:22.172931 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:10:22.172931 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:10:22.172931 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:10:22.172931 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:10:22.172931 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:10:22.172931 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:10:22.172931 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:10:22.172931 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:10:22.172931 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 21 20:10:22.172931 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:10:22.172931 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 21 20:10:22.172931 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:10:22.172931 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 581/1165] 10.222.0.15 () {56 vars in 1117 bytes} [Tue Jun 21 20:10:22 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:10:22.177425 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f892063-1111-4df1-8eb4-7ee0cef21969 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:10:22.272764 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f892063-1111-4df1-8eb4-7ee0cef21969 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:10:22.305208 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e07e8b-19b8-4c93-9644-aa12beb92784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:10:22.305854 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e07e8b-19b8-4c93-9644-aa12beb92784 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:22.306140 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e07e8b-19b8-4c93-9644-aa12beb92784 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:22.306423 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e07e8b-19b8-4c93-9644-aa12beb92784 None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:22.307140 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e07e8b-19b8-4c93-9644-aa12beb92784 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:10:22.307449 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e07e8b-19b8-4c93-9644-aa12beb92784 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:10:22.308823 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e07e8b-19b8-4c93-9644-aa12beb92784 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:10:22.315672 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 585/1166] 10.222.0.15 () {56 vars in 1115 bytes} [Tue Jun 21 20:10:22 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:10:24.311139 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713d9f5-b112-4e8e-bc58-830b9b1792db None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:24.311667 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713d9f5-b112-4e8e-bc58-830b9b1792db None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:24.311667 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713d9f5-b112-4e8e-bc58-830b9b1792db None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:24.313090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 582/1167] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:10:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:10:24.318922 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89c38b-2664-4ec6-8788-862739693880 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:24.319348 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89c38b-2664-4ec6-8788-862739693880 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:24.319488 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89c38b-2664-4ec6-8788-862739693880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:24.336431 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-5d89c38b-2664-4ec6-8788-862739693880 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:10:24.337622 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-5d89c38b-2664-4ec6-8788-862739693880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:10:24.353495 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:10:24.402096 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 586/1168] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:10:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 20:10:24.424812 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713d9f5-b112-4e8e-bc58-830b9b1792db None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:10:24.524171 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713d9f5-b112-4e8e-bc58-830b9b1792db None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:10:24.540228 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:10:24.556898 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee8585-16fb-4af0-a261-8d6a7a692531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:10:24.557549 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee8585-16fb-4af0-a261-8d6a7a692531 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:24.557834 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee8585-16fb-4af0-a261-8d6a7a692531 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:24.558111 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee8585-16fb-4af0-a261-8d6a7a692531 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:24.558850 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ee8585-16fb-4af0-a261-8d6a7a692531 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:10:24.560223 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ee8585-16fb-4af0-a261-8d6a7a692531 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:10:24.574259 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 583/1169] 10.222.0.15 () {60 vars in 1138 bytes} [Tue Jun 21 20:10:24 2022] POST /identity/v3/domains => generated 267 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:10:26.585550 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c845b1-b58e-416c-be9d-bfe8876ba4ce None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:26.586112 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c845b1-b58e-416c-be9d-bfe8876ba4ce None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:26.586112 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c845b1-b58e-416c-be9d-bfe8876ba4ce None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:26.587503 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 587/1170] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:10:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:10:26.592762 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f047db-0230-4aad-9e71-5aed5b00fbc5 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:26.593195 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f047db-0230-4aad-9e71-5aed5b00fbc5 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:26.593316 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f047db-0230-4aad-9e71-5aed5b00fbc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:26.610408 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-23f047db-0230-4aad-9e71-5aed5b00fbc5 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:10:26.611594 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-23f047db-0230-4aad-9e71-5aed5b00fbc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:10:26.675601 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 584/1171] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:10:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 20:10:26.699719 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c845b1-b58e-416c-be9d-bfe8876ba4ce None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:10:26.799359 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c845b1-b58e-416c-be9d-bfe8876ba4ce None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:10:26.831332 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ed80a-61c9-4cd7-bc91-1c05284976eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:10:26.832714 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ed80a-61c9-4cd7-bc91-1c05284976eb None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:26.833000 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ed80a-61c9-4cd7-bc91-1c05284976eb None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:26.833277 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ed80a-61c9-4cd7-bc91-1c05284976eb None admin] PATH_INFO: `/v3/domains/e575a60a2dd3412d807351be671e287e` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:26.843574 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381ed80a-61c9-4cd7-bc91-1c05284976eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=e575a60a2dd3412d807351be671e287e)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:10:26.844988 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381ed80a-61c9-4cd7-bc91-1c05284976eb None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:10:26.846634 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 588/1172] 10.222.0.15 () {56 vars in 1183 bytes} [Tue Jun 21 20:10:26 2022] GET /identity/v3/domains/e575a60a2dd3412d807351be671e287e => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:10:26.852932 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f047db-0230-4aad-9e71-5aed5b00fbc5 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:10:26.949677 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f047db-0230-4aad-9e71-5aed5b00fbc5 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:10:26.959014 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:10:26.985021 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893dd819-fba5-41fe-8c3c-5092acc10eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:10:26.985676 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893dd819-fba5-41fe-8c3c-5092acc10eca None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:26.985967 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893dd819-fba5-41fe-8c3c-5092acc10eca None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:26.986250 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893dd819-fba5-41fe-8c3c-5092acc10eca None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:26.986970 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893dd819-fba5-41fe-8c3c-5092acc10eca None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:10:26.988523 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893dd819-fba5-41fe-8c3c-5092acc10eca None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:10:27.011795 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 585/1173] 10.222.0.15 () {60 vars in 1141 bytes} [Tue Jun 21 20:10:26 2022] POST /identity/v3/projects => generated 361 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:10:29.038914 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a39327-1967-451a-ba31-4520d81ac319 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:29.039432 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a39327-1967-451a-ba31-4520d81ac319 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:29.039518 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a39327-1967-451a-ba31-4520d81ac319 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:29.040898 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 589/1174] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:10:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:10:29.046054 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e26546-6271-4ff2-a4ed-ad88a00f0f76 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:29.046461 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e26546-6271-4ff2-a4ed-ad88a00f0f76 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:29.046625 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e26546-6271-4ff2-a4ed-ad88a00f0f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:29.063471 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-29e26546-6271-4ff2-a4ed-ad88a00f0f76 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:10:29.064689 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-29e26546-6271-4ff2-a4ed-ad88a00f0f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:10:29.128548 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 586/1175] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:10:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 20:10:29.152924 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a39327-1967-451a-ba31-4520d81ac319 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:10:29.167619 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:10:29.251012 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a39327-1967-451a-ba31-4520d81ac319 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:10:29.282840 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f12dc7-a276-4c53-ac8d-1c2c99c5f75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:10:29.283679 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f12dc7-a276-4c53-ac8d-1c2c99c5f75e None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:29.283984 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f12dc7-a276-4c53-ac8d-1c2c99c5f75e None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:29.284264 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f12dc7-a276-4c53-ac8d-1c2c99c5f75e None admin] PATH_INFO: `/v3/domains/e575a60a2dd3412d807351be671e287e` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:29.285405 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f12dc7-a276-4c53-ac8d-1c2c99c5f75e None admin] RBAC: Authorizing `identity:get_domain(domain_id=e575a60a2dd3412d807351be671e287e)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:10:29.286813 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f12dc7-a276-4c53-ac8d-1c2c99c5f75e None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:10:29.288426 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 590/1176] 10.222.0.15 () {56 vars in 1183 bytes} [Tue Jun 21 20:10:29 2022] GET /identity/v3/domains/e575a60a2dd3412d807351be671e287e => generated 267 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:10:29.293892 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e26546-6271-4ff2-a4ed-ad88a00f0f76 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:10:29.380387 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:10:29.390707 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e26546-6271-4ff2-a4ed-ad88a00f0f76 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:10:29.422874 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30658bd4-492f-4d56-8d8c-b8cc9873719c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:10:29.423531 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30658bd4-492f-4d56-8d8c-b8cc9873719c None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:29.423815 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30658bd4-492f-4d56-8d8c-b8cc9873719c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:29.424118 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30658bd4-492f-4d56-8d8c-b8cc9873719c None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:29.424813 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30658bd4-492f-4d56-8d8c-b8cc9873719c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:10:29.426831 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30658bd4-492f-4d56-8d8c-b8cc9873719c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:10:29.444986 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 587/1177] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Jun 21 20:10:29 2022] POST /identity/v3/users => generated 311 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:10:31.542517 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8995ae8-c92c-4c40-9260-559225b84642 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:31.543052 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8995ae8-c92c-4c40-9260-559225b84642 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:31.543174 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8995ae8-c92c-4c40-9260-559225b84642 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:31.544502 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 591/1178] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:10:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:10:31.549832 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e3808-fb1c-479d-9ff7-a885721234ee None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:31.550212 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e3808-fb1c-479d-9ff7-a885721234ee None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:31.550886 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e3808-fb1c-479d-9ff7-a885721234ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:31.567863 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-2a6e3808-fb1c-479d-9ff7-a885721234ee None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:10:31.569081 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2a6e3808-fb1c-479d-9ff7-a885721234ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:10:31.634745 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 588/1179] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:10:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 20:10:31.658371 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8995ae8-c92c-4c40-9260-559225b84642 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:10:31.736787 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:10:31.756618 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8995ae8-c92c-4c40-9260-559225b84642 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:10:31.788384 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2e0ef-32d4-4c28-b6d3-06b9b3ad5d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:10:31.789158 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2e0ef-32d4-4c28-b6d3-06b9b3ad5d97 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:31.789441 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2e0ef-32d4-4c28-b6d3-06b9b3ad5d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:31.789714 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2e0ef-32d4-4c28-b6d3-06b9b3ad5d97 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:31.801048 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d2e0ef-32d4-4c28-b6d3-06b9b3ad5d97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:10:31.808356 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-23d2e0ef-32d4-4c28-b6d3-06b9b3ad5d97 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 20:10:31.808356 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:10:31.808356 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:10:31.808356 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:10:31.808356 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:10:31.808356 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:10:31.808356 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:10:31.808356 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:10:31.808356 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:10:31.808356 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:10:31.808356 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:10:31.808356 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:10:31.808356 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:10:31.808356 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:10:31.808356 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:10:31.808356 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:10:31.809421 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:10:31.809421 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:10:31.809421 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:10:31.809421 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:10:31.809421 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:10:31.809421 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:10:31.809421 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:10:31.809421 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:10:31.809421 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:10:31.809421 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:10:31.809421 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:10:31.809421 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:10:31.809421 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:10:31.809421 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:10:31.809421 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:10:31.809421 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:10:31.810464 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:10:31.810464 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:10:31.810464 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:10:31.810464 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:10:31.810464 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:10:31.810464 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:10:31.810464 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:10:31.810464 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:10:31.810464 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:10:31.810464 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:10:31.810464 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 20:10:31.810464 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:10:31.810464 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 592/1180] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jun 21 20:10:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:10:31.815279 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e3808-fb1c-479d-9ff7-a885721234ee None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:10:31.888467 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:10:31.911347 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e3808-fb1c-479d-9ff7-a885721234ee None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:10:31.945805 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac8b9a-941f-4160-b92a-d1d71ed619f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:10:31.946470 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac8b9a-941f-4160-b92a-d1d71ed619f0 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:31.946758 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac8b9a-941f-4160-b92a-d1d71ed619f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:31.947037 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac8b9a-941f-4160-b92a-d1d71ed619f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:31.947780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ac8b9a-941f-4160-b92a-d1d71ed619f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:10:31.948120 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ac8b9a-941f-4160-b92a-d1d71ed619f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:10:31.949477 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ac8b9a-941f-4160-b92a-d1d71ed619f0 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:10:31.957236 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 589/1181] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:10:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:10:31.962906 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2e0ef-32d4-4c28-b6d3-06b9b3ad5d97 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:10:32.059014 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2e0ef-32d4-4c28-b6d3-06b9b3ad5d97 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:10:32.091569 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfacd5a-ee46-42e9-bd77-5a31f1f50d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:10:32.092453 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfacd5a-ee46-42e9-bd77-5a31f1f50d86 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:32.092737 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfacd5a-ee46-42e9-bd77-5a31f1f50d86 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:32.093010 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfacd5a-ee46-42e9-bd77-5a31f1f50d86 None admin] PATH_INFO: `/v3/users/ab0111440fba409182aed28c841b75e3` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:32.102875 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:10:32.106374 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfacd5a-ee46-42e9-bd77-5a31f1f50d86 None admin] RBAC: Authorizing `identity:get_user(user_id=ab0111440fba409182aed28c841b75e3)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:10:32.108325 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfacd5a-ee46-42e9-bd77-5a31f1f50d86 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:10:32.110131 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 593/1182] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jun 21 20:10:31 2022] GET /identity/v3/users/ab0111440fba409182aed28c841b75e3 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:10:32.116369 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac8b9a-941f-4160-b92a-d1d71ed619f0 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:10:32.212429 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac8b9a-941f-4160-b92a-d1d71ed619f0 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:10:32.245066 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1f0e3-48d7-4534-ab19-f140789351eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:10:32.245712 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1f0e3-48d7-4534-ab19-f140789351eb None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:32.246017 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1f0e3-48d7-4534-ab19-f140789351eb None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:32.246285 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1f0e3-48d7-4534-ab19-f140789351eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:32.255100 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:10:32.312375 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa1f0e3-48d7-4534-ab19-f140789351eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:10:32.313785 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa1f0e3-48d7-4534-ab19-f140789351eb None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:10:32.408617 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 590/1183] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:10:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 20:10:32.414314 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfacd5a-ee46-42e9-bd77-5a31f1f50d86 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:10:32.510573 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfacd5a-ee46-42e9-bd77-5a31f1f50d86 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:10:32.543279 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c7a575-9bfa-4b44-88e1-f9e94c0e12f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:10:32.544149 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7a575-9bfa-4b44-88e1-f9e94c0e12f3 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:32.544436 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7a575-9bfa-4b44-88e1-f9e94c0e12f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:32.544715 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7a575-9bfa-4b44-88e1-f9e94c0e12f3 None admin] PATH_INFO: `/v3/projects/6476c598c786412183102f9d5c51d61f` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:32.545885 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c7a575-9bfa-4b44-88e1-f9e94c0e12f3 None admin] RBAC: Authorizing `identity:get_project(project_id=6476c598c786412183102f9d5c51d61f)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:10:32.547295 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c7a575-9bfa-4b44-88e1-f9e94c0e12f3 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:10:32.548991 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 594/1184] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jun 21 20:10:32 2022] GET /identity/v3/projects/6476c598c786412183102f9d5c51d61f => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:10:32.554847 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1f0e3-48d7-4534-ab19-f140789351eb None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:10:32.593582 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:10:32.652055 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1f0e3-48d7-4534-ab19-f140789351eb None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:10:32.684483 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc31b7-aaa5-40f8-95fd-716a07c6fe67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:10:32.685130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc31b7-aaa5-40f8-95fd-716a07c6fe67 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:32.685417 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc31b7-aaa5-40f8-95fd-716a07c6fe67 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:32.685696 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc31b7-aaa5-40f8-95fd-716a07c6fe67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:32.686529 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcc31b7-aaa5-40f8-95fd-716a07c6fe67 None admin] RBAC: Adding query filter params (role.id=1f5332f48d9e4c2aac866d0d546c94d5, scope.project.id=6476c598c786412183102f9d5c51d61f, user.id=ab0111440fba409182aed28c841b75e3) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:10:32.686845 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcc31b7-aaa5-40f8-95fd-716a07c6fe67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:10:32.688429 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcc31b7-aaa5-40f8-95fd-716a07c6fe67 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:10:32.694246 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 591/1185] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jun 21 20:10:32 2022] GET /identity/v3/role_assignments?user.id=ab0111440fba409182aed28c841b75e3&scope.project.id=6476c598c786412183102f9d5c51d61f&role.id=1f5332f48d9e4c2aac866d0d546c94d5 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:10:34.674843 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c47176-6d01-4510-b66a-6947a0320b20 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:34.675404 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c47176-6d01-4510-b66a-6947a0320b20 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:34.675404 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c47176-6d01-4510-b66a-6947a0320b20 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:34.676818 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 595/1186] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:10:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:10:34.681915 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af937e65-7eae-4d54-bdc3-444826b5413e None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:34.682349 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af937e65-7eae-4d54-bdc3-444826b5413e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:34.682482 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af937e65-7eae-4d54-bdc3-444826b5413e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:34.699261 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-af937e65-7eae-4d54-bdc3-444826b5413e None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:10:34.700463 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-af937e65-7eae-4d54-bdc3-444826b5413e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:10:34.765108 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 592/1187] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:10:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 20:10:34.787838 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c47176-6d01-4510-b66a-6947a0320b20 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:10:34.852506 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:10:34.886965 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c47176-6d01-4510-b66a-6947a0320b20 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:10:34.919330 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3154ac02-3d7b-49f1-a84d-fa9f70087a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:10:34.920146 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154ac02-3d7b-49f1-a84d-fa9f70087a5e None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:34.920432 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154ac02-3d7b-49f1-a84d-fa9f70087a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:34.920709 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154ac02-3d7b-49f1-a84d-fa9f70087a5e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:34.930374 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3154ac02-3d7b-49f1-a84d-fa9f70087a5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:10:34.937744 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-3154ac02-3d7b-49f1-a84d-fa9f70087a5e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 20:10:34.937744 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:10:34.937744 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:10:34.937744 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:10:34.937744 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:10:34.937744 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:10:34.937744 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:10:34.937744 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:10:34.937744 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:10:34.937744 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:10:34.937744 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:10:34.937744 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:10:34.937744 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:10:34.937744 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:10:34.937744 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:10:34.937744 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:10:34.938917 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:10:34.938917 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:10:34.938917 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:10:34.938917 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:10:34.938917 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:10:34.938917 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:10:34.938917 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:10:34.938917 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:10:34.938917 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:10:34.938917 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:10:34.938917 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:10:34.938917 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:10:34.938917 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:10:34.938917 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:10:34.938917 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:10:34.938917 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:10:34.940055 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:10:34.940055 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:10:34.940055 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:10:34.940055 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:10:34.940055 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:10:34.940055 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:10:34.940055 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:10:34.940055 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:10:34.940055 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:10:34.940055 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:10:34.940055 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 20:10:34.940055 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:10:34.940055 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 596/1188] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jun 21 20:10:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:10:34.945506 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af937e65-7eae-4d54-bdc3-444826b5413e None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:10:34.975244 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:10:35.041395 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af937e65-7eae-4d54-bdc3-444826b5413e None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:10:35.074185 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff17697-8da1-4a6a-978c-23e50b080cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:10:35.074843 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff17697-8da1-4a6a-978c-23e50b080cc0 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:35.075131 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff17697-8da1-4a6a-978c-23e50b080cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:35.075412 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff17697-8da1-4a6a-978c-23e50b080cc0 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:35.076193 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff17697-8da1-4a6a-978c-23e50b080cc0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:10:35.076505 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff17697-8da1-4a6a-978c-23e50b080cc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:10:35.077857 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff17697-8da1-4a6a-978c-23e50b080cc0 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:10:35.085607 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 593/1189] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:10:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:10:35.091239 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3154ac02-3d7b-49f1-a84d-fa9f70087a5e None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:10:35.187179 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3154ac02-3d7b-49f1-a84d-fa9f70087a5e None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:10:35.211300 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:10:35.220056 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d834982-4467-421f-a7eb-195bbbd7ce69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:10:35.220921 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d834982-4467-421f-a7eb-195bbbd7ce69 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:35.221209 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d834982-4467-421f-a7eb-195bbbd7ce69 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:35.221489 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d834982-4467-421f-a7eb-195bbbd7ce69 None admin] PATH_INFO: `/v3/users/ab0111440fba409182aed28c841b75e3` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:35.222656 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d834982-4467-421f-a7eb-195bbbd7ce69 None admin] RBAC: Authorizing `identity:get_user(user_id=ab0111440fba409182aed28c841b75e3)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:10:35.224126 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d834982-4467-421f-a7eb-195bbbd7ce69 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:10:35.225894 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 597/1190] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jun 21 20:10:35 2022] GET /identity/v3/users/ab0111440fba409182aed28c841b75e3 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:10:35.231278 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff17697-8da1-4a6a-978c-23e50b080cc0 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:10:35.321628 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:10:35.328364 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff17697-8da1-4a6a-978c-23e50b080cc0 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:10:35.360050 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbf1851-b0f9-4bb5-9b3a-3ac25ba5a52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:10:35.360903 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf1851-b0f9-4bb5-9b3a-3ac25ba5a52d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:35.361187 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf1851-b0f9-4bb5-9b3a-3ac25ba5a52d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:35.361464 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf1851-b0f9-4bb5-9b3a-3ac25ba5a52d None admin] PATH_INFO: `/v3/projects/6476c598c786412183102f9d5c51d61f` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:35.363135 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbf1851-b0f9-4bb5-9b3a-3ac25ba5a52d None admin] RBAC: Authorizing `identity:get_project(project_id=6476c598c786412183102f9d5c51d61f)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:10:35.364581 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbf1851-b0f9-4bb5-9b3a-3ac25ba5a52d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:10:35.366233 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 594/1191] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jun 21 20:10:35 2022] GET /identity/v3/projects/6476c598c786412183102f9d5c51d61f => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:10:35.371771 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d834982-4467-421f-a7eb-195bbbd7ce69 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:10:35.467061 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d834982-4467-421f-a7eb-195bbbd7ce69 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:10:35.499941 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef64579-b75e-4d5b-ad7e-e2d4f5ec75f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:10:35.500829 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef64579-b75e-4d5b-ad7e-e2d4f5ec75f6 None admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:35.501139 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef64579-b75e-4d5b-ad7e-e2d4f5ec75f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:35.501418 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef64579-b75e-4d5b-ad7e-e2d4f5ec75f6 None admin] PATH_INFO: `/v3/projects/6476c598c786412183102f9d5c51d61f/users/ab0111440fba409182aed28c841b75e3/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:35.503342 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef64579-b75e-4d5b-ad7e-e2d4f5ec75f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=6476c598c786412183102f9d5c51d61f, user_id=ab0111440fba409182aed28c841b75e3, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:10:35.504776 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef64579-b75e-4d5b-ad7e-e2d4f5ec75f6 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:10:35.516816 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 598/1192] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Jun 21 20:10:35 2022] PUT /identity/v3/projects/6476c598c786412183102f9d5c51d61f/users/ab0111440fba409182aed28c841b75e3/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:10:37.505676 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b5c86-f1e7-4eff-b62b-273945a5d673 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:37.506209 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b5c86-f1e7-4eff-b62b-273945a5d673 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:37.506320 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b5c86-f1e7-4eff-b62b-273945a5d673 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:37.507615 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 595/1193] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:10:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:10:37.512854 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d74c7-705c-434b-af26-934b1593b63a None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:37.513235 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d74c7-705c-434b-af26-934b1593b63a None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:37.513419 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d74c7-705c-434b-af26-934b1593b63a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:37.530406 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-fd4d74c7-705c-434b-af26-934b1593b63a None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:10:37.531589 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-fd4d74c7-705c-434b-af26-934b1593b63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:10:37.579293 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:10:37.596789 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 599/1194] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:10:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 20:10:37.621138 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b5c86-f1e7-4eff-b62b-273945a5d673 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:10:37.720103 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b5c86-f1e7-4eff-b62b-273945a5d673 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:10:37.752546 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94451f93-bd4a-4d06-a0c0-d533167cea7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:10:37.753350 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94451f93-bd4a-4d06-a0c0-d533167cea7f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:37.753631 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94451f93-bd4a-4d06-a0c0-d533167cea7f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:37.753901 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94451f93-bd4a-4d06-a0c0-d533167cea7f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:37.763970 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94451f93-bd4a-4d06-a0c0-d533167cea7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:10:37.771367 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-94451f93-bd4a-4d06-a0c0-d533167cea7f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 20:10:37.771367 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:10:37.771367 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:10:37.771367 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:10:37.771367 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:10:37.771367 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:10:37.771367 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:10:37.771367 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:10:37.771367 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:10:37.771367 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:10:37.771367 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:10:37.771367 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:10:37.771367 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:10:37.771367 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:10:37.771367 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:10:37.771367 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:10:37.772456 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:10:37.772456 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:10:37.772456 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:10:37.772456 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:10:37.772456 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:10:37.772456 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:10:37.772456 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:10:37.772456 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:10:37.772456 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:10:37.772456 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:10:37.772456 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:10:37.772456 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:10:37.772456 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:10:37.772456 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:10:37.772456 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:10:37.772456 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:10:37.773329 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:10:37.773329 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:10:37.773329 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:10:37.773329 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:10:37.773329 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:10:37.773329 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:10:37.773329 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:10:37.773329 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:10:37.773329 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:10:37.773329 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:10:37.773329 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 20:10:37.773329 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:10:37.773329 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 596/1195] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jun 21 20:10:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:10:37.778503 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d74c7-705c-434b-af26-934b1593b63a None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:10:37.873742 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d74c7-705c-434b-af26-934b1593b63a None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:10:37.905943 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0e4b2-c798-4b29-a21e-966540089543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:10:37.906602 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0e4b2-c798-4b29-a21e-966540089543 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:37.906894 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0e4b2-c798-4b29-a21e-966540089543 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:37.907168 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0e4b2-c798-4b29-a21e-966540089543 None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:37.907910 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece0e4b2-c798-4b29-a21e-966540089543 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:10:37.908243 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece0e4b2-c798-4b29-a21e-966540089543 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:10:37.910149 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece0e4b2-c798-4b29-a21e-966540089543 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:10:37.917975 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 600/1196] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:10:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:10:37.923572 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94451f93-bd4a-4d06-a0c0-d533167cea7f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:10:37.947465 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:10:38.020988 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94451f93-bd4a-4d06-a0c0-d533167cea7f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:10:38.053410 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a750d6a-daad-40b9-9e4d-1c32ed49f910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:10:38.054268 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a750d6a-daad-40b9-9e4d-1c32ed49f910 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:38.054545 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a750d6a-daad-40b9-9e4d-1c32ed49f910 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:38.054815 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a750d6a-daad-40b9-9e4d-1c32ed49f910 None admin] PATH_INFO: `/v3/users/ab0111440fba409182aed28c841b75e3` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:38.056000 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a750d6a-daad-40b9-9e4d-1c32ed49f910 None admin] RBAC: Authorizing `identity:get_user(user_id=ab0111440fba409182aed28c841b75e3)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:10:38.057408 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a750d6a-daad-40b9-9e4d-1c32ed49f910 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:10:38.058988 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 597/1197] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jun 21 20:10:37 2022] GET /identity/v3/users/ab0111440fba409182aed28c841b75e3 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:10:38.064586 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0e4b2-c798-4b29-a21e-966540089543 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:10:38.110241 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:10:38.161227 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0e4b2-c798-4b29-a21e-966540089543 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:10:38.192403 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6820be2d-14f9-434f-87a0-8966d07f10c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:10:38.197184 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820be2d-14f9-434f-87a0-8966d07f10c3 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:38.197476 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820be2d-14f9-434f-87a0-8966d07f10c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:38.197755 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820be2d-14f9-434f-87a0-8966d07f10c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:38.261700 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6820be2d-14f9-434f-87a0-8966d07f10c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:10:38.263144 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6820be2d-14f9-434f-87a0-8966d07f10c3 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:10:38.306643 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:10:38.359170 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 601/1198] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:10:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 20:10:38.365094 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a750d6a-daad-40b9-9e4d-1c32ed49f910 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:10:38.451138 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:10:38.461385 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a750d6a-daad-40b9-9e4d-1c32ed49f910 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:10:38.493411 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039c364-8461-49af-8f7b-6d160107ae3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:10:38.494247 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039c364-8461-49af-8f7b-6d160107ae3d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:38.494529 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039c364-8461-49af-8f7b-6d160107ae3d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:38.494811 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039c364-8461-49af-8f7b-6d160107ae3d None admin] PATH_INFO: `/v3/projects/6476c598c786412183102f9d5c51d61f` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:38.495980 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0039c364-8461-49af-8f7b-6d160107ae3d None admin] RBAC: Authorizing `identity:get_project(project_id=6476c598c786412183102f9d5c51d61f)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:10:38.497383 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0039c364-8461-49af-8f7b-6d160107ae3d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:10:38.499018 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 598/1199] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jun 21 20:10:38 2022] GET /identity/v3/projects/6476c598c786412183102f9d5c51d61f => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:10:38.505402 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6820be2d-14f9-434f-87a0-8966d07f10c3 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:10:38.600220 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6820be2d-14f9-434f-87a0-8966d07f10c3 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:10:38.633037 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b2b8a9-07f8-4c68-ac45-fe46aa6ecef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:10:38.633675 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2b8a9-07f8-4c68-ac45-fe46aa6ecef9 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:10:38.633959 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2b8a9-07f8-4c68-ac45-fe46aa6ecef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:10:38.634236 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2b8a9-07f8-4c68-ac45-fe46aa6ecef9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:10:38.635061 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b2b8a9-07f8-4c68-ac45-fe46aa6ecef9 None admin] RBAC: Adding query filter params (role.id=1f5332f48d9e4c2aac866d0d546c94d5, scope.project.id=6476c598c786412183102f9d5c51d61f, user.id=ab0111440fba409182aed28c841b75e3) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:10:38.635378 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b2b8a9-07f8-4c68-ac45-fe46aa6ecef9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:10:38.636817 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b2b8a9-07f8-4c68-ac45-fe46aa6ecef9 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:10:38.642425 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 602/1200] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jun 21 20:10:38 2022] GET /identity/v3/role_assignments?user.id=ab0111440fba409182aed28c841b75e3&scope.project.id=6476c598c786412183102f9d5c51d61f&role.id=1f5332f48d9e4c2aac866d0d546c94d5 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:10:48.489436 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=21 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:10:48.639861 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=95 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:11:33.540448 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029a324-e5ce-4a5d-9c1e-18b7bc801fb8 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:33.541198 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029a324-e5ce-4a5d-9c1e-18b7bc801fb8 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:33.541198 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029a324-e5ce-4a5d-9c1e-18b7bc801fb8 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:33.542383 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 599/1201] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:11:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:11:33.547875 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc3595-aa4e-4dd5-8913-84be7e396e2c None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:33.548407 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc3595-aa4e-4dd5-8913-84be7e396e2c None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:33.548503 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc3595-aa4e-4dd5-8913-84be7e396e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:33.570916 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-f5bc3595-aa4e-4dd5-8913-84be7e396e2c None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:11:33.572626 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-f5bc3595-aa4e-4dd5-8913-84be7e396e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:11:33.666744 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 603/1202] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:11:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 20:11:33.691844 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029a324-e5ce-4a5d-9c1e-18b7bc801fb8 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:33.841986 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029a324-e5ce-4a5d-9c1e-18b7bc801fb8 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:33.893616 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b85aee-ddfc-4179-81e3-7b9acbd773b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:33.894505 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b85aee-ddfc-4179-81e3-7b9acbd773b9 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:33.894814 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b85aee-ddfc-4179-81e3-7b9acbd773b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:33.895112 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b85aee-ddfc-4179-81e3-7b9acbd773b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:33.910372 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b85aee-ddfc-4179-81e3-7b9acbd773b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:33.911840 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b85aee-ddfc-4179-81e3-7b9acbd773b9 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:33.934332 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-26b85aee-ddfc-4179-81e3-7b9acbd773b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:11:33.934332 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:11:33.934332 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:11:33.934332 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:11:33.934332 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:11:33.934332 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:11:33.934332 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:11:33.934332 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:11:33.934332 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:11:33.934332 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:11:33.934332 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:11:33.934332 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:11:33.934332 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:11:33.934332 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:11:33.934332 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:11:33.935577 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:11:33.935577 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:11:33.935577 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:11:33.935577 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:11:33.935577 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:11:33.935577 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:11:33.935577 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:11:33.935577 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:11:33.935577 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:11:33.935577 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:11:33.935577 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:11:33.935577 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:11:33.935577 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:11:33.935577 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:11:33.935577 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:11:33.935577 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:11:33.935577 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:11:33.936873 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:11:33.936873 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:11:33.936873 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:11:33.936873 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:11:33.938600 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 600/1203] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:11:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:11:33.946356 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc3595-aa4e-4dd5-8913-84be7e396e2c None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:34.077293 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc3595-aa4e-4dd5-8913-84be7e396e2c None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:34.111120 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:11:34.119077 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da853dcf-bfc9-42da-9b19-4bc8ac44934a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:34.119077 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da853dcf-bfc9-42da-9b19-4bc8ac44934a None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:34.119077 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da853dcf-bfc9-42da-9b19-4bc8ac44934a None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:34.119077 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da853dcf-bfc9-42da-9b19-4bc8ac44934a None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:34.119506 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da853dcf-bfc9-42da-9b19-4bc8ac44934a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:11:34.119820 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da853dcf-bfc9-42da-9b19-4bc8ac44934a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:34.121283 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da853dcf-bfc9-42da-9b19-4bc8ac44934a None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:34.135972 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 604/1204] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:11:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:11:34.140187 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b85aee-ddfc-4179-81e3-7b9acbd773b9 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:34.204557 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:11:34.267579 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b85aee-ddfc-4179-81e3-7b9acbd773b9 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:34.314420 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d367cbfa-300e-4f74-b184-3ae9967d4f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:34.315719 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367cbfa-300e-4f74-b184-3ae9967d4f7f None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:34.316110 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367cbfa-300e-4f74-b184-3ae9967d4f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:34.316286 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367cbfa-300e-4f74-b184-3ae9967d4f7f None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:34.317049 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d367cbfa-300e-4f74-b184-3ae9967d4f7f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:34.318616 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d367cbfa-300e-4f74-b184-3ae9967d4f7f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:34.348657 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 601/1205] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Jun 21 20:11:34 2022] POST /identity/v3/users => generated 251 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:11:36.583783 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5d08a-55cf-4e60-aa5e-43efc6c61c58 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:36.584690 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5d08a-55cf-4e60-aa5e-43efc6c61c58 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:36.584690 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5d08a-55cf-4e60-aa5e-43efc6c61c58 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:36.585921 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 605/1206] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:11:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:11:36.590983 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31502b0f-6a20-464b-9feb-62b1497e673e None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:36.591463 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31502b0f-6a20-464b-9feb-62b1497e673e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:36.591583 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31502b0f-6a20-464b-9feb-62b1497e673e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:36.610422 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-31502b0f-6a20-464b-9feb-62b1497e673e None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:11:36.612410 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-31502b0f-6a20-464b-9feb-62b1497e673e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:11:36.688699 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 602/1207] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:11:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 20:11:36.714993 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5d08a-55cf-4e60-aa5e-43efc6c61c58 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:36.834920 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5d08a-55cf-4e60-aa5e-43efc6c61c58 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:36.885302 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2810d-6f98-401a-97d1-7762bdf2ddca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:36.886367 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2810d-6f98-401a-97d1-7762bdf2ddca None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:36.886597 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2810d-6f98-401a-97d1-7762bdf2ddca None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:36.886826 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2810d-6f98-401a-97d1-7762bdf2ddca None admin] PATH_INFO: `/v3/roles/service` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:36.898640 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b2810d-6f98-401a-97d1-7762bdf2ddca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:11:36.906684 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-97b2810d-6f98-401a-97d1-7762bdf2ddca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 20:11:36.906684 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:11:36.906684 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:11:36.906684 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:11:36.906684 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:11:36.906684 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:11:36.906684 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:11:36.906684 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:11:36.906684 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:11:36.906684 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:11:36.906684 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:11:36.906684 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:11:36.906684 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:11:36.906684 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:11:36.906684 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:11:36.906684 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:11:36.907763 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:11:36.907763 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:11:36.907763 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:11:36.907763 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:11:36.907763 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:11:36.907763 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:11:36.907763 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:11:36.907763 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:11:36.907763 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:11:36.907763 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:11:36.907763 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:11:36.907763 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:11:36.907763 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:11:36.907763 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:11:36.907763 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:11:36.907763 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:11:36.909181 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:11:36.909181 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:11:36.909181 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:11:36.909181 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:11:36.909181 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:11:36.909181 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:11:36.909181 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:11:36.909181 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:11:36.909181 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:11:36.909181 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:11:36.909181 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 20:11:36.909181 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:11:36.909181 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 606/1208] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Jun 21 20:11:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:11:36.914659 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31502b0f-6a20-464b-9feb-62b1497e673e None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:36.963125 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:11:37.033689 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31502b0f-6a20-464b-9feb-62b1497e673e None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:37.075200 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5366efe-a166-4f3c-a38e-8a67f5371758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:37.075980 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5366efe-a166-4f3c-a38e-8a67f5371758 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:37.076307 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5366efe-a166-4f3c-a38e-8a67f5371758 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:37.076623 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5366efe-a166-4f3c-a38e-8a67f5371758 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:37.077418 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5366efe-a166-4f3c-a38e-8a67f5371758 None admin] RBAC: Adding query filter params (name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:11:37.077735 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5366efe-a166-4f3c-a38e-8a67f5371758 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:37.079335 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5366efe-a166-4f3c-a38e-8a67f5371758 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:37.094300 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 603/1209] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Jun 21 20:11:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:11:37.095452 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2810d-6f98-401a-97d1-7762bdf2ddca None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:37.154112 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:11:37.211642 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2810d-6f98-401a-97d1-7762bdf2ddca None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:37.254798 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf10930-932f-4b68-b360-cac96238d362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:37.255603 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf10930-932f-4b68-b360-cac96238d362 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:37.255890 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf10930-932f-4b68-b360-cac96238d362 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:37.256194 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf10930-932f-4b68-b360-cac96238d362 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:37.267939 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf10930-932f-4b68-b360-cac96238d362 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:37.269457 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf10930-932f-4b68-b360-cac96238d362 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:37.290971 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-6cf10930-932f-4b68-b360-cac96238d362 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:11:37.290971 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:11:37.290971 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:11:37.290971 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:11:37.290971 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:11:37.290971 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:11:37.290971 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:11:37.290971 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:11:37.290971 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:11:37.290971 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:11:37.290971 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:11:37.290971 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:11:37.290971 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:11:37.290971 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:11:37.290971 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:11:37.297371 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:11:37.297371 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:11:37.297371 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:11:37.297371 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:11:37.297371 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:11:37.297371 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:11:37.297371 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:11:37.297371 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:11:37.297371 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:11:37.297371 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:11:37.297371 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:11:37.297371 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:11:37.297371 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:11:37.297371 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:11:37.297371 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:11:37.297371 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:11:37.297371 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:11:37.298269 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:11:37.298269 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:11:37.298269 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:11:37.298269 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:11:37.298269 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 607/1210] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:11:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:11:37.298566 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5366efe-a166-4f3c-a38e-8a67f5371758 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:37.417593 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:11:37.421214 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5366efe-a166-4f3c-a38e-8a67f5371758 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:37.470576 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094bb675-bd16-4ea8-9e02-1ea4706a4397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:37.471940 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094bb675-bd16-4ea8-9e02-1ea4706a4397 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:37.472235 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094bb675-bd16-4ea8-9e02-1ea4706a4397 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:37.472509 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094bb675-bd16-4ea8-9e02-1ea4706a4397 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:37.473255 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094bb675-bd16-4ea8-9e02-1ea4706a4397 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:11:37.473563 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094bb675-bd16-4ea8-9e02-1ea4706a4397 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:37.474959 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094bb675-bd16-4ea8-9e02-1ea4706a4397 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:37.489902 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 604/1211] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:11:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:11:37.495734 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf10930-932f-4b68-b360-cac96238d362 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:37.622022 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf10930-932f-4b68-b360-cac96238d362 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:37.623615 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:11:37.666821 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d175119-c8a3-4c0a-8eca-370a683fe69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:37.667852 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d175119-c8a3-4c0a-8eca-370a683fe69c None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:37.668237 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d175119-c8a3-4c0a-8eca-370a683fe69c None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:37.668630 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d175119-c8a3-4c0a-8eca-370a683fe69c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:37.678629 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d175119-c8a3-4c0a-8eca-370a683fe69c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:37.681628 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d175119-c8a3-4c0a-8eca-370a683fe69c None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:37.694934 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-5d175119-c8a3-4c0a-8eca-370a683fe69c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 21 20:11:37.694934 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:11:37.694934 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:11:37.694934 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:11:37.694934 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:11:37.694934 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:11:37.694934 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:11:37.694934 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:11:37.694934 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:11:37.694934 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:11:37.694934 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:11:37.694934 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:11:37.694934 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 20:11:37.694934 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 20:11:37.694934 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 20:11:37.694934 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 20:11:37.695996 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:11:37.695996 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:11:37.695996 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 20:11:37.695996 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:11:37.695996 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 20:11:37.695996 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:11:37.695996 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:11:37.695996 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:11:37.695996 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:11:37.695996 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:11:37.695996 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:11:37.695996 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:11:37.695996 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:11:37.695996 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:11:37.695996 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:11:37.695996 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:11:37.695996 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:11:37.695996 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:11:37.696968 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:11:37.696968 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:11:37.696968 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 20:11:37.696968 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 20:11:37.696968 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 20:11:37.696968 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 20:11:37.696968 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 20:11:37.696968 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 20:11:37.696968 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 21 20:11:37.696968 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:11:37.696968 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 608/1212] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:11:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:11:37.702180 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094bb675-bd16-4ea8-9e02-1ea4706a4397 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:37.814441 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094bb675-bd16-4ea8-9e02-1ea4706a4397 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:37.853056 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee40ec6d-59c5-4a41-b339-4b9bbe739255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:37.853757 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40ec6d-59c5-4a41-b339-4b9bbe739255 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:37.854054 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40ec6d-59c5-4a41-b339-4b9bbe739255 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:37.854332 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40ec6d-59c5-4a41-b339-4b9bbe739255 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:37.855190 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee40ec6d-59c5-4a41-b339-4b9bbe739255 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:11:37.855511 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee40ec6d-59c5-4a41-b339-4b9bbe739255 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:37.857259 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee40ec6d-59c5-4a41-b339-4b9bbe739255 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:37.877307 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 605/1213] 10.222.0.15 () {56 vars in 1143 bytes} [Tue Jun 21 20:11:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:11:37.883618 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d175119-c8a3-4c0a-8eca-370a683fe69c None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:38.001385 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d175119-c8a3-4c0a-8eca-370a683fe69c None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:38.041615 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d656fc53-135a-4aac-8995-2bbe64a44bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:38.042379 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d656fc53-135a-4aac-8995-2bbe64a44bf2 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:38.042686 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d656fc53-135a-4aac-8995-2bbe64a44bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:38.043031 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d656fc53-135a-4aac-8995-2bbe64a44bf2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:38.076574 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:11:38.119730 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d656fc53-135a-4aac-8995-2bbe64a44bf2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:38.121605 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d656fc53-135a-4aac-8995-2bbe64a44bf2 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:38.239983 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 609/1214] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:11:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 20:11:38.245953 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee40ec6d-59c5-4a41-b339-4b9bbe739255 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:38.265757 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:11:38.360922 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee40ec6d-59c5-4a41-b339-4b9bbe739255 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:38.400822 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59bb3c0-d0af-4746-9273-71ac44a4a046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:38.401629 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59bb3c0-d0af-4746-9273-71ac44a4a046 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:38.401917 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59bb3c0-d0af-4746-9273-71ac44a4a046 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:38.402197 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59bb3c0-d0af-4746-9273-71ac44a4a046 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:38.414750 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59bb3c0-d0af-4746-9273-71ac44a4a046 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:38.416434 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59bb3c0-d0af-4746-9273-71ac44a4a046 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:38.437117 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-f59bb3c0-d0af-4746-9273-71ac44a4a046 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:11:38.437117 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:11:38.437117 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:11:38.437117 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:11:38.437117 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:11:38.437117 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:11:38.437117 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:11:38.437117 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:11:38.437117 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:11:38.437117 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:11:38.437117 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:11:38.437117 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:11:38.437117 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:11:38.437117 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:11:38.437117 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:11:38.438097 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:11:38.438097 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:11:38.438097 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:11:38.438097 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:11:38.438097 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:11:38.438097 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:11:38.438097 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:11:38.438097 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:11:38.438097 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:11:38.438097 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:11:38.438097 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:11:38.438097 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:11:38.438097 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:11:38.438097 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:11:38.438097 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:11:38.438097 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:11:38.438097 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:11:38.439033 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:11:38.439033 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:11:38.439033 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:11:38.439033 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:11:38.439033 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 606/1215] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:11:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:11:38.444714 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d656fc53-135a-4aac-8995-2bbe64a44bf2 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:38.515477 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:11:38.557805 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d656fc53-135a-4aac-8995-2bbe64a44bf2 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:38.597099 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce8f3f-7dc1-4216-8ffe-d9ba6fa3bc8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:38.597889 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce8f3f-7dc1-4216-8ffe-d9ba6fa3bc8d None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:38.598179 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce8f3f-7dc1-4216-8ffe-d9ba6fa3bc8d None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:38.598547 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce8f3f-7dc1-4216-8ffe-d9ba6fa3bc8d None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:38.599357 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce8f3f-7dc1-4216-8ffe-d9ba6fa3bc8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:11:38.599769 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce8f3f-7dc1-4216-8ffe-d9ba6fa3bc8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:38.601406 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce8f3f-7dc1-4216-8ffe-d9ba6fa3bc8d None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:38.616785 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 610/1216] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:11:38.622855 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59bb3c0-d0af-4746-9273-71ac44a4a046 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:38.711625 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:11:38.753268 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59bb3c0-d0af-4746-9273-71ac44a4a046 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:38.790523 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580eca80-44ba-405e-8451-6403050a57ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:38.791356 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580eca80-44ba-405e-8451-6403050a57ec None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:38.791646 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580eca80-44ba-405e-8451-6403050a57ec None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:38.792003 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580eca80-44ba-405e-8451-6403050a57ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:38.801247 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580eca80-44ba-405e-8451-6403050a57ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:38.801671 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580eca80-44ba-405e-8451-6403050a57ec None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:38.817072 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-580eca80-44ba-405e-8451-6403050a57ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:11:38.817072 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:11:38.817072 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:11:38.817072 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:11:38.817072 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:11:38.817072 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:11:38.817072 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:11:38.817072 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:11:38.817072 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:11:38.817072 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:11:38.817072 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:11:38.817072 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:11:38.817072 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 20:11:38.817072 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 20:11:38.817072 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 20:11:38.818015 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 20:11:38.818015 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:11:38.818015 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:11:38.818015 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:11:38.818015 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:11:38.818015 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:11:38.818015 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:11:38.818015 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:11:38.818015 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:11:38.818015 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:11:38.818015 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:11:38.818015 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:11:38.818015 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:11:38.818015 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:11:38.818015 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:11:38.818015 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:11:38.818015 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:11:38.818997 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 20:11:38.818997 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 20:11:38.818997 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 20:11:38.818997 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 20:11:38.818997 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 20:11:38.818997 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 20:11:38.818997 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:11:38.818997 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:11:38.822391 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 607/1217] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jun 21 20:11:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:11:38.823901 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce8f3f-7dc1-4216-8ffe-d9ba6fa3bc8d None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:38.934245 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce8f3f-7dc1-4216-8ffe-d9ba6fa3bc8d None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:38.960769 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:11:38.977786 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32ac5f5-df04-4964-b79e-2afc5b1d8924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:38.978426 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ac5f5-df04-4964-b79e-2afc5b1d8924 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:38.978709 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ac5f5-df04-4964-b79e-2afc5b1d8924 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:38.979003 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ac5f5-df04-4964-b79e-2afc5b1d8924 None admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:38.979779 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32ac5f5-df04-4964-b79e-2afc5b1d8924 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:11:38.980117 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32ac5f5-df04-4964-b79e-2afc5b1d8924 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:38.981812 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32ac5f5-df04-4964-b79e-2afc5b1d8924 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:38.994758 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 611/1218] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jun 21 20:11:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:11:39.001804 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580eca80-44ba-405e-8451-6403050a57ec None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:39.120991 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580eca80-44ba-405e-8451-6403050a57ec None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:39.156844 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:11:39.161684 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185f6f1-5a44-4921-82be-81be67df3b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:39.162609 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185f6f1-5a44-4921-82be-81be67df3b87 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:39.163272 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185f6f1-5a44-4921-82be-81be67df3b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:39.163655 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185f6f1-5a44-4921-82be-81be67df3b87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:39.164721 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0185f6f1-5a44-4921-82be-81be67df3b87 None admin] RBAC: Adding query filter params (role.id=a4929ef60a294190b2d59e8d61e05063, scope.project.id=4dcb71ef7b6e49148edd61a1eb8da7bb, user.id=a59294bff27c4b3f8aaeeab48ed35a0e) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:11:39.165261 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0185f6f1-5a44-4921-82be-81be67df3b87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:39.167292 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0185f6f1-5a44-4921-82be-81be67df3b87 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:39.183961 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 608/1219] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jun 21 20:11:39 2022] GET /identity/v3/role_assignments?user.id=a59294bff27c4b3f8aaeeab48ed35a0e&scope.project.id=4dcb71ef7b6e49148edd61a1eb8da7bb&role.id=a4929ef60a294190b2d59e8d61e05063 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:11:41.413712 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f7193-b79b-4659-b679-e8cad6bdd8fa None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:41.414338 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f7193-b79b-4659-b679-e8cad6bdd8fa None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:41.414448 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f7193-b79b-4659-b679-e8cad6bdd8fa None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:41.416215 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 612/1220] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:11:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:11:41.422424 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7a663-8898-4cb2-8875-e31011099a66 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:41.422878 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7a663-8898-4cb2-8875-e31011099a66 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:41.423126 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7a663-8898-4cb2-8875-e31011099a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:41.442306 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-45c7a663-8898-4cb2-8875-e31011099a66 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:11:41.443553 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-45c7a663-8898-4cb2-8875-e31011099a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:11:41.511757 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 609/1221] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:11:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 20:11:41.535416 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f7193-b79b-4659-b679-e8cad6bdd8fa None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:41.641184 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f7193-b79b-4659-b679-e8cad6bdd8fa None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:41.681145 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b11ada-1184-466d-95c5-23fae478bb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:41.681880 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b11ada-1184-466d-95c5-23fae478bb39 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:41.682161 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b11ada-1184-466d-95c5-23fae478bb39 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:41.682450 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b11ada-1184-466d-95c5-23fae478bb39 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:41.692855 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b11ada-1184-466d-95c5-23fae478bb39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:11:41.700765 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-d9b11ada-1184-466d-95c5-23fae478bb39 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 20:11:41.700765 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:11:41.700765 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:11:41.700765 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:11:41.700765 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:11:41.700765 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:11:41.700765 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:11:41.700765 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:11:41.700765 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:11:41.700765 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:11:41.700765 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:11:41.700765 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:11:41.700765 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:11:41.700765 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:11:41.700765 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:11:41.700765 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:11:41.701776 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:11:41.701776 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:11:41.701776 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:11:41.701776 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:11:41.701776 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:11:41.701776 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:11:41.701776 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:11:41.701776 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:11:41.701776 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:11:41.701776 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:11:41.701776 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:11:41.701776 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:11:41.701776 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:11:41.701776 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:11:41.701776 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:11:41.701776 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:11:41.702750 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:11:41.702750 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:11:41.702750 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:11:41.702750 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:11:41.702750 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:11:41.702750 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:11:41.702750 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:11:41.702750 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:11:41.702750 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:11:41.702750 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:11:41.702750 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 20:11:41.702750 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:11:41.702750 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 613/1222] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Jun 21 20:11:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:11:41.708270 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c7a663-8898-4cb2-8875-e31011099a66 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:41.816214 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c7a663-8898-4cb2-8875-e31011099a66 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:41.842181 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:11:41.853885 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91b6d6-cb5c-4d52-b0e1-72ba83e87b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:41.854566 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91b6d6-cb5c-4d52-b0e1-72ba83e87b7f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:41.854854 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91b6d6-cb5c-4d52-b0e1-72ba83e87b7f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:41.855135 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91b6d6-cb5c-4d52-b0e1-72ba83e87b7f None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:41.856147 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c91b6d6-cb5c-4d52-b0e1-72ba83e87b7f None admin] RBAC: Adding query filter params (name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:11:41.856481 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c91b6d6-cb5c-4d52-b0e1-72ba83e87b7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:41.857931 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c91b6d6-cb5c-4d52-b0e1-72ba83e87b7f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:41.866081 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 610/1223] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Jun 21 20:11:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:11:41.871635 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b11ada-1184-466d-95c5-23fae478bb39 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:41.924552 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:11:41.988601 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b11ada-1184-466d-95c5-23fae478bb39 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:42.022175 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b707c69a-62d5-43ef-8e24-feb323f97796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:42.022952 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707c69a-62d5-43ef-8e24-feb323f97796 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:42.023239 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707c69a-62d5-43ef-8e24-feb323f97796 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:42.023516 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707c69a-62d5-43ef-8e24-feb323f97796 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:42.034796 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b707c69a-62d5-43ef-8e24-feb323f97796 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:42.036282 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b707c69a-62d5-43ef-8e24-feb323f97796 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:42.054419 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-b707c69a-62d5-43ef-8e24-feb323f97796 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:11:42.054419 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:11:42.054419 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:11:42.054419 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:11:42.054419 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:11:42.054419 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:11:42.054419 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:11:42.054419 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:11:42.054419 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:11:42.054419 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:11:42.054419 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:11:42.054419 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:11:42.054419 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:11:42.054419 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:11:42.054419 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:11:42.055621 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:11:42.055621 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:11:42.055621 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:11:42.055621 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:11:42.055621 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:11:42.055621 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:11:42.055621 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:11:42.055621 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:11:42.055621 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:11:42.055621 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:11:42.055621 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:11:42.055621 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:11:42.055621 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:11:42.055621 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:11:42.055621 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:11:42.055621 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:11:42.055621 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:11:42.056711 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:11:42.056711 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:11:42.056711 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:11:42.056711 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:11:42.056711 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 614/1224] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:11:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:11:42.061708 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91b6d6-cb5c-4d52-b0e1-72ba83e87b7f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:42.172717 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91b6d6-cb5c-4d52-b0e1-72ba83e87b7f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:42.207996 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d3238c-b610-405d-8a73-6dc99076c068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:42.208724 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3238c-b610-405d-8a73-6dc99076c068 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:42.209199 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3238c-b610-405d-8a73-6dc99076c068 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:42.209551 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3238c-b610-405d-8a73-6dc99076c068 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:42.210643 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d3238c-b610-405d-8a73-6dc99076c068 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:11:42.211039 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d3238c-b610-405d-8a73-6dc99076c068 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:42.213472 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d3238c-b610-405d-8a73-6dc99076c068 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:42.227063 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 611/1225] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:11:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:11:42.233195 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b707c69a-62d5-43ef-8e24-feb323f97796 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:42.330821 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:11:42.338093 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b707c69a-62d5-43ef-8e24-feb323f97796 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:42.376964 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e703ddc-84bd-42d5-b282-8e3c71816668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:42.377896 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e703ddc-84bd-42d5-b282-8e3c71816668 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:42.378177 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e703ddc-84bd-42d5-b282-8e3c71816668 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:42.378459 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e703ddc-84bd-42d5-b282-8e3c71816668 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:42.386870 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e703ddc-84bd-42d5-b282-8e3c71816668 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:42.388643 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e703ddc-84bd-42d5-b282-8e3c71816668 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:42.405826 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-3e703ddc-84bd-42d5-b282-8e3c71816668 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 21 20:11:42.405826 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:11:42.405826 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:11:42.405826 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:11:42.405826 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:11:42.405826 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:11:42.405826 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:11:42.405826 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:11:42.405826 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:11:42.405826 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:11:42.405826 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:11:42.405826 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:11:42.405826 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 20:11:42.405826 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 20:11:42.405826 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 20:11:42.405826 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 20:11:42.407105 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:11:42.407105 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:11:42.407105 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 20:11:42.407105 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:11:42.407105 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 20:11:42.407105 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:11:42.407105 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:11:42.407105 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:11:42.407105 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:11:42.407105 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:11:42.407105 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:11:42.407105 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:11:42.407105 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:11:42.407105 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:11:42.407105 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:11:42.407105 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:11:42.407105 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:11:42.407105 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:11:42.408838 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:11:42.408838 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:11:42.408838 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 20:11:42.408838 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 20:11:42.408838 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 20:11:42.408838 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 20:11:42.408838 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 20:11:42.408838 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 20:11:42.408838 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 21 20:11:42.408838 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:11:42.408838 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 615/1226] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:11:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:11:42.413949 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d3238c-b610-405d-8a73-6dc99076c068 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:42.467448 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:11:42.532571 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d3238c-b610-405d-8a73-6dc99076c068 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:42.568758 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab3833-440b-4ff9-8155-443f032f2a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:42.569425 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab3833-440b-4ff9-8155-443f032f2a22 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:42.569708 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab3833-440b-4ff9-8155-443f032f2a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:42.569990 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab3833-440b-4ff9-8155-443f032f2a22 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:42.570813 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbab3833-440b-4ff9-8155-443f032f2a22 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:11:42.571120 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbab3833-440b-4ff9-8155-443f032f2a22 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:42.572565 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbab3833-440b-4ff9-8155-443f032f2a22 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:42.596622 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 612/1227] 10.222.0.15 () {56 vars in 1143 bytes} [Tue Jun 21 20:11:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:11:42.597757 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e703ddc-84bd-42d5-b282-8e3c71816668 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:42.704179 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e703ddc-84bd-42d5-b282-8e3c71816668 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:42.741348 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c163d95f-826a-49f4-9988-1695c6fa8782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:42.742177 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163d95f-826a-49f4-9988-1695c6fa8782 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:42.742460 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163d95f-826a-49f4-9988-1695c6fa8782 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:42.742740 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163d95f-826a-49f4-9988-1695c6fa8782 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:42.754050 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c163d95f-826a-49f4-9988-1695c6fa8782 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:42.755589 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c163d95f-826a-49f4-9988-1695c6fa8782 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:42.775184 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-c163d95f-826a-49f4-9988-1695c6fa8782 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:11:42.775184 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:11:42.775184 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:11:42.775184 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:11:42.775184 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:11:42.775184 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:11:42.775184 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:11:42.775184 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:11:42.775184 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:11:42.775184 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:11:42.775184 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:11:42.775184 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:11:42.775184 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:11:42.775184 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:11:42.775184 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:11:42.776204 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:11:42.776204 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:11:42.776204 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:11:42.776204 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:11:42.776204 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:11:42.776204 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:11:42.776204 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:11:42.776204 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:11:42.776204 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:11:42.776204 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:11:42.776204 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:11:42.776204 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:11:42.776204 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:11:42.776204 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:11:42.776204 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:11:42.776204 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:11:42.776204 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:11:42.777112 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:11:42.777112 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:11:42.777112 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:11:42.777112 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:11:42.777112 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 616/1228] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:11:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:11:42.782131 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab3833-440b-4ff9-8155-443f032f2a22 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:42.894654 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab3833-440b-4ff9-8155-443f032f2a22 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:42.896979 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:11:42.931875 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32145aa3-5402-4292-9c30-fc1e0fb66c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:42.932559 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32145aa3-5402-4292-9c30-fc1e0fb66c41 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:42.932839 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32145aa3-5402-4292-9c30-fc1e0fb66c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:42.933131 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32145aa3-5402-4292-9c30-fc1e0fb66c41 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:42.933845 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32145aa3-5402-4292-9c30-fc1e0fb66c41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:11:42.934130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32145aa3-5402-4292-9c30-fc1e0fb66c41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:42.935480 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32145aa3-5402-4292-9c30-fc1e0fb66c41 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:42.952451 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 613/1229] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:11:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:11:42.953878 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c163d95f-826a-49f4-9988-1695c6fa8782 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:42.963667 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:11:43.056072 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c163d95f-826a-49f4-9988-1695c6fa8782 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:43.090403 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9db66f-0ef9-48bf-9211-5595162e7ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:43.091200 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9db66f-0ef9-48bf-9211-5595162e7ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:43.091505 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9db66f-0ef9-48bf-9211-5595162e7ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:43.091759 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9db66f-0ef9-48bf-9211-5595162e7ec8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:43.098964 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9db66f-0ef9-48bf-9211-5595162e7ec8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:43.100447 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9db66f-0ef9-48bf-9211-5595162e7ec8 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:43.115392 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-ed9db66f-0ef9-48bf-9211-5595162e7ec8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:11:43.115392 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:11:43.115392 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:11:43.115392 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:11:43.115392 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:11:43.115392 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:11:43.115392 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:11:43.115392 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:11:43.115392 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:11:43.115392 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:11:43.115392 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:11:43.115392 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:11:43.115392 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 20:11:43.115392 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 20:11:43.115392 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 20:11:43.116557 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 20:11:43.116557 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:11:43.116557 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:11:43.116557 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:11:43.116557 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:11:43.116557 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:11:43.116557 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:11:43.116557 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:11:43.116557 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:11:43.116557 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:11:43.116557 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:11:43.116557 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:11:43.116557 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:11:43.116557 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:11:43.116557 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:11:43.116557 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:11:43.116557 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:11:43.117754 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 20:11:43.117754 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 20:11:43.117754 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 20:11:43.117754 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 20:11:43.117754 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 20:11:43.117754 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 20:11:43.117754 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:11:43.117754 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:11:43.117754 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 617/1230] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jun 21 20:11:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:11:43.122521 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32145aa3-5402-4292-9c30-fc1e0fb66c41 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:43.238883 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32145aa3-5402-4292-9c30-fc1e0fb66c41 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:43.274358 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2272e918-5a78-4195-b62a-0976bb4a5092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:43.275050 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2272e918-5a78-4195-b62a-0976bb4a5092 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:43.275312 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2272e918-5a78-4195-b62a-0976bb4a5092 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:43.275581 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2272e918-5a78-4195-b62a-0976bb4a5092 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:43.276392 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2272e918-5a78-4195-b62a-0976bb4a5092 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:11:43.276702 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2272e918-5a78-4195-b62a-0976bb4a5092 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:43.278123 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2272e918-5a78-4195-b62a-0976bb4a5092 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:43.290134 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 614/1231] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jun 21 20:11:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:11:43.296179 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9db66f-0ef9-48bf-9211-5595162e7ec8 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:43.369786 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:11:43.405851 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9db66f-0ef9-48bf-9211-5595162e7ec8 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:43.443074 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b036c42-f772-4266-b7fd-ecc028e9762f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:43.444099 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b036c42-f772-4266-b7fd-ecc028e9762f None admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:43.444390 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b036c42-f772-4266-b7fd-ecc028e9762f None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:43.444710 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b036c42-f772-4266-b7fd-ecc028e9762f None admin] PATH_INFO: `/v3/projects/4dcb71ef7b6e49148edd61a1eb8da7bb/users/a59294bff27c4b3f8aaeeab48ed35a0e/roles/a4929ef60a294190b2d59e8d61e05063` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:43.459993 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b036c42-f772-4266-b7fd-ecc028e9762f None admin] RBAC: Authorizing `identity:create_grant(project_id=4dcb71ef7b6e49148edd61a1eb8da7bb, user_id=a59294bff27c4b3f8aaeeab48ed35a0e, role_id=a4929ef60a294190b2d59e8d61e05063)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:43.461629 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b036c42-f772-4266-b7fd-ecc028e9762f None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:43.475369 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 618/1232] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Jun 21 20:11:43 2022] PUT /identity/v3/projects/4dcb71ef7b6e49148edd61a1eb8da7bb/users/a59294bff27c4b3f8aaeeab48ed35a0e/roles/a4929ef60a294190b2d59e8d61e05063 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:11:45.517088 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e638104-4ce3-4793-9f8c-95a57e3f1d2f None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:45.517657 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e638104-4ce3-4793-9f8c-95a57e3f1d2f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:45.517657 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e638104-4ce3-4793-9f8c-95a57e3f1d2f None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:45.519031 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 615/1233] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:11:45.524907 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339b373-f136-4931-9c0a-1879c087c0b0 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:45.525461 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339b373-f136-4931-9c0a-1879c087c0b0 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:45.525575 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339b373-f136-4931-9c0a-1879c087c0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:45.542507 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-8339b373-f136-4931-9c0a-1879c087c0b0 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:11:45.543701 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-8339b373-f136-4931-9c0a-1879c087c0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:11:45.615902 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 619/1234] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:11:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 20:11:45.643507 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e638104-4ce3-4793-9f8c-95a57e3f1d2f None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:45.676953 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:11:45.765491 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e638104-4ce3-4793-9f8c-95a57e3f1d2f None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:45.801889 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b5e70-9d52-4ebd-8763-b6b95e9578a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:45.802635 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b5e70-9d52-4ebd-8763-b6b95e9578a5 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:45.802922 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b5e70-9d52-4ebd-8763-b6b95e9578a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:45.803206 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b5e70-9d52-4ebd-8763-b6b95e9578a5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:45.813159 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b5e70-9d52-4ebd-8763-b6b95e9578a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:11:45.820920 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-815b5e70-9d52-4ebd-8763-b6b95e9578a5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 20:11:45.820920 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:11:45.820920 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:11:45.820920 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:11:45.820920 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:11:45.820920 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:11:45.820920 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:11:45.820920 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:11:45.820920 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:11:45.820920 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:11:45.820920 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:11:45.820920 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:11:45.820920 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:11:45.820920 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:11:45.820920 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:11:45.820920 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:11:45.822020 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:11:45.822020 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:11:45.822020 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:11:45.822020 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:11:45.822020 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:11:45.822020 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:11:45.822020 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:11:45.822020 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:11:45.822020 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:11:45.822020 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:11:45.822020 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:11:45.822020 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:11:45.822020 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:11:45.822020 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:11:45.822020 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:11:45.822020 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:11:45.823340 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:11:45.823340 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:11:45.823340 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:11:45.823340 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:11:45.823340 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:11:45.823340 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:11:45.823340 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:11:45.823340 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:11:45.823340 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:11:45.823340 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:11:45.823340 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 20:11:45.823340 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:11:45.823340 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 616/1235] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Jun 21 20:11:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:11:45.828384 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339b373-f136-4931-9c0a-1879c087c0b0 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:45.880633 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:11:45.943410 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339b373-f136-4931-9c0a-1879c087c0b0 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:45.983460 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35396ca-b956-4382-b869-e6d78c1c24cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:45.984278 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35396ca-b956-4382-b869-e6d78c1c24cf None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:45.984592 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35396ca-b956-4382-b869-e6d78c1c24cf None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:45.984925 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35396ca-b956-4382-b869-e6d78c1c24cf None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:45.985821 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35396ca-b956-4382-b869-e6d78c1c24cf None admin] RBAC: Adding query filter params (name=service) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:11:45.986737 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35396ca-b956-4382-b869-e6d78c1c24cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:45.988417 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35396ca-b956-4382-b869-e6d78c1c24cf None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:45.998936 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 620/1236] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Jun 21 20:11:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:11:46.005233 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b5e70-9d52-4ebd-8763-b6b95e9578a5 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:46.097406 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:11:46.114148 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b5e70-9d52-4ebd-8763-b6b95e9578a5 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:46.149905 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d285d27-eafc-493e-8115-5811f35bc7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:46.150713 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d285d27-eafc-493e-8115-5811f35bc7db None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:46.150998 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d285d27-eafc-493e-8115-5811f35bc7db None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:46.151278 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d285d27-eafc-493e-8115-5811f35bc7db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:46.162599 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d285d27-eafc-493e-8115-5811f35bc7db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:46.164084 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d285d27-eafc-493e-8115-5811f35bc7db None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:46.181590 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-9d285d27-eafc-493e-8115-5811f35bc7db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:11:46.181590 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:11:46.181590 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:11:46.181590 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:11:46.181590 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:11:46.181590 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:11:46.181590 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:11:46.181590 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:11:46.181590 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:11:46.181590 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:11:46.181590 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:11:46.181590 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:11:46.181590 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:11:46.181590 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:11:46.181590 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:11:46.182754 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:11:46.182754 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:11:46.182754 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:11:46.182754 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:11:46.182754 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:11:46.182754 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:11:46.182754 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:11:46.182754 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:11:46.182754 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:11:46.182754 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:11:46.182754 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:11:46.182754 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:11:46.182754 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:11:46.182754 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:11:46.182754 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:11:46.182754 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:11:46.182754 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:11:46.183759 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:11:46.183759 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:11:46.183759 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:11:46.183759 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:11:46.183759 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 617/1237] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:11:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:11:46.188651 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35396ca-b956-4382-b869-e6d78c1c24cf None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:46.298621 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35396ca-b956-4382-b869-e6d78c1c24cf None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:46.308625 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:11:46.335907 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f3f88-598c-4de8-a6a2-bcc15b03debd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:46.336602 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f3f88-598c-4de8-a6a2-bcc15b03debd None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:46.336900 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f3f88-598c-4de8-a6a2-bcc15b03debd None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:46.337183 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f3f88-598c-4de8-a6a2-bcc15b03debd None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:46.337918 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158f3f88-598c-4de8-a6a2-bcc15b03debd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:11:46.338220 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158f3f88-598c-4de8-a6a2-bcc15b03debd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:46.339613 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158f3f88-598c-4de8-a6a2-bcc15b03debd None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:46.351933 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 621/1238] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:11:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:11:46.357753 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d285d27-eafc-493e-8115-5811f35bc7db None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:46.471678 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d285d27-eafc-493e-8115-5811f35bc7db None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:46.515710 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d54e1e-a970-48d9-aa77-42870db92267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:46.516633 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d54e1e-a970-48d9-aa77-42870db92267 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:46.516951 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d54e1e-a970-48d9-aa77-42870db92267 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:46.517817 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d54e1e-a970-48d9-aa77-42870db92267 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:46.520940 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:11:46.526949 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d54e1e-a970-48d9-aa77-42870db92267 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:46.528765 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d54e1e-a970-48d9-aa77-42870db92267 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:46.544653 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-87d54e1e-a970-48d9-aa77-42870db92267 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 21 20:11:46.544653 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:11:46.544653 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:11:46.544653 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:11:46.544653 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:11:46.544653 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:11:46.544653 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:11:46.544653 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:11:46.544653 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:11:46.544653 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:11:46.544653 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:11:46.544653 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:11:46.544653 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 20:11:46.544653 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 20:11:46.544653 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 20:11:46.544653 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 20:11:46.545780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:11:46.545780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:11:46.545780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 20:11:46.545780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:11:46.545780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 20:11:46.545780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:11:46.545780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:11:46.545780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:11:46.545780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:11:46.545780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:11:46.545780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:11:46.545780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:11:46.545780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:11:46.545780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:11:46.545780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:11:46.545780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:11:46.545780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:11:46.545780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:11:46.551707 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:11:46.551707 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:11:46.551707 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 20:11:46.551707 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 20:11:46.551707 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 20:11:46.551707 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 20:11:46.551707 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 20:11:46.551707 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 20:11:46.551707 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 21 20:11:46.551707 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:11:46.551707 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 618/1239] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:11:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:11:46.552683 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f3f88-598c-4de8-a6a2-bcc15b03debd None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:46.678740 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f3f88-598c-4de8-a6a2-bcc15b03debd None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:46.714905 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee719b5f-fb6f-4996-b12f-ae1eeb2a91b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:46.715689 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee719b5f-fb6f-4996-b12f-ae1eeb2a91b3 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:46.716054 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee719b5f-fb6f-4996-b12f-ae1eeb2a91b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:46.716335 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee719b5f-fb6f-4996-b12f-ae1eeb2a91b3 None admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:46.717288 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee719b5f-fb6f-4996-b12f-ae1eeb2a91b3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:11:46.717625 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee719b5f-fb6f-4996-b12f-ae1eeb2a91b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:46.719206 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee719b5f-fb6f-4996-b12f-ae1eeb2a91b3 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:46.738931 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 622/1240] 10.222.0.15 () {56 vars in 1143 bytes} [Tue Jun 21 20:11:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:11:46.744673 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d54e1e-a970-48d9-aa77-42870db92267 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:46.851023 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d54e1e-a970-48d9-aa77-42870db92267 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:46.889726 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad6943-027f-4f50-933e-8be3fab3d0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:46.890378 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad6943-027f-4f50-933e-8be3fab3d0bd None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:46.890664 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad6943-027f-4f50-933e-8be3fab3d0bd None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:46.890941 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad6943-027f-4f50-933e-8be3fab3d0bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:46.955637 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:11:46.964013 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ad6943-027f-4f50-933e-8be3fab3d0bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:46.965859 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ad6943-027f-4f50-933e-8be3fab3d0bd None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:47.073652 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 619/1241] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:11:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 20:11:47.079392 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee719b5f-fb6f-4996-b12f-ae1eeb2a91b3 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:47.109357 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:11:47.196220 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee719b5f-fb6f-4996-b12f-ae1eeb2a91b3 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:47.233391 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb39fe5-c101-49c7-905c-198e5c40944e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:47.234174 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb39fe5-c101-49c7-905c-198e5c40944e None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:47.234527 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb39fe5-c101-49c7-905c-198e5c40944e None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:47.234856 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb39fe5-c101-49c7-905c-198e5c40944e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:47.245765 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb39fe5-c101-49c7-905c-198e5c40944e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:47.247347 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb39fe5-c101-49c7-905c-198e5c40944e None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:47.265396 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-ccb39fe5-c101-49c7-905c-198e5c40944e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:11:47.265396 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:11:47.265396 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:11:47.265396 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:11:47.265396 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:11:47.265396 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:11:47.265396 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:11:47.265396 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:11:47.265396 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:11:47.265396 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:11:47.265396 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:11:47.265396 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:11:47.265396 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:11:47.265396 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:11:47.265396 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:11:47.266518 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:11:47.266518 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:11:47.266518 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:11:47.266518 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:11:47.266518 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:11:47.266518 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:11:47.266518 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:11:47.266518 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:11:47.266518 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:11:47.266518 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:11:47.266518 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:11:47.266518 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:11:47.266518 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:11:47.266518 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:11:47.266518 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:11:47.266518 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:11:47.266518 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:11:47.268142 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:11:47.268142 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:11:47.268142 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:11:47.268142 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:11:47.271949 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 623/1242] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:11:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:11:47.272788 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad6943-027f-4f50-933e-8be3fab3d0bd None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:47.370142 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:11:47.377484 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad6943-027f-4f50-933e-8be3fab3d0bd None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:47.412161 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6386ee-b906-4cb7-8c11-65b233537ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:47.412824 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6386ee-b906-4cb7-8c11-65b233537ccf None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:47.413106 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6386ee-b906-4cb7-8c11-65b233537ccf None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:47.413382 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6386ee-b906-4cb7-8c11-65b233537ccf None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:47.414096 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6386ee-b906-4cb7-8c11-65b233537ccf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:11:47.414403 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6386ee-b906-4cb7-8c11-65b233537ccf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:47.415747 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6386ee-b906-4cb7-8c11-65b233537ccf None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:47.427343 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 620/1243] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:11:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:11:47.433209 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb39fe5-c101-49c7-905c-198e5c40944e None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:47.521425 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:11:47.544833 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb39fe5-c101-49c7-905c-198e5c40944e None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:47.581165 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640c330-4208-4081-98ad-9353942fec99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:47.581959 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640c330-4208-4081-98ad-9353942fec99 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:47.582238 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640c330-4208-4081-98ad-9353942fec99 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:47.582511 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640c330-4208-4081-98ad-9353942fec99 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:47.589255 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2640c330-4208-4081-98ad-9353942fec99 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:47.590675 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2640c330-4208-4081-98ad-9353942fec99 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:47.604101 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-2640c330-4208-4081-98ad-9353942fec99 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:11:47.604101 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:11:47.604101 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:11:47.604101 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:11:47.604101 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:11:47.604101 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:11:47.604101 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:11:47.604101 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:11:47.604101 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:11:47.604101 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:11:47.604101 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:11:47.604101 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:11:47.604101 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 20:11:47.604101 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 20:11:47.604101 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 20:11:47.605697 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 20:11:47.605697 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:11:47.605697 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:11:47.605697 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:11:47.605697 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:11:47.605697 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:11:47.605697 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:11:47.605697 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:11:47.605697 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:11:47.605697 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:11:47.605697 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:11:47.605697 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:11:47.605697 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:11:47.605697 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:11:47.605697 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:11:47.605697 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:11:47.605697 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:11:47.607084 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 20:11:47.607084 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 20:11:47.607084 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 20:11:47.607084 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 20:11:47.607084 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 20:11:47.607084 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 20:11:47.607084 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:11:47.607084 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:11:47.610373 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 624/1244] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jun 21 20:11:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:11:47.611610 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6386ee-b906-4cb7-8c11-65b233537ccf None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:47.726961 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6386ee-b906-4cb7-8c11-65b233537ccf None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:47.762429 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7ea7a8-9bed-4ecd-b2b0-3842c68275a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:47.763138 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ea7a8-9bed-4ecd-b2b0-3842c68275a4 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:47.763516 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ea7a8-9bed-4ecd-b2b0-3842c68275a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:47.763771 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ea7a8-9bed-4ecd-b2b0-3842c68275a4 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:47.764597 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7ea7a8-9bed-4ecd-b2b0-3842c68275a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:11:47.764899 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7ea7a8-9bed-4ecd-b2b0-3842c68275a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:47.766295 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7ea7a8-9bed-4ecd-b2b0-3842c68275a4 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:47.779476 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 621/1245] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jun 21 20:11:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:11:47.785714 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640c330-4208-4081-98ad-9353942fec99 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:47.906384 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640c330-4208-4081-98ad-9353942fec99 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:47.944046 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c2eff5-bca5-4684-997c-92070479f7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:47.944738 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2eff5-bca5-4684-997c-92070479f7f1 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:47.945035 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2eff5-bca5-4684-997c-92070479f7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:47.945314 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2eff5-bca5-4684-997c-92070479f7f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:47.946190 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c2eff5-bca5-4684-997c-92070479f7f1 None admin] RBAC: Adding query filter params (role.id=a4929ef60a294190b2d59e8d61e05063, scope.project.id=4dcb71ef7b6e49148edd61a1eb8da7bb, user.id=a59294bff27c4b3f8aaeeab48ed35a0e) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:11:47.946510 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c2eff5-bca5-4684-997c-92070479f7f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:47.947949 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c2eff5-bca5-4684-997c-92070479f7f1 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:47.953902 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 625/1246] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jun 21 20:11:47 2022] GET /identity/v3/role_assignments?user.id=a59294bff27c4b3f8aaeeab48ed35a0e&scope.project.id=4dcb71ef7b6e49148edd61a1eb8da7bb&role.id=a4929ef60a294190b2d59e8d61e05063 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:11:50.135665 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebb098-1a93-44fe-9664-a90952cd892b None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:50.136244 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebb098-1a93-44fe-9664-a90952cd892b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:50.136244 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebb098-1a93-44fe-9664-a90952cd892b None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:50.138126 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 622/1247] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:11:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:11:50.143754 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2423e3-bf03-4696-ba86-1358805b8825 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:50.144310 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2423e3-bf03-4696-ba86-1358805b8825 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:50.144428 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2423e3-bf03-4696-ba86-1358805b8825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:50.149457 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:11:50.162170 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-8b2423e3-bf03-4696-ba86-1358805b8825 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:11:50.163421 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-8b2423e3-bf03-4696-ba86-1358805b8825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:11:50.235734 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 626/1248] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:11:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 20:11:50.263756 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ebb098-1a93-44fe-9664-a90952cd892b None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:50.285130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:11:50.384530 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ebb098-1a93-44fe-9664-a90952cd892b None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:50.426919 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db64dc-0874-440e-9826-9c1822062829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:50.427621 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db64dc-0874-440e-9826-9c1822062829 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:50.427905 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db64dc-0874-440e-9826-9c1822062829 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:50.428232 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db64dc-0874-440e-9826-9c1822062829 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:50.440542 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39db64dc-0874-440e-9826-9c1822062829 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:11:50.448748 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-39db64dc-0874-440e-9826-9c1822062829 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 20:11:50.448748 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:11:50.448748 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:11:50.448748 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:11:50.448748 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:11:50.448748 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:11:50.448748 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:11:50.448748 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:11:50.448748 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:11:50.448748 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:11:50.448748 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:11:50.448748 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:11:50.448748 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:11:50.448748 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:11:50.448748 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:11:50.448748 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:11:50.449777 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:11:50.449777 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:11:50.449777 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:11:50.449777 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:11:50.449777 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:11:50.449777 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:11:50.449777 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:11:50.449777 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:11:50.449777 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:11:50.449777 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:11:50.449777 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:11:50.449777 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:11:50.449777 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:11:50.449777 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:11:50.449777 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:11:50.449777 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:11:50.450613 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:11:50.450613 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:11:50.450613 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:11:50.450613 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:11:50.450613 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:11:50.450613 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:11:50.450613 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:11:50.450613 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:11:50.450613 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:11:50.450613 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:11:50.450613 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 20:11:50.450613 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:11:50.450613 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 623/1249] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jun 21 20:11:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:11:50.457402 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2423e3-bf03-4696-ba86-1358805b8825 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:50.575218 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2423e3-bf03-4696-ba86-1358805b8825 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:50.609078 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:11:50.614824 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa6b31-30b2-473a-bee9-ad98c501001e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:50.615509 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa6b31-30b2-473a-bee9-ad98c501001e None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:50.615820 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa6b31-30b2-473a-bee9-ad98c501001e None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:50.616162 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa6b31-30b2-473a-bee9-ad98c501001e None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:50.617045 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfa6b31-30b2-473a-bee9-ad98c501001e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:11:50.617401 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfa6b31-30b2-473a-bee9-ad98c501001e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:50.618949 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfa6b31-30b2-473a-bee9-ad98c501001e None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:50.628794 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 627/1250] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:11:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:11:50.635092 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db64dc-0874-440e-9826-9c1822062829 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:50.733322 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:11:50.761614 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db64dc-0874-440e-9826-9c1822062829 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:50.799081 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b1de7-3621-4304-8be9-fbb14429d384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:50.800056 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b1de7-3621-4304-8be9-fbb14429d384 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:50.800382 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b1de7-3621-4304-8be9-fbb14429d384 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:50.800686 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b1de7-3621-4304-8be9-fbb14429d384 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:50.813330 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895b1de7-3621-4304-8be9-fbb14429d384 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:50.815623 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895b1de7-3621-4304-8be9-fbb14429d384 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:50.836341 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-895b1de7-3621-4304-8be9-fbb14429d384 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:11:50.836341 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:11:50.836341 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:11:50.836341 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:11:50.836341 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:11:50.836341 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:11:50.836341 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:11:50.836341 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:11:50.836341 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:11:50.836341 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:11:50.836341 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:11:50.836341 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:11:50.836341 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:11:50.836341 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:11:50.836341 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:11:50.837411 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:11:50.837411 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:11:50.837411 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:11:50.837411 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:11:50.837411 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:11:50.837411 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:11:50.837411 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:11:50.837411 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:11:50.837411 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:11:50.837411 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:11:50.837411 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:11:50.837411 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:11:50.837411 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:11:50.837411 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:11:50.837411 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:11:50.837411 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:11:50.837411 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:11:50.838308 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:11:50.838308 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:11:50.838308 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:11:50.838308 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:11:50.838308 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 624/1251] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:11:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:11:50.843789 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa6b31-30b2-473a-bee9-ad98c501001e None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:50.958407 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa6b31-30b2-473a-bee9-ad98c501001e None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:50.996678 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf31b6d8-4b13-408a-a11b-3946f4bbf455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:50.997366 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31b6d8-4b13-408a-a11b-3946f4bbf455 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:50.997712 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31b6d8-4b13-408a-a11b-3946f4bbf455 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:50.998055 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31b6d8-4b13-408a-a11b-3946f4bbf455 None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:50.998814 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf31b6d8-4b13-408a-a11b-3946f4bbf455 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:11:50.999133 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf31b6d8-4b13-408a-a11b-3946f4bbf455 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:51.000751 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf31b6d8-4b13-408a-a11b-3946f4bbf455 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:51.014082 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 628/1252] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:11:51.020138 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b1de7-3621-4304-8be9-fbb14429d384 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:51.130923 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b1de7-3621-4304-8be9-fbb14429d384 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:51.160262 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:11:51.171271 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1f911e-58bf-4a1a-a5f1-161fedef0f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:51.172158 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f911e-58bf-4a1a-a5f1-161fedef0f9e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:51.172443 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f911e-58bf-4a1a-a5f1-161fedef0f9e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:51.172720 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f911e-58bf-4a1a-a5f1-161fedef0f9e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:51.180860 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1f911e-58bf-4a1a-a5f1-161fedef0f9e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:51.182292 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1f911e-58bf-4a1a-a5f1-161fedef0f9e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:51.199122 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-cf1f911e-58bf-4a1a-a5f1-161fedef0f9e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 21 20:11:51.199122 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:11:51.199122 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:11:51.199122 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:11:51.199122 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:11:51.199122 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:11:51.199122 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:11:51.199122 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:11:51.199122 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:11:51.199122 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:11:51.199122 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:11:51.199122 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:11:51.199122 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 20:11:51.199122 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 20:11:51.199122 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 20:11:51.199122 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 20:11:51.200319 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:11:51.200319 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:11:51.200319 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 20:11:51.200319 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:11:51.200319 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 20:11:51.200319 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:11:51.200319 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:11:51.200319 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:11:51.200319 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:11:51.200319 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:11:51.200319 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:11:51.200319 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:11:51.200319 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:11:51.200319 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:11:51.200319 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:11:51.200319 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:11:51.200319 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:11:51.200319 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:11:51.201477 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:11:51.201477 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:11:51.201477 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 20:11:51.201477 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 20:11:51.201477 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 20:11:51.201477 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 20:11:51.201477 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 20:11:51.201477 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 20:11:51.201477 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 21 20:11:51.201477 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:11:51.206584 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 625/1253] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:11:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:11:51.207674 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf31b6d8-4b13-408a-a11b-3946f4bbf455 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:51.269511 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:11:51.317937 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf31b6d8-4b13-408a-a11b-3946f4bbf455 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:51.354392 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aedc57-239d-44b6-b5da-a6c157f84ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:51.355064 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aedc57-239d-44b6-b5da-a6c157f84ecb None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:51.355352 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aedc57-239d-44b6-b5da-a6c157f84ecb None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:51.355877 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aedc57-239d-44b6-b5da-a6c157f84ecb None admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:51.356751 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aedc57-239d-44b6-b5da-a6c157f84ecb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:11:51.357064 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aedc57-239d-44b6-b5da-a6c157f84ecb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:51.358474 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aedc57-239d-44b6-b5da-a6c157f84ecb None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:51.375944 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 629/1254] 10.222.0.15 () {56 vars in 1143 bytes} [Tue Jun 21 20:11:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:11:51.383373 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1f911e-58bf-4a1a-a5f1-161fedef0f9e None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:51.493963 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1f911e-58bf-4a1a-a5f1-161fedef0f9e None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:51.527743 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c268f9ed-274d-48ed-9d9e-4660cb99e0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:51.528350 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268f9ed-274d-48ed-9d9e-4660cb99e0d2 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:51.528629 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268f9ed-274d-48ed-9d9e-4660cb99e0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:51.528907 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268f9ed-274d-48ed-9d9e-4660cb99e0d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:51.596785 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:11:51.612389 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c268f9ed-274d-48ed-9d9e-4660cb99e0d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:51.613983 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c268f9ed-274d-48ed-9d9e-4660cb99e0d2 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:51.739247 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 626/1255] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:11:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 21 20:11:51.745290 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aedc57-239d-44b6-b5da-a6c157f84ecb None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:51.851712 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aedc57-239d-44b6-b5da-a6c157f84ecb None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:51.866751 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:11:51.889397 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f197d899-6e76-4db1-ae2e-38e7a60bb062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:51.890410 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197d899-6e76-4db1-ae2e-38e7a60bb062 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:51.890782 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197d899-6e76-4db1-ae2e-38e7a60bb062 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:51.891072 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197d899-6e76-4db1-ae2e-38e7a60bb062 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:51.903185 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f197d899-6e76-4db1-ae2e-38e7a60bb062 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:51.904769 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f197d899-6e76-4db1-ae2e-38e7a60bb062 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:51.925326 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-f197d899-6e76-4db1-ae2e-38e7a60bb062 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:11:51.925326 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:11:51.925326 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:11:51.925326 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:11:51.925326 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:11:51.925326 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:11:51.925326 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:11:51.925326 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:11:51.925326 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:11:51.925326 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:11:51.925326 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:11:51.925326 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:11:51.925326 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:11:51.925326 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:11:51.925326 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:11:51.926260 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:11:51.926260 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:11:51.926260 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:11:51.926260 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:11:51.926260 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:11:51.926260 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:11:51.926260 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:11:51.926260 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:11:51.926260 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:11:51.926260 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:11:51.926260 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:11:51.926260 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:11:51.926260 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:11:51.926260 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:11:51.926260 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:11:51.926260 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:11:51.926260 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:11:51.931894 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:11:51.931894 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:11:51.931894 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:11:51.931894 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:11:51.931894 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 630/1256] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:11:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:11:51.933255 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c268f9ed-274d-48ed-9d9e-4660cb99e0d2 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:52.025087 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:11:52.039112 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c268f9ed-274d-48ed-9d9e-4660cb99e0d2 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:52.076538 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eba363-88e6-4036-a42d-76584a7b7cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:52.077390 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eba363-88e6-4036-a42d-76584a7b7cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:52.077736 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eba363-88e6-4036-a42d-76584a7b7cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:52.078092 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eba363-88e6-4036-a42d-76584a7b7cc8 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:52.079026 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eba363-88e6-4036-a42d-76584a7b7cc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:11:52.079343 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eba363-88e6-4036-a42d-76584a7b7cc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:52.080867 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eba363-88e6-4036-a42d-76584a7b7cc8 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:52.093214 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 627/1257] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:11:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:11:52.099338 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f197d899-6e76-4db1-ae2e-38e7a60bb062 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:52.213606 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f197d899-6e76-4db1-ae2e-38e7a60bb062 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:52.249952 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a19d6-e29c-4475-95a7-4a59e0d69589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:52.250760 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a19d6-e29c-4475-95a7-4a59e0d69589 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:52.251047 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a19d6-e29c-4475-95a7-4a59e0d69589 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:52.251323 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a19d6-e29c-4475-95a7-4a59e0d69589 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:52.258478 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5a19d6-e29c-4475-95a7-4a59e0d69589 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:52.260022 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5a19d6-e29c-4475-95a7-4a59e0d69589 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:52.274455 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-ba5a19d6-e29c-4475-95a7-4a59e0d69589 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:11:52.274455 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:11:52.274455 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:11:52.274455 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:11:52.274455 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:11:52.274455 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:11:52.274455 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:11:52.274455 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:11:52.274455 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:11:52.274455 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:11:52.274455 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:11:52.274455 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:11:52.274455 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 20:11:52.274455 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 20:11:52.274455 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 20:11:52.275557 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 20:11:52.275557 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:11:52.275557 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:11:52.275557 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:11:52.275557 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:11:52.275557 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:11:52.275557 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:11:52.275557 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:11:52.275557 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:11:52.275557 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:11:52.275557 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:11:52.275557 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:11:52.275557 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:11:52.275557 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:11:52.275557 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:11:52.275557 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:11:52.275557 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:11:52.276658 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 20:11:52.276658 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 20:11:52.276658 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 20:11:52.276658 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 20:11:52.276658 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 20:11:52.276658 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 20:11:52.276658 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:11:52.276658 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:11:52.276658 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 631/1258] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jun 21 20:11:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 20:11:52.281478 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eba363-88e6-4036-a42d-76584a7b7cc8 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:52.390691 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eba363-88e6-4036-a42d-76584a7b7cc8 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:52.425742 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963af2ec-0510-47e6-ba60-420fb50e9d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:52.426446 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963af2ec-0510-47e6-ba60-420fb50e9d0d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:52.426732 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963af2ec-0510-47e6-ba60-420fb50e9d0d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:52.427012 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963af2ec-0510-47e6-ba60-420fb50e9d0d None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:52.427826 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963af2ec-0510-47e6-ba60-420fb50e9d0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:11:52.428173 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963af2ec-0510-47e6-ba60-420fb50e9d0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:52.429653 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963af2ec-0510-47e6-ba60-420fb50e9d0d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:52.443609 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 628/1259] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jun 21 20:11:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:11:52.449864 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a19d6-e29c-4475-95a7-4a59e0d69589 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:52.477349 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:11:52.556506 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a19d6-e29c-4475-95a7-4a59e0d69589 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:52.591855 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bedabe9-2ff8-4f77-8ad9-d39d15abec32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:52.592553 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedabe9-2ff8-4f77-8ad9-d39d15abec32 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:52.592841 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedabe9-2ff8-4f77-8ad9-d39d15abec32 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:52.593122 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedabe9-2ff8-4f77-8ad9-d39d15abec32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:52.593966 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bedabe9-2ff8-4f77-8ad9-d39d15abec32 None admin] RBAC: Adding query filter params (role.id=1f5332f48d9e4c2aac866d0d546c94d5, scope.project.id=4dcb71ef7b6e49148edd61a1eb8da7bb, user.id=a59294bff27c4b3f8aaeeab48ed35a0e) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:11:52.594284 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bedabe9-2ff8-4f77-8ad9-d39d15abec32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:52.596306 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bedabe9-2ff8-4f77-8ad9-d39d15abec32 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:52.602429 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 632/1260] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jun 21 20:11:52 2022] GET /identity/v3/role_assignments?user.id=a59294bff27c4b3f8aaeeab48ed35a0e&scope.project.id=4dcb71ef7b6e49148edd61a1eb8da7bb&role.id=1f5332f48d9e4c2aac866d0d546c94d5 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:11:54.588783 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5f76b-075e-41e6-8bf1-c1abcaa292e3 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:54.589355 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5f76b-075e-41e6-8bf1-c1abcaa292e3 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:54.589355 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5f76b-075e-41e6-8bf1-c1abcaa292e3 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:54.590718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 629/1261] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:11:54.596793 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13648c70-26ad-4bab-bdfa-475908f06f3a None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:54.597187 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13648c70-26ad-4bab-bdfa-475908f06f3a None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:54.597368 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13648c70-26ad-4bab-bdfa-475908f06f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:54.614835 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-13648c70-26ad-4bab-bdfa-475908f06f3a None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:11:54.616065 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-13648c70-26ad-4bab-bdfa-475908f06f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:11:54.696279 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 633/1262] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:11:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 20:11:54.721325 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e5f76b-075e-41e6-8bf1-c1abcaa292e3 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:54.732343 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:11:54.819983 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e5f76b-075e-41e6-8bf1-c1abcaa292e3 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:54.853072 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35d612-068a-41e3-9540-7e2cabebcec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:54.853799 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35d612-068a-41e3-9540-7e2cabebcec1 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:54.854083 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35d612-068a-41e3-9540-7e2cabebcec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:54.854359 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35d612-068a-41e3-9540-7e2cabebcec1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:54.864581 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd35d612-068a-41e3-9540-7e2cabebcec1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:11:54.872151 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-fd35d612-068a-41e3-9540-7e2cabebcec1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 20:11:54.872151 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:11:54.872151 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:11:54.872151 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:11:54.872151 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:11:54.872151 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:11:54.872151 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:11:54.872151 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:11:54.872151 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:11:54.872151 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:11:54.872151 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:11:54.872151 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:11:54.872151 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:11:54.872151 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:11:54.872151 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:11:54.872151 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:11:54.873242 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:11:54.873242 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:11:54.873242 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:11:54.873242 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:11:54.873242 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:11:54.873242 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:11:54.873242 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:11:54.873242 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:11:54.873242 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:11:54.873242 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:11:54.873242 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:11:54.873242 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:11:54.873242 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:11:54.873242 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:11:54.873242 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:11:54.873242 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:11:54.874291 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:11:54.874291 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:11:54.874291 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:11:54.874291 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:11:54.874291 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:11:54.874291 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:11:54.874291 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:11:54.874291 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:11:54.874291 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:11:54.874291 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:11:54.874291 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 20:11:54.874291 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:11:54.874291 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 630/1263] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jun 21 20:11:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:11:54.880070 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13648c70-26ad-4bab-bdfa-475908f06f3a None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:54.898462 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:11:54.976876 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13648c70-26ad-4bab-bdfa-475908f06f3a None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:55.010128 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9341b722-86e4-47c5-8e46-7dc88e5e8055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:55.010792 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341b722-86e4-47c5-8e46-7dc88e5e8055 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:55.011079 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341b722-86e4-47c5-8e46-7dc88e5e8055 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:55.011361 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341b722-86e4-47c5-8e46-7dc88e5e8055 None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:55.012136 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9341b722-86e4-47c5-8e46-7dc88e5e8055 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:11:55.012449 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9341b722-86e4-47c5-8e46-7dc88e5e8055 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:55.013829 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9341b722-86e4-47c5-8e46-7dc88e5e8055 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:55.022303 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 634/1264] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:11:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:11:55.027806 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35d612-068a-41e3-9540-7e2cabebcec1 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:55.091462 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:11:55.124350 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35d612-068a-41e3-9540-7e2cabebcec1 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:55.157182 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a441cd2-447b-466f-8f9e-22d3a4e395f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:55.158461 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a441cd2-447b-466f-8f9e-22d3a4e395f6 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:55.158742 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a441cd2-447b-466f-8f9e-22d3a4e395f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:55.159019 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a441cd2-447b-466f-8f9e-22d3a4e395f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:55.169318 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a441cd2-447b-466f-8f9e-22d3a4e395f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:55.170746 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a441cd2-447b-466f-8f9e-22d3a4e395f6 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:55.187946 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-1a441cd2-447b-466f-8f9e-22d3a4e395f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:11:55.187946 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:11:55.187946 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:11:55.187946 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:11:55.187946 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:11:55.187946 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:11:55.187946 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:11:55.187946 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:11:55.187946 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:11:55.187946 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:11:55.187946 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:11:55.187946 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:11:55.187946 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:11:55.187946 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:11:55.187946 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:11:55.188951 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:11:55.188951 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:11:55.188951 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:11:55.188951 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:11:55.188951 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:11:55.188951 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:11:55.188951 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:11:55.188951 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:11:55.188951 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:11:55.188951 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:11:55.188951 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:11:55.188951 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:11:55.188951 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:11:55.188951 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:11:55.188951 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:11:55.188951 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:11:55.188951 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:11:55.190062 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:11:55.190062 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:11:55.190062 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:11:55.190062 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:11:55.190062 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 631/1265] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:11:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:11:55.194644 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9341b722-86e4-47c5-8e46-7dc88e5e8055 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:55.274049 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:11:55.293039 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9341b722-86e4-47c5-8e46-7dc88e5e8055 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:55.324573 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796f6648-2729-4ee0-930a-e915cbd46b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:55.325225 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f6648-2729-4ee0-930a-e915cbd46b84 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:55.325512 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f6648-2729-4ee0-930a-e915cbd46b84 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:55.325791 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f6648-2729-4ee0-930a-e915cbd46b84 None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:55.326504 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796f6648-2729-4ee0-930a-e915cbd46b84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:11:55.326814 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796f6648-2729-4ee0-930a-e915cbd46b84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:55.328194 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796f6648-2729-4ee0-930a-e915cbd46b84 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:55.340062 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 635/1266] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:11:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:11:55.345954 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a441cd2-447b-466f-8f9e-22d3a4e395f6 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:55.442854 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a441cd2-447b-466f-8f9e-22d3a4e395f6 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:55.461737 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:11:55.475909 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae04269-7809-428b-8f1f-d96efb703590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:55.476719 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae04269-7809-428b-8f1f-d96efb703590 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:55.477000 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae04269-7809-428b-8f1f-d96efb703590 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:55.477273 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae04269-7809-428b-8f1f-d96efb703590 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:55.484718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae04269-7809-428b-8f1f-d96efb703590 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:55.486653 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae04269-7809-428b-8f1f-d96efb703590 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:55.500374 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-aae04269-7809-428b-8f1f-d96efb703590 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 21 20:11:55.500374 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:11:55.500374 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:11:55.500374 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:11:55.500374 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:11:55.500374 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:11:55.500374 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:11:55.500374 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:11:55.500374 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:11:55.500374 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:11:55.500374 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:11:55.500374 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:11:55.500374 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 20:11:55.500374 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 20:11:55.500374 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 20:11:55.500374 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 20:11:55.502019 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:11:55.502019 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:11:55.502019 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 20:11:55.502019 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:11:55.502019 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 20:11:55.502019 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:11:55.502019 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:11:55.502019 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:11:55.502019 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:11:55.502019 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:11:55.502019 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:11:55.502019 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:11:55.502019 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:11:55.502019 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:11:55.502019 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:11:55.502019 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:11:55.502019 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:11:55.502019 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:11:55.503017 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:11:55.503017 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:11:55.503017 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 20:11:55.503017 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 20:11:55.503017 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 20:11:55.503017 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 20:11:55.503017 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 20:11:55.503017 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 20:11:55.503017 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 21 20:11:55.503017 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:11:55.503017 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 632/1267] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:11:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:11:55.507603 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796f6648-2729-4ee0-930a-e915cbd46b84 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:55.602515 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796f6648-2729-4ee0-930a-e915cbd46b84 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:55.635341 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22924da-f106-4e02-b4e9-5747b592df46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:55.636013 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22924da-f106-4e02-b4e9-5747b592df46 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:55.636297 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22924da-f106-4e02-b4e9-5747b592df46 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:55.636576 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22924da-f106-4e02-b4e9-5747b592df46 None admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:55.637454 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22924da-f106-4e02-b4e9-5747b592df46 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:11:55.637766 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22924da-f106-4e02-b4e9-5747b592df46 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:55.639169 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22924da-f106-4e02-b4e9-5747b592df46 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:55.648874 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:11:55.658340 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 636/1268] 10.222.0.15 () {56 vars in 1143 bytes} [Tue Jun 21 20:11:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:11:55.664226 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae04269-7809-428b-8f1f-d96efb703590 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:55.761750 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae04269-7809-428b-8f1f-d96efb703590 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:55.793994 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21826421-4374-4f2d-8cf4-80778956f53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:55.794786 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21826421-4374-4f2d-8cf4-80778956f53d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:55.795073 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21826421-4374-4f2d-8cf4-80778956f53d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:55.795353 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21826421-4374-4f2d-8cf4-80778956f53d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:55.806249 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21826421-4374-4f2d-8cf4-80778956f53d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:55.807688 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21826421-4374-4f2d-8cf4-80778956f53d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:55.824684 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-21826421-4374-4f2d-8cf4-80778956f53d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:11:55.824684 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:11:55.824684 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:11:55.824684 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:11:55.824684 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:11:55.824684 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:11:55.824684 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:11:55.824684 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:11:55.824684 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:11:55.824684 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:11:55.824684 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:11:55.824684 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:11:55.824684 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:11:55.824684 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:11:55.824684 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:11:55.825711 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:11:55.825711 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:11:55.825711 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:11:55.825711 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:11:55.825711 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:11:55.825711 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:11:55.825711 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:11:55.825711 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:11:55.825711 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:11:55.825711 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:11:55.825711 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:11:55.825711 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:11:55.825711 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:11:55.825711 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:11:55.825711 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:11:55.825711 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:11:55.825711 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:11:55.826829 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:11:55.826829 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:11:55.826829 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:11:55.826829 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:11:55.826829 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 633/1269] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:11:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:11:55.832136 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22924da-f106-4e02-b4e9-5747b592df46 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:55.926483 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22924da-f106-4e02-b4e9-5747b592df46 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:55.959186 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387ebde7-a330-4b49-9fc5-d8247c130876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:55.959830 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ebde7-a330-4b49-9fc5-d8247c130876 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:55.960140 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ebde7-a330-4b49-9fc5-d8247c130876 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:55.960417 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ebde7-a330-4b49-9fc5-d8247c130876 None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:55.961135 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387ebde7-a330-4b49-9fc5-d8247c130876 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:11:55.961444 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387ebde7-a330-4b49-9fc5-d8247c130876 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:55.962790 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387ebde7-a330-4b49-9fc5-d8247c130876 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:55.973576 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 637/1270] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:11:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:11:55.979227 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21826421-4374-4f2d-8cf4-80778956f53d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:56.011046 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:11:56.077532 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21826421-4374-4f2d-8cf4-80778956f53d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:56.109115 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1aab08-edd9-4a4d-a946-7c671cadc5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:56.109891 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1aab08-edd9-4a4d-a946-7c671cadc5b9 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:56.110175 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1aab08-edd9-4a4d-a946-7c671cadc5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:56.110453 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1aab08-edd9-4a4d-a946-7c671cadc5b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:56.117387 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1aab08-edd9-4a4d-a946-7c671cadc5b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:56.118820 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1aab08-edd9-4a4d-a946-7c671cadc5b9 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:56.133077 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-2a1aab08-edd9-4a4d-a946-7c671cadc5b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:11:56.133077 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:11:56.133077 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:11:56.133077 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:11:56.133077 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:11:56.133077 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:11:56.133077 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:11:56.133077 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:11:56.133077 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:11:56.133077 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:11:56.133077 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:11:56.133077 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:11:56.133077 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 20:11:56.133077 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 20:11:56.133077 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 20:11:56.134130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 20:11:56.134130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:11:56.134130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:11:56.134130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:11:56.134130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:11:56.134130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:11:56.134130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:11:56.134130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:11:56.134130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:11:56.134130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:11:56.134130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:11:56.134130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:11:56.134130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:11:56.134130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:11:56.134130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:11:56.134130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:11:56.134130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:11:56.135058 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 20:11:56.135058 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 20:11:56.135058 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 20:11:56.135058 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 20:11:56.135058 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 20:11:56.135058 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 20:11:56.135058 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:11:56.135058 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:11:56.135058 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 634/1271] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jun 21 20:11:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:11:56.140225 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387ebde7-a330-4b49-9fc5-d8247c130876 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:56.197167 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:11:56.236821 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387ebde7-a330-4b49-9fc5-d8247c130876 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:56.268706 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d305b5c-d36a-4b77-be63-4e4f12b61b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:56.269350 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d305b5c-d36a-4b77-be63-4e4f12b61b02 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:56.269633 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d305b5c-d36a-4b77-be63-4e4f12b61b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:56.269907 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d305b5c-d36a-4b77-be63-4e4f12b61b02 None admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:56.270679 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d305b5c-d36a-4b77-be63-4e4f12b61b02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:11:56.270986 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d305b5c-d36a-4b77-be63-4e4f12b61b02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:56.272427 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d305b5c-d36a-4b77-be63-4e4f12b61b02 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:56.283900 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 638/1272] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jun 21 20:11:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:11:56.289790 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1aab08-edd9-4a4d-a946-7c671cadc5b9 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:56.379156 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:11:56.388020 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1aab08-edd9-4a4d-a946-7c671cadc5b9 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:56.420849 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203198dd-d720-4d48-80b6-bb799254a69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:56.421732 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203198dd-d720-4d48-80b6-bb799254a69c None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:56.422022 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203198dd-d720-4d48-80b6-bb799254a69c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:56.422305 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203198dd-d720-4d48-80b6-bb799254a69c None admin] PATH_INFO: `/v3/projects/4dcb71ef7b6e49148edd61a1eb8da7bb/users/a59294bff27c4b3f8aaeeab48ed35a0e/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:56.424890 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203198dd-d720-4d48-80b6-bb799254a69c None admin] RBAC: Authorizing `identity:create_grant(project_id=4dcb71ef7b6e49148edd61a1eb8da7bb, user_id=a59294bff27c4b3f8aaeeab48ed35a0e, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:56.426310 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203198dd-d720-4d48-80b6-bb799254a69c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:56.438746 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 635/1273] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Jun 21 20:11:56 2022] PUT /identity/v3/projects/4dcb71ef7b6e49148edd61a1eb8da7bb/users/a59294bff27c4b3f8aaeeab48ed35a0e/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:11:58.446634 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d208fb-dd73-40c2-bb4e-43b2a15f678a None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:58.447162 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d208fb-dd73-40c2-bb4e-43b2a15f678a None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:58.447270 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d208fb-dd73-40c2-bb4e-43b2a15f678a None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:58.448600 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 639/1274] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:11:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:11:58.453711 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f945fb-f564-4add-b99b-73f7dec28db0 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:58.454125 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f945fb-f564-4add-b99b-73f7dec28db0 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:58.454265 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f945fb-f564-4add-b99b-73f7dec28db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:58.471575 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-67f945fb-f564-4add-b99b-73f7dec28db0 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:11:58.472796 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-67f945fb-f564-4add-b99b-73f7dec28db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:11:58.537358 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 636/1275] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:11:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 20:11:58.560873 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d208fb-dd73-40c2-bb4e-43b2a15f678a None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:58.666467 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d208fb-dd73-40c2-bb4e-43b2a15f678a None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:58.683720 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:11:58.700410 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5069344-2d10-4163-98ad-827455b63684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:58.701138 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5069344-2d10-4163-98ad-827455b63684 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:58.701426 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5069344-2d10-4163-98ad-827455b63684 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:58.701704 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5069344-2d10-4163-98ad-827455b63684 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:58.711420 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5069344-2d10-4163-98ad-827455b63684 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 20:11:58.718946 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-a5069344-2d10-4163-98ad-827455b63684 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 20:11:58.718946 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:11:58.718946 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:11:58.718946 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:11:58.718946 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:11:58.718946 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:11:58.718946 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:11:58.718946 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:11:58.718946 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:11:58.718946 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:11:58.718946 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:11:58.718946 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:11:58.718946 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 20:11:58.718946 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 20:11:58.718946 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 20:11:58.718946 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 20:11:58.720551 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 20:11:58.720551 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 20:11:58.720551 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 20:11:58.720551 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 20:11:58.720551 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:11:58.720551 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:11:58.720551 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:11:58.720551 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:11:58.720551 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:11:58.720551 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:11:58.720551 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:11:58.720551 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:11:58.720551 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:11:58.720551 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:11:58.720551 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:11:58.720551 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:11:58.721768 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:11:58.721768 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:11:58.721768 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:11:58.721768 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:11:58.721768 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 20:11:58.721768 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 20:11:58.721768 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 20:11:58.721768 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 20:11:58.721768 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 20:11:58.721768 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 20:11:58.721768 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 20:11:58.721768 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:11:58.721768 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 640/1276] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jun 21 20:11:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:11:58.726563 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f945fb-f564-4add-b99b-73f7dec28db0 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:58.804229 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:11:58.823448 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f945fb-f564-4add-b99b-73f7dec28db0 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:58.856528 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b9223c-ad78-480b-b75c-487051a45d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:58.857207 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9223c-ad78-480b-b75c-487051a45d1c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:58.857458 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9223c-ad78-480b-b75c-487051a45d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:58.857731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9223c-ad78-480b-b75c-487051a45d1c None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:58.858467 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b9223c-ad78-480b-b75c-487051a45d1c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:11:58.858774 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b9223c-ad78-480b-b75c-487051a45d1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:58.860147 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b9223c-ad78-480b-b75c-487051a45d1c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:58.868685 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 637/1277] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jun 21 20:11:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:11:58.874207 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5069344-2d10-4163-98ad-827455b63684 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:58.972482 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5069344-2d10-4163-98ad-827455b63684 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:59.005481 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd68d0d-4e22-4740-ab4f-7868efe5ee60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:59.006261 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd68d0d-4e22-4740-ab4f-7868efe5ee60 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:59.006549 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd68d0d-4e22-4740-ab4f-7868efe5ee60 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:59.006829 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd68d0d-4e22-4740-ab4f-7868efe5ee60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:59.017690 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd68d0d-4e22-4740-ab4f-7868efe5ee60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:59.019153 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd68d0d-4e22-4740-ab4f-7868efe5ee60 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:59.036347 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-3dd68d0d-4e22-4740-ab4f-7868efe5ee60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:11:59.036347 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:11:59.036347 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:11:59.036347 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:11:59.036347 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:11:59.036347 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:11:59.036347 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:11:59.036347 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:11:59.036347 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:11:59.036347 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:11:59.036347 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:11:59.036347 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:11:59.036347 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:11:59.036347 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:11:59.036347 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:11:59.037390 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:11:59.037390 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:11:59.037390 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:11:59.037390 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:11:59.037390 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:11:59.037390 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:11:59.037390 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:11:59.037390 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:11:59.037390 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:11:59.037390 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:11:59.037390 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:11:59.037390 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:11:59.037390 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:11:59.037390 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:11:59.037390 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:11:59.037390 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:11:59.037390 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:11:59.038487 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:11:59.038487 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:11:59.038487 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:11:59.038487 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:11:59.038487 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 641/1278] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:11:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:11:59.043120 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b9223c-ad78-480b-b75c-487051a45d1c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:59.137583 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b9223c-ad78-480b-b75c-487051a45d1c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:59.170235 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803687c2-3098-4230-9da6-5f2227731ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:59.170876 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803687c2-3098-4230-9da6-5f2227731ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:59.171159 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803687c2-3098-4230-9da6-5f2227731ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:59.171437 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803687c2-3098-4230-9da6-5f2227731ca1 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:59.172178 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803687c2-3098-4230-9da6-5f2227731ca1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:11:59.172484 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803687c2-3098-4230-9da6-5f2227731ca1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:59.174009 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803687c2-3098-4230-9da6-5f2227731ca1 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:59.185169 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 638/1279] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:11:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:11:59.190517 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd68d0d-4e22-4740-ab4f-7868efe5ee60 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:59.221372 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:11:59.287855 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd68d0d-4e22-4740-ab4f-7868efe5ee60 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:59.319165 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1eaf30-d9b5-4757-bfc7-5a319fe069e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:59.319974 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1eaf30-d9b5-4757-bfc7-5a319fe069e0 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:59.320263 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1eaf30-d9b5-4757-bfc7-5a319fe069e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:59.320540 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1eaf30-d9b5-4757-bfc7-5a319fe069e0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:59.327780 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1eaf30-d9b5-4757-bfc7-5a319fe069e0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:59.329717 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1eaf30-d9b5-4757-bfc7-5a319fe069e0 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:59.343504 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-ca1eaf30-d9b5-4757-bfc7-5a319fe069e0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 21 20:11:59.343504 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:11:59.343504 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:11:59.343504 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:11:59.343504 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:11:59.343504 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:11:59.343504 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:11:59.343504 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:11:59.343504 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:11:59.343504 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:11:59.343504 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:11:59.343504 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:11:59.343504 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 20:11:59.343504 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 20:11:59.343504 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 20:11:59.343504 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 20:11:59.344682 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:11:59.344682 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:11:59.344682 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 20:11:59.344682 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:11:59.344682 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 20:11:59.344682 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 20:11:59.344682 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:11:59.344682 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:11:59.344682 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:11:59.344682 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:11:59.344682 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:11:59.344682 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:11:59.344682 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:11:59.344682 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:11:59.344682 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:11:59.344682 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:11:59.344682 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:11:59.344682 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:11:59.346511 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:11:59.346511 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:11:59.346511 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 20:11:59.346511 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 20:11:59.346511 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 20:11:59.346511 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 20:11:59.346511 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 20:11:59.346511 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 20:11:59.346511 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 21 20:11:59.346511 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:11:59.346511 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 642/1280] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:11:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:11:59.350737 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803687c2-3098-4230-9da6-5f2227731ca1 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:59.354392 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:11:59.446261 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803687c2-3098-4230-9da6-5f2227731ca1 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:59.478783 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da90be-7ad2-401c-adc9-32cab8d371b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:59.479441 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da90be-7ad2-401c-adc9-32cab8d371b7 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:59.479724 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da90be-7ad2-401c-adc9-32cab8d371b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:59.480034 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da90be-7ad2-401c-adc9-32cab8d371b7 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:59.481123 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7da90be-7ad2-401c-adc9-32cab8d371b7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:11:59.481430 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7da90be-7ad2-401c-adc9-32cab8d371b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:59.482834 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7da90be-7ad2-401c-adc9-32cab8d371b7 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:59.499042 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 639/1281] 10.222.0.15 () {56 vars in 1143 bytes} [Tue Jun 21 20:11:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:11:59.505043 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1eaf30-d9b5-4757-bfc7-5a319fe069e0 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:59.592974 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:11:59.602338 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1eaf30-d9b5-4757-bfc7-5a319fe069e0 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:59.634962 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9366a3-0cbf-4d51-b2cb-b8d8a213489f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:59.635605 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9366a3-0cbf-4d51-b2cb-b8d8a213489f None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:59.636001 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9366a3-0cbf-4d51-b2cb-b8d8a213489f None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:59.636232 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9366a3-0cbf-4d51-b2cb-b8d8a213489f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:59.705844 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9366a3-0cbf-4d51-b2cb-b8d8a213489f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:59.707289 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9366a3-0cbf-4d51-b2cb-b8d8a213489f None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:59.791094 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:11:59.801734 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 643/1282] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jun 21 20:11:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 20:11:59.807474 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da90be-7ad2-401c-adc9-32cab8d371b7 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:11:59.867557 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:11:59.904968 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da90be-7ad2-401c-adc9-32cab8d371b7 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:11:59.937299 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92d7cf9-67a2-41bb-93df-5008569818f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:11:59.938089 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d7cf9-67a2-41bb-93df-5008569818f8 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:11:59.938369 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d7cf9-67a2-41bb-93df-5008569818f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:11:59.939221 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d7cf9-67a2-41bb-93df-5008569818f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:11:59.948797 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92d7cf9-67a2-41bb-93df-5008569818f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:11:59.950227 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92d7cf9-67a2-41bb-93df-5008569818f8 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:11:59.966900 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-f92d7cf9-67a2-41bb-93df-5008569818f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:11:59.966900 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:11:59.966900 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:11:59.966900 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:11:59.966900 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:11:59.966900 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:11:59.966900 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:11:59.966900 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:11:59.966900 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:11:59.966900 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:11:59.966900 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:11:59.966900 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:11:59.966900 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 20:11:59.966900 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 20:11:59.966900 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 20:11:59.967961 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 20:11:59.967961 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:11:59.967961 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:11:59.967961 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:11:59.967961 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:11:59.967961 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:11:59.967961 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:11:59.967961 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:11:59.967961 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:11:59.967961 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:11:59.967961 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:11:59.967961 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:11:59.967961 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:11:59.967961 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:11:59.967961 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:11:59.967961 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:11:59.967961 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:11:59.969104 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 20:11:59.969104 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 20:11:59.969104 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 20:11:59.969104 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:11:59.969104 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 640/1283] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:11:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:11:59.973823 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9366a3-0cbf-4d51-b2cb-b8d8a213489f None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:12:00.068634 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9366a3-0cbf-4d51-b2cb-b8d8a213489f None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:12:00.101528 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394bf061-c287-4937-ac23-a6c440507674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:12:00.102175 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bf061-c287-4937-ac23-a6c440507674 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:12:00.102457 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bf061-c287-4937-ac23-a6c440507674 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:12:00.102733 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bf061-c287-4937-ac23-a6c440507674 None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:12:00.103447 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394bf061-c287-4937-ac23-a6c440507674 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:12:00.103754 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394bf061-c287-4937-ac23-a6c440507674 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:12:00.105135 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394bf061-c287-4937-ac23-a6c440507674 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:12:00.116807 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 644/1284] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jun 21 20:11:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:12:00.122344 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92d7cf9-67a2-41bb-93df-5008569818f8 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:12:00.218893 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92d7cf9-67a2-41bb-93df-5008569818f8 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:12:00.232806 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:12:00.252895 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf4a819-3ce6-4ec1-b0b2-14501a3fa56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:12:00.253680 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4a819-3ce6-4ec1-b0b2-14501a3fa56a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:12:00.253964 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4a819-3ce6-4ec1-b0b2-14501a3fa56a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:12:00.254239 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4a819-3ce6-4ec1-b0b2-14501a3fa56a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:12:00.260596 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf4a819-3ce6-4ec1-b0b2-14501a3fa56a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:12:00.262022 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf4a819-3ce6-4ec1-b0b2-14501a3fa56a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:12:00.275941 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-dbf4a819-3ce6-4ec1-b0b2-14501a3fa56a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:12:00.275941 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:12:00.275941 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:12:00.275941 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:12:00.275941 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:12:00.275941 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:12:00.275941 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:12:00.275941 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:12:00.275941 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:12:00.275941 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:12:00.275941 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:12:00.275941 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:12:00.275941 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 20:12:00.275941 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 20:12:00.275941 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 20:12:00.276865 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 20:12:00.276865 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:12:00.276865 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:12:00.276865 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:12:00.276865 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:12:00.276865 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:12:00.276865 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:12:00.276865 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:12:00.276865 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 21 20:12:00.276865 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:12:00.276865 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:12:00.276865 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:12:00.276865 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:12:00.276865 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:12:00.276865 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:12:00.276865 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:12:00.276865 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:12:00.278134 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 20:12:00.278134 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 20:12:00.278134 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 20:12:00.278134 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 20:12:00.278134 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 20:12:00.278134 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 20:12:00.278134 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 20:12:00.278134 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 21 20:12:00.278134 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 641/1285] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jun 21 20:12:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:12:00.282743 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394bf061-c287-4937-ac23-a6c440507674 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:12:00.331196 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:12:00.379478 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394bf061-c287-4937-ac23-a6c440507674 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:12:00.412193 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee22f225-c9e8-4025-8f17-4dde53e1fca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:12:00.412841 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22f225-c9e8-4025-8f17-4dde53e1fca8 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:12:00.413127 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22f225-c9e8-4025-8f17-4dde53e1fca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:12:00.413406 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22f225-c9e8-4025-8f17-4dde53e1fca8 None admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:12:00.414196 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee22f225-c9e8-4025-8f17-4dde53e1fca8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:12:00.414508 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee22f225-c9e8-4025-8f17-4dde53e1fca8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:12:00.415941 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee22f225-c9e8-4025-8f17-4dde53e1fca8 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:12:00.428221 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 645/1286] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jun 21 20:12:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:12:00.434110 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf4a819-3ce6-4ec1-b0b2-14501a3fa56a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:12:00.529202 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf4a819-3ce6-4ec1-b0b2-14501a3fa56a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:12:00.561043 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08bda1a-1e51-4831-8529-2b4d7fca75b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:12:00.561669 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08bda1a-1e51-4831-8529-2b4d7fca75b4 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:12:00.561952 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08bda1a-1e51-4831-8529-2b4d7fca75b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:12:00.562229 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08bda1a-1e51-4831-8529-2b4d7fca75b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:12:00.563042 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08bda1a-1e51-4831-8529-2b4d7fca75b4 None admin] RBAC: Adding query filter params (role.id=1f5332f48d9e4c2aac866d0d546c94d5, scope.project.id=4dcb71ef7b6e49148edd61a1eb8da7bb, user.id=a59294bff27c4b3f8aaeeab48ed35a0e) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:12:00.563354 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08bda1a-1e51-4831-8529-2b4d7fca75b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:12:00.564780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08bda1a-1e51-4831-8529-2b4d7fca75b4 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:12:00.570345 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 642/1287] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jun 21 20:12:00 2022] GET /identity/v3/role_assignments?user.id=a59294bff27c4b3f8aaeeab48ed35a0e&scope.project.id=4dcb71ef7b6e49148edd61a1eb8da7bb&role.id=1f5332f48d9e4c2aac866d0d546c94d5 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:12:02.585206 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75d869-7b29-4e65-9e67-6d72a31b80c2 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:12:02.585762 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75d869-7b29-4e65-9e67-6d72a31b80c2 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:12:02.585762 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75d869-7b29-4e65-9e67-6d72a31b80c2 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:12:02.587127 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 646/1288] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:12:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:12:02.592482 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9cc87-2797-4af0-81c4-36d3a012df25 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:12:02.592850 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9cc87-2797-4af0-81c4-36d3a012df25 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:12:02.593053 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9cc87-2797-4af0-81c4-36d3a012df25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:12:02.610081 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-89e9cc87-2797-4af0-81c4-36d3a012df25 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:12:02.611892 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-89e9cc87-2797-4af0-81c4-36d3a012df25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:12:02.642047 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:12:02.687951 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 643/1289] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:12:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 20:12:02.709006 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75d869-7b29-4e65-9e67-6d72a31b80c2 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:12:02.807883 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75d869-7b29-4e65-9e67-6d72a31b80c2 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:12:02.818141 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:12:02.841681 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc6765f-6f84-46fc-9d40-5ab80cc4e958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:12:02.842414 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6765f-6f84-46fc-9d40-5ab80cc4e958 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:12:02.842788 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6765f-6f84-46fc-9d40-5ab80cc4e958 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:12:02.843064 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6765f-6f84-46fc-9d40-5ab80cc4e958 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:12:02.843718 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc6765f-6f84-46fc-9d40-5ab80cc4e958 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:12:02.845765 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc6765f-6f84-46fc-9d40-5ab80cc4e958 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:12:02.857698 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-cdc6765f-6f84-46fc-9d40-5ab80cc4e958 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 20:12:02.857698 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:12:02.857698 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 20:12:02.857698 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 20:12:02.857698 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 20:12:02.857698 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 20:12:02.857698 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 20:12:02.857698 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 20:12:02.857698 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 20:12:02.857698 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:12:02.857698 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 20:12:02.857698 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:12:02.857698 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:12:02.857698 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:12:02.857698 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:12:02.857698 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:12:02.857698 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:12:02.858871 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:12:02.858871 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:12:02.858871 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:12:02.858871 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:12:02.858871 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:12:02.858871 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:12:02.858871 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 20:12:02.858871 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 20:12:02.858871 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 20:12:02.858871 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 20:12:02.858871 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:12:02.858871 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:12:02.858871 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:12:02.858871 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:12:02.858871 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:12:02.858871 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:12:02.859906 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:12:02.859906 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:12:02.859906 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:12:02.859906 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:12:02.859906 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:12:02.859906 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:12:02.859906 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:12:02.859906 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:12:02.859906 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:12:02.859906 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:12:02.859906 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 20:12:02.859906 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 20:12:02.859906 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 20:12:02.859906 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:12:02.859906 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 647/1290] 10.222.0.15 () {56 vars in 1117 bytes} [Tue Jun 21 20:12:02 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:12:02.864777 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9cc87-2797-4af0-81c4-36d3a012df25 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:12:02.958453 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9cc87-2797-4af0-81c4-36d3a012df25 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:12:02.991213 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feabb0ba-41e5-4a00-b6fb-78c98fc270fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:12:02.991867 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabb0ba-41e5-4a00-b6fb-78c98fc270fe None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:12:02.992188 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabb0ba-41e5-4a00-b6fb-78c98fc270fe None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:12:02.992468 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabb0ba-41e5-4a00-b6fb-78c98fc270fe None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:12:02.993166 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feabb0ba-41e5-4a00-b6fb-78c98fc270fe None admin] RBAC: Adding query filter params (name=placement) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:12:02.993475 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feabb0ba-41e5-4a00-b6fb-78c98fc270fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:12:02.994821 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feabb0ba-41e5-4a00-b6fb-78c98fc270fe None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:12:02.999498 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 644/1291] 10.222.0.15 () {56 vars in 1116 bytes} [Tue Jun 21 20:12:02 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:12:03.005086 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc6765f-6f84-46fc-9d40-5ab80cc4e958 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:12:03.103611 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc6765f-6f84-46fc-9d40-5ab80cc4e958 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:12:03.135964 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f453d11c-a2c2-4e0d-a956-c35cf2eaa205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:12:03.136612 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453d11c-a2c2-4e0d-a956-c35cf2eaa205 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:12:03.136900 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453d11c-a2c2-4e0d-a956-c35cf2eaa205 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:12:03.137183 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453d11c-a2c2-4e0d-a956-c35cf2eaa205 None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:12:03.137885 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f453d11c-a2c2-4e0d-a956-c35cf2eaa205 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:12:03.138193 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f453d11c-a2c2-4e0d-a956-c35cf2eaa205 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:12:03.139549 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f453d11c-a2c2-4e0d-a956-c35cf2eaa205 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:12:03.143842 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 648/1292] 10.222.0.15 () {56 vars in 1116 bytes} [Tue Jun 21 20:12:03 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:12:05.144081 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb4c324-226b-4aab-b6b3-d1d550652d9c None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:12:05.144654 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb4c324-226b-4aab-b6b3-d1d550652d9c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:12:05.144654 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb4c324-226b-4aab-b6b3-d1d550652d9c None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:12:05.146010 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 645/1293] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:12:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 20:12:05.150951 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158cef4-c9e2-4a99-afb9-351a463a2ad7 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:12:05.151351 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158cef4-c9e2-4a99-afb9-351a463a2ad7 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:12:05.151511 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158cef4-c9e2-4a99-afb9-351a463a2ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:12:05.168108 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-3158cef4-c9e2-4a99-afb9-351a463a2ad7 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:12:05.169261 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-3158cef4-c9e2-4a99-afb9-351a463a2ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:12:05.198021 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:12:05.233820 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 649/1294] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:12:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 20:12:05.257005 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb4c324-226b-4aab-b6b3-d1d550652d9c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:12:05.287005 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:12:05.356138 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb4c324-226b-4aab-b6b3-d1d550652d9c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:12:05.388596 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4a657-daa5-4f3b-bcc4-aeb7d52d266f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:12:05.389245 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4a657-daa5-4f3b-bcc4-aeb7d52d266f None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:12:05.389530 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4a657-daa5-4f3b-bcc4-aeb7d52d266f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:12:05.389808 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4a657-daa5-4f3b-bcc4-aeb7d52d266f None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:12:05.390521 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db4a657-daa5-4f3b-bcc4-aeb7d52d266f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:12:05.392495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db4a657-daa5-4f3b-bcc4-aeb7d52d266f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:12:05.404995 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 646/1295] 10.222.0.15 () {60 vars in 1141 bytes} [Tue Jun 21 20:12:05 2022] POST /identity/v3/services => generated 246 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 20:12:07.431866 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e5c18d-f15a-4759-a807-a20c4886cdfc None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:12:07.432451 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e5c18d-f15a-4759-a807-a20c4886cdfc None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:12:07.432451 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e5c18d-f15a-4759-a807-a20c4886cdfc None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:12:07.433834 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 650/1296] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:12:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:12:07.438987 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f0eb6-ea92-4162-a8e5-806a58ef6045 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:12:07.439422 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f0eb6-ea92-4162-a8e5-806a58ef6045 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:12:07.439551 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f0eb6-ea92-4162-a8e5-806a58ef6045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:12:07.456459 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-670f0eb6-ea92-4162-a8e5-806a58ef6045 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:12:07.457639 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-670f0eb6-ea92-4162-a8e5-806a58ef6045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:12:07.527436 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 647/1297] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:12:07 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 20:12:07.550856 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e5c18d-f15a-4759-a807-a20c4886cdfc None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:12:07.653303 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e5c18d-f15a-4759-a807-a20c4886cdfc None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:12:07.692848 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63bda5-2cfd-40f6-afac-42f76aa578cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:12:07.693719 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63bda5-2cfd-40f6-afac-42f76aa578cc None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:12:07.694064 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63bda5-2cfd-40f6-afac-42f76aa578cc None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:12:07.694410 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63bda5-2cfd-40f6-afac-42f76aa578cc None admin] PATH_INFO: `/v3/services/placement` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:12:07.695186 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d63bda5-2cfd-40f6-afac-42f76aa578cc None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:12:07.696700 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d63bda5-2cfd-40f6-afac-42f76aa578cc None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:12:07.710288 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-8d63bda5-2cfd-40f6-afac-42f76aa578cc None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 20:12:07.710288 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:12:07.710288 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 20:12:07.710288 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 20:12:07.710288 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 20:12:07.710288 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 20:12:07.710288 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 20:12:07.710288 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 20:12:07.710288 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 20:12:07.710288 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:12:07.710288 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 20:12:07.710288 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:12:07.710288 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:12:07.710288 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:12:07.710288 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:12:07.710288 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:12:07.710288 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:12:07.711671 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:12:07.711671 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:12:07.711671 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:12:07.711671 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:12:07.711671 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:12:07.711671 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:12:07.711671 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 20:12:07.711671 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 20:12:07.711671 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 20:12:07.711671 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 20:12:07.711671 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:12:07.711671 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:12:07.711671 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:12:07.711671 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:12:07.711671 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:12:07.711671 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:12:07.712989 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:12:07.712989 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:12:07.712989 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:12:07.712989 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:12:07.712989 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:12:07.712989 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:12:07.712989 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:12:07.712989 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:12:07.712989 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:12:07.712989 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:12:07.712989 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 20:12:07.712989 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 20:12:07.712989 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 20:12:07.712989 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:12:07.712989 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 651/1298] 10.222.0.15 () {56 vars in 1117 bytes} [Tue Jun 21 20:12:07 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:12:07.717889 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f0eb6-ea92-4162-a8e5-806a58ef6045 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:12:07.736869 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:12:07.820826 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f0eb6-ea92-4162-a8e5-806a58ef6045 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:12:07.856548 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7058a8-e951-4d35-add4-7cfdc280047b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:12:07.857256 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7058a8-e951-4d35-add4-7cfdc280047b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:12:07.857483 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7058a8-e951-4d35-add4-7cfdc280047b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:12:07.857758 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7058a8-e951-4d35-add4-7cfdc280047b None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:12:07.858453 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7058a8-e951-4d35-add4-7cfdc280047b None admin] RBAC: Adding query filter params (name=placement) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:12:07.858758 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7058a8-e951-4d35-add4-7cfdc280047b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:12:07.860123 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7058a8-e951-4d35-add4-7cfdc280047b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:12:07.865220 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 648/1299] 10.222.0.15 () {56 vars in 1116 bytes} [Tue Jun 21 20:12:07 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:12:07.871112 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63bda5-2cfd-40f6-afac-42f76aa578cc None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:12:07.902353 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:12:07.967661 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63bda5-2cfd-40f6-afac-42f76aa578cc None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:12:07.999680 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a183ab-6477-49d5-9752-4008c42f923a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:12:08.000530 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a183ab-6477-49d5-9752-4008c42f923a None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:12:08.000866 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a183ab-6477-49d5-9752-4008c42f923a None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:12:08.001647 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a183ab-6477-49d5-9752-4008c42f923a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:12:08.002424 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a183ab-6477-49d5-9752-4008c42f923a None admin] RBAC: Adding query filter params (interface=public, service_id=fe5c2ef8310c466c9fe2fa309ba6efda, region_id=RegionOne) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:12:08.002735 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a183ab-6477-49d5-9752-4008c42f923a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:12:08.004099 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a183ab-6477-49d5-9752-4008c42f923a None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:12:08.008929 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 652/1300] 10.222.0.15 () {56 vars in 1251 bytes} [Tue Jun 21 20:12:07 2022] GET /identity/v3/endpoints?service_id=fe5c2ef8310c466c9fe2fa309ba6efda&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:12:08.014411 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7058a8-e951-4d35-add4-7cfdc280047b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:12:08.092973 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:12:08.111379 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7058a8-e951-4d35-add4-7cfdc280047b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:12:08.144789 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d19fbd-d957-4b0f-a044-584228053038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:12:08.145447 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d19fbd-d957-4b0f-a044-584228053038 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:12:08.145736 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d19fbd-d957-4b0f-a044-584228053038 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:12:08.146023 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d19fbd-d957-4b0f-a044-584228053038 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:12:08.146706 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d19fbd-d957-4b0f-a044-584228053038 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:12:08.148092 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d19fbd-d957-4b0f-a044-584228053038 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:12:08.154731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 649/1301] 10.222.0.15 () {56 vars in 1087 bytes} [Tue Jun 21 20:12:08 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:12:10.173823 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dfac0e-86e0-4667-9ae6-dffdd5746d2c None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:12:10.174369 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dfac0e-86e0-4667-9ae6-dffdd5746d2c None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:12:10.174369 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dfac0e-86e0-4667-9ae6-dffdd5746d2c None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:12:10.175736 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 653/1302] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:12:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:12:10.180909 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed38d62-3bd1-4eec-a233-d72947224ab2 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:12:10.181342 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed38d62-3bd1-4eec-a233-d72947224ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:12:10.181474 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed38d62-3bd1-4eec-a233-d72947224ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:12:10.197756 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-9ed38d62-3bd1-4eec-a233-d72947224ab2 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:12:10.198935 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9ed38d62-3bd1-4eec-a233-d72947224ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:12:10.262838 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 650/1303] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:12:10 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 20:12:10.286357 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dfac0e-86e0-4667-9ae6-dffdd5746d2c None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:12:10.377648 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:12:10.384450 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dfac0e-86e0-4667-9ae6-dffdd5746d2c None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:12:10.416724 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23635ca4-2b4b-444d-8a15-908d9f069813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:12:10.417505 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23635ca4-2b4b-444d-8a15-908d9f069813 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:12:10.417788 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23635ca4-2b4b-444d-8a15-908d9f069813 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:12:10.418064 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23635ca4-2b4b-444d-8a15-908d9f069813 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:12:10.418705 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23635ca4-2b4b-444d-8a15-908d9f069813 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:12:10.420089 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23635ca4-2b4b-444d-8a15-908d9f069813 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:12:10.431464 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-23635ca4-2b4b-444d-8a15-908d9f069813 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 20:12:10.431464 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:12:10.431464 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 20:12:10.431464 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 20:12:10.431464 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 20:12:10.431464 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 20:12:10.431464 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 20:12:10.431464 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 20:12:10.431464 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 20:12:10.431464 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:12:10.431464 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 20:12:10.431464 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:12:10.431464 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:12:10.431464 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:12:10.431464 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:12:10.431464 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:12:10.431464 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:12:10.432637 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:12:10.432637 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:12:10.432637 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:12:10.432637 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:12:10.432637 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:12:10.432637 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:12:10.432637 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 20:12:10.432637 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 20:12:10.432637 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 20:12:10.432637 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 20:12:10.432637 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:12:10.432637 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:12:10.432637 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:12:10.432637 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:12:10.432637 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:12:10.432637 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:12:10.433663 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:12:10.433663 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:12:10.433663 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:12:10.433663 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:12:10.433663 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:12:10.433663 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:12:10.433663 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:12:10.433663 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:12:10.433663 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:12:10.433663 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:12:10.433663 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 20:12:10.433663 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 20:12:10.433663 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 20:12:10.433663 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:12:10.433663 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 654/1304] 10.222.0.15 () {56 vars in 1117 bytes} [Tue Jun 21 20:12:10 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 20:12:10.438388 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed38d62-3bd1-4eec-a233-d72947224ab2 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:12:10.511266 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:12:10.534134 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed38d62-3bd1-4eec-a233-d72947224ab2 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:12:10.566064 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a48f31-b550-4555-a6c7-9b6f9190b31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:12:10.566713 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a48f31-b550-4555-a6c7-9b6f9190b31c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:12:10.567001 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a48f31-b550-4555-a6c7-9b6f9190b31c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:12:10.567280 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a48f31-b550-4555-a6c7-9b6f9190b31c None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:12:10.568005 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a48f31-b550-4555-a6c7-9b6f9190b31c None admin] RBAC: Adding query filter params (name=placement) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:12:10.568319 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a48f31-b550-4555-a6c7-9b6f9190b31c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:12:10.569667 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a48f31-b550-4555-a6c7-9b6f9190b31c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:12:10.574636 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 651/1305] 10.222.0.15 () {56 vars in 1116 bytes} [Tue Jun 21 20:12:10 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:12:10.580630 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23635ca4-2b4b-444d-8a15-908d9f069813 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:12:10.682087 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23635ca4-2b4b-444d-8a15-908d9f069813 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:12:10.714486 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a122607-4fa9-4432-9ad6-330fb509505e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:12:10.715129 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a122607-4fa9-4432-9ad6-330fb509505e None admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:12:10.715412 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a122607-4fa9-4432-9ad6-330fb509505e None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:12:10.715688 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a122607-4fa9-4432-9ad6-330fb509505e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:12:10.716451 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a122607-4fa9-4432-9ad6-330fb509505e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:12:10.717804 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a122607-4fa9-4432-9ad6-330fb509505e None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:12:10.734908 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 655/1306] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Jun 21 20:12:10 2022] POST /identity/v3/endpoints => generated 331 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 20:12:20.571747 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=30 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:12:20.730580 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:13:12.804342 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80584439-4201-4e57-820b-06ee597fe822 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:13:12.804955 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80584439-4201-4e57-820b-06ee597fe822 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:13:12.804955 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80584439-4201-4e57-820b-06ee597fe822 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:13:12.806340 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 652/1307] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:13:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:13:12.812397 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3ee0b-a8ca-417d-9242-f70875df3c83 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:13:12.812950 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3ee0b-a8ca-417d-9242-f70875df3c83 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:13:12.812950 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3ee0b-a8ca-417d-9242-f70875df3c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:13:13.003709 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-5db3ee0b-a8ca-417d-9242-f70875df3c83 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:13:13.005209 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-5db3ee0b-a8ca-417d-9242-f70875df3c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:13:13.276542 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 656/1308] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:13:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 451 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:13:13.331440 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081620f-091a-4891-86a4-79bd27bb9f8c None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:13:13.331822 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081620f-091a-4891-86a4-79bd27bb9f8c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:13:13.332332 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081620f-091a-4891-86a4-79bd27bb9f8c None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:13:13.334512 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 653/1309] 10.222.0.15 () {54 vars in 964 bytes} [Tue Jun 21 20:13:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:13:13.343078 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae86735-a7eb-4b48-a910-3acba4926cc2 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:13:13.343557 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae86735-a7eb-4b48-a910-3acba4926cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:13:13.343991 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae86735-a7eb-4b48-a910-3acba4926cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:13:13.490616 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-aae86735-a7eb-4b48-a910-3acba4926cc2 None None] MFA Rules not processed for user `1b01b53897d64bbaac6efb6f13d413a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:13:13.492365 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-aae86735-a7eb-4b48-a910-3acba4926cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:13:13.517020 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:13:13.583300 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 657/1310] 10.222.0.15 () {58 vars in 1061 bytes} [Tue Jun 21 20:13:13 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:13:13.592678 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081620f-091a-4891-86a4-79bd27bb9f8c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:13:13.594513 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5081620f-091a-4891-86a4-79bd27bb9f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:13:13.714946 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081620f-091a-4891-86a4-79bd27bb9f8c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:13:13.795648 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f98f6-4b8e-41bb-a6d2-5677f6378cdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:13:13.796265 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f98f6-4b8e-41bb-a6d2-5677f6378cdf service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:13:13.796558 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f98f6-4b8e-41bb-a6d2-5677f6378cdf service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:13:13.797000 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f98f6-4b8e-41bb-a6d2-5677f6378cdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:13:13.798703 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e47f98f6-4b8e-41bb-a6d2-5677f6378cdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:13:13.858584 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:13:13.921612 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47f98f6-4b8e-41bb-a6d2-5677f6378cdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:13:13.923314 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47f98f6-4b8e-41bb-a6d2-5677f6378cdf service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:13:13.943614 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 654/1311] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:13:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:13:16.309885 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0697010-a73e-4c9a-a29f-dd4c430093ae None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:13:16.310487 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0697010-a73e-4c9a-a29f-dd4c430093ae None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:13:16.310606 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0697010-a73e-4c9a-a29f-dd4c430093ae None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:13:16.311973 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 658/1312] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:13:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:13:16.317222 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fae6a7-0a77-4e2a-82be-dedaaa281921 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:13:16.317689 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fae6a7-0a77-4e2a-82be-dedaaa281921 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:13:16.317864 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fae6a7-0a77-4e2a-82be-dedaaa281921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:13:16.387789 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-88fae6a7-0a77-4e2a-82be-dedaaa281921 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:13:16.389559 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-88fae6a7-0a77-4e2a-82be-dedaaa281921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:13:16.492633 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 655/1313] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:13:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:13:16.532181 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0697010-a73e-4c9a-a29f-dd4c430093ae None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:13:16.533775 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-b0697010-a73e-4c9a-a29f-dd4c430093ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:13:16.645792 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0697010-a73e-4c9a-a29f-dd4c430093ae None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:13:16.719487 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:13:16.722153 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb766925-90cc-4424-a8d5-562d7ee0e7fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:13:16.722843 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb766925-90cc-4424-a8d5-562d7ee0e7fe service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:13:16.723378 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb766925-90cc-4424-a8d5-562d7ee0e7fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:13:16.723843 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb766925-90cc-4424-a8d5-562d7ee0e7fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:13:16.726010 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-eb766925-90cc-4424-a8d5-562d7ee0e7fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:13:16.837126 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb766925-90cc-4424-a8d5-562d7ee0e7fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:13:16.838584 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb766925-90cc-4424-a8d5-562d7ee0e7fe service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:13:16.858670 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 659/1314] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:13:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:13:19.183460 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f84446f-6a3d-49ac-ba3a-9e1f65a24e5c None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:13:19.184017 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f84446f-6a3d-49ac-ba3a-9e1f65a24e5c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:13:19.184115 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f84446f-6a3d-49ac-ba3a-9e1f65a24e5c None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:13:19.185415 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 656/1315] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:13:19.190466 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61aa73e-e1b3-4ef3-a03a-c5c6b69f7e0b None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:13:19.190908 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61aa73e-e1b3-4ef3-a03a-c5c6b69f7e0b None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:13:19.191038 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61aa73e-e1b3-4ef3-a03a-c5c6b69f7e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:13:19.255011 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-e61aa73e-e1b3-4ef3-a03a-c5c6b69f7e0b None None] MFA Rules not processed for user `4cd92ad55d0048e4947a9eb9038bc935`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:13:19.256259 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-e61aa73e-e1b3-4ef3-a03a-c5c6b69f7e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:13:19.307310 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:13:19.351945 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 660/1316] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:13:19 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:13:19.406844 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297b82f-749c-4cd8-affe-e70b50252882 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:13:19.407134 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297b82f-749c-4cd8-affe-e70b50252882 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:13:19.407416 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297b82f-749c-4cd8-affe-e70b50252882 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:13:19.408817 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 657/1317] 10.222.0.15 () {54 vars in 964 bytes} [Tue Jun 21 20:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:13:19.414656 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d17c36-45d6-4651-85ec-d8e64ef584c3 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:13:19.414948 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d17c36-45d6-4651-85ec-d8e64ef584c3 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:13:19.415227 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d17c36-45d6-4651-85ec-d8e64ef584c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:13:19.489291 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-e8d17c36-45d6-4651-85ec-d8e64ef584c3 None None] MFA Rules not processed for user `1b01b53897d64bbaac6efb6f13d413a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:13:19.490440 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-e8d17c36-45d6-4651-85ec-d8e64ef584c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:13:19.565290 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 661/1318] 10.222.0.15 () {58 vars in 1061 bytes} [Tue Jun 21 20:13:19 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:13:19.574218 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0297b82f-749c-4cd8-affe-e70b50252882 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:13:19.575745 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0297b82f-749c-4cd8-affe-e70b50252882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:13:19.585843 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:13:19.677780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0297b82f-749c-4cd8-affe-e70b50252882 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:13:19.748844 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da83969-6afb-4910-8fce-90c9261991c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:13:19.749430 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da83969-6afb-4910-8fce-90c9261991c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:13:19.749714 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da83969-6afb-4910-8fce-90c9261991c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:13:19.749994 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da83969-6afb-4910-8fce-90c9261991c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:13:19.751626 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7da83969-6afb-4910-8fce-90c9261991c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:13:19.812311 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:13:19.859783 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da83969-6afb-4910-8fce-90c9261991c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:13:19.861245 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da83969-6afb-4910-8fce-90c9261991c9 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:13:19.879130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 658/1319] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:13:19 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:13:22.782078 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b438eb5-6e87-4774-9c07-9ede93f01119 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:13:22.782618 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b438eb5-6e87-4774-9c07-9ede93f01119 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:13:22.782618 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b438eb5-6e87-4774-9c07-9ede93f01119 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:13:22.784164 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 662/1320] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:13:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:13:22.789235 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619fb15-171f-4a61-bd69-631c1aef8493 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:13:22.789638 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619fb15-171f-4a61-bd69-631c1aef8493 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:13:22.789798 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619fb15-171f-4a61-bd69-631c1aef8493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:13:22.852834 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-6619fb15-171f-4a61-bd69-631c1aef8493 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:13:22.854283 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6619fb15-171f-4a61-bd69-631c1aef8493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:13:22.948872 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 659/1321] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:13:22 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:13:22.988758 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b438eb5-6e87-4774-9c07-9ede93f01119 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:13:22.990313 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-0b438eb5-6e87-4774-9c07-9ede93f01119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:13:23.040039 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:13:23.092700 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b438eb5-6e87-4774-9c07-9ede93f01119 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:13:23.163681 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b0b9e-fdc0-49ce-b8d8-a72b1ee5ddc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:13:23.164351 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b0b9e-fdc0-49ce-b8d8-a72b1ee5ddc1 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:13:23.164639 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b0b9e-fdc0-49ce-b8d8-a72b1ee5ddc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:13:23.164916 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b0b9e-fdc0-49ce-b8d8-a72b1ee5ddc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:13:23.166553 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-7c9b0b9e-fdc0-49ce-b8d8-a72b1ee5ddc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:13:23.260456 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:13:23.273724 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9b0b9e-fdc0-49ce-b8d8-a72b1ee5ddc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:13:23.275150 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9b0b9e-fdc0-49ce-b8d8-a72b1ee5ddc1 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:13:23.292738 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 663/1322] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:13:22 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:13:25.988471 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124271f-3d67-42ab-817a-1262d5ccc287 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:13:25.989042 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124271f-3d67-42ab-817a-1262d5ccc287 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:13:25.989042 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124271f-3d67-42ab-817a-1262d5ccc287 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:13:25.990547 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 660/1323] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:13:25.995623 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b9e25-0edf-4a1f-b420-14d0f4874647 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:13:25.996086 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b9e25-0edf-4a1f-b420-14d0f4874647 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:13:25.996225 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b9e25-0edf-4a1f-b420-14d0f4874647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:13:26.061440 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-248b9e25-0edf-4a1f-b420-14d0f4874647 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:13:26.062655 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-248b9e25-0edf-4a1f-b420-14d0f4874647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:13:26.168169 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 664/1324] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:13:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:13:26.208316 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7124271f-3d67-42ab-817a-1262d5ccc287 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:13:26.209924 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7124271f-3d67-42ab-817a-1262d5ccc287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:13:26.230392 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:13:26.319235 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7124271f-3d67-42ab-817a-1262d5ccc287 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:13:26.391544 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c5d54b-9a8a-48e5-a456-e438de86bc03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:13:26.392228 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5d54b-9a8a-48e5-a456-e438de86bc03 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:13:26.392524 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5d54b-9a8a-48e5-a456-e438de86bc03 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:13:26.392807 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5d54b-9a8a-48e5-a456-e438de86bc03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:13:26.394472 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-40c5d54b-9a8a-48e5-a456-e438de86bc03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:13:26.464008 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:13:26.502553 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c5d54b-9a8a-48e5-a456-e438de86bc03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:13:26.504024 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c5d54b-9a8a-48e5-a456-e438de86bc03 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:13:26.523492 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 661/1325] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:13:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:13:28.605560 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4834bde9-b6e8-4e5c-a404-3683f2132dff None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:13:28.606088 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4834bde9-b6e8-4e5c-a404-3683f2132dff None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:13:28.606088 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4834bde9-b6e8-4e5c-a404-3683f2132dff None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:13:28.607417 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 665/1326] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:13:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:13:28.612889 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869902d-ec24-428f-917f-cd0b3fcb9e54 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:13:28.613382 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869902d-ec24-428f-917f-cd0b3fcb9e54 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:13:28.613861 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869902d-ec24-428f-917f-cd0b3fcb9e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:13:28.689598 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c869902d-ec24-428f-917f-cd0b3fcb9e54 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:13:28.690811 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c869902d-ec24-428f-917f-cd0b3fcb9e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:13:28.787281 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 662/1327] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:13:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:13:28.823146 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4834bde9-b6e8-4e5c-a404-3683f2132dff None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:13:28.824818 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-4834bde9-b6e8-4e5c-a404-3683f2132dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:13:28.890748 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:13:28.936040 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4834bde9-b6e8-4e5c-a404-3683f2132dff None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:13:29.014477 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42019c4-d6cb-454d-88fe-858d58d6bf8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:13:29.015131 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42019c4-d6cb-454d-88fe-858d58d6bf8c service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:13:29.015417 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42019c4-d6cb-454d-88fe-858d58d6bf8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:13:29.015695 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42019c4-d6cb-454d-88fe-858d58d6bf8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:13:29.017395 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-a42019c4-d6cb-454d-88fe-858d58d6bf8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:13:29.124036 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:13:29.126712 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42019c4-d6cb-454d-88fe-858d58d6bf8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:13:29.128301 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42019c4-d6cb-454d-88fe-858d58d6bf8c service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:13:29.149624 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 666/1328] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:13:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:13:31.232760 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298955c-37d3-4b33-be30-74864f4fa546 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:13:31.233296 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298955c-37d3-4b33-be30-74864f4fa546 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:13:31.233296 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298955c-37d3-4b33-be30-74864f4fa546 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:13:31.234745 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 663/1329] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:13:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:13:31.240173 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ccbe7-0598-44e7-87b0-8ad81aa47855 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:13:31.240619 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ccbe7-0598-44e7-87b0-8ad81aa47855 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:13:31.240862 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ccbe7-0598-44e7-87b0-8ad81aa47855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:13:31.307216 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-dc5ccbe7-0598-44e7-87b0-8ad81aa47855 None None] MFA Rules not processed for user `4cd92ad55d0048e4947a9eb9038bc935`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:13:31.308457 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-dc5ccbe7-0598-44e7-87b0-8ad81aa47855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:13:31.407798 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 667/1330] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:13:31 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:13:31.445765 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298955c-37d3-4b33-be30-74864f4fa546 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:13:31.447302 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7298955c-37d3-4b33-be30-74864f4fa546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:13:31.477231 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:13:31.550888 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298955c-37d3-4b33-be30-74864f4fa546 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:13:31.625015 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3335c906-4393-4496-b658-656e6bc17b79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:13:31.625680 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335c906-4393-4496-b658-656e6bc17b79 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:13:31.625952 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335c906-4393-4496-b658-656e6bc17b79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:13:31.626229 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335c906-4393-4496-b658-656e6bc17b79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:13:31.627883 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3335c906-4393-4496-b658-656e6bc17b79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:13:31.703096 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:13:31.740224 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3335c906-4393-4496-b658-656e6bc17b79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:13:31.741695 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3335c906-4393-4496-b658-656e6bc17b79 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:13:31.760113 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 664/1331] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:13:31 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:13:34.012508 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d22dd-5217-4780-9e7d-df63fe95da15 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:13:34.013054 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d22dd-5217-4780-9e7d-df63fe95da15 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:13:34.013054 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d22dd-5217-4780-9e7d-df63fe95da15 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:13:34.014490 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 668/1332] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:13:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:13:34.019572 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e21e75-aa1d-40bf-8909-984e2af1a52f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:13:34.020033 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e21e75-aa1d-40bf-8909-984e2af1a52f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:13:34.020163 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e21e75-aa1d-40bf-8909-984e2af1a52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:13:34.083675 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-75e21e75-aa1d-40bf-8909-984e2af1a52f None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:13:34.084891 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-75e21e75-aa1d-40bf-8909-984e2af1a52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:13:34.179743 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 665/1333] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:13:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 20:13:34.215672 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d22dd-5217-4780-9e7d-df63fe95da15 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:13:34.217280 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-bb5d22dd-5217-4780-9e7d-df63fe95da15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:13:34.285139 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:13:34.319418 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d22dd-5217-4780-9e7d-df63fe95da15 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:13:34.390585 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a6fb7-2594-491c-a3e4-b4960a59fb26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:13:34.391227 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a6fb7-2594-491c-a3e4-b4960a59fb26 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:13:34.391514 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a6fb7-2594-491c-a3e4-b4960a59fb26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:13:34.391796 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a6fb7-2594-491c-a3e4-b4960a59fb26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:13:34.393466 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-5d1a6fb7-2594-491c-a3e4-b4960a59fb26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:13:34.500393 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a6fb7-2594-491c-a3e4-b4960a59fb26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:13:34.501751 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a6fb7-2594-491c-a3e4-b4960a59fb26 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:13:34.511483 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:13:34.520048 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 669/1334] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:13:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:13:36.594858 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8a2ca-243d-4455-8b9f-8f9db184c20f None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:13:36.595507 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8a2ca-243d-4455-8b9f-8f9db184c20f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:13:36.595507 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8a2ca-243d-4455-8b9f-8f9db184c20f None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:13:36.596836 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 666/1335] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:13:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:13:36.602129 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560617d7-c922-4dda-83e8-c002a36722b5 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:13:36.602558 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560617d7-c922-4dda-83e8-c002a36722b5 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:13:36.602662 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560617d7-c922-4dda-83e8-c002a36722b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:13:36.665863 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-560617d7-c922-4dda-83e8-c002a36722b5 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:13:36.667061 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-560617d7-c922-4dda-83e8-c002a36722b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:13:36.763813 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 670/1336] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:13:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:13:36.803428 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8a2ca-243d-4455-8b9f-8f9db184c20f None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:13:36.805008 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-32d8a2ca-243d-4455-8b9f-8f9db184c20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:13:36.846076 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:13:36.909863 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8a2ca-243d-4455-8b9f-8f9db184c20f None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:13:36.981085 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198786b-0779-4f18-b5e4-2c9c5fec2259 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:13:36.982288 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198786b-0779-4f18-b5e4-2c9c5fec2259 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:13:36.982575 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198786b-0779-4f18-b5e4-2c9c5fec2259 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:13:36.982859 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198786b-0779-4f18-b5e4-2c9c5fec2259 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:13:36.984551 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1198786b-0779-4f18-b5e4-2c9c5fec2259 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:13:37.065279 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:13:37.090505 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1198786b-0779-4f18-b5e4-2c9c5fec2259 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:13:37.092455 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1198786b-0779-4f18-b5e4-2c9c5fec2259 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:13:37.110715 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 667/1337] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:13:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:13:39.427106 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcdf6a-0c0c-42ad-941f-7c3754e68512 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:13:39.427667 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcdf6a-0c0c-42ad-941f-7c3754e68512 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:13:39.427667 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcdf6a-0c0c-42ad-941f-7c3754e68512 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:13:39.429089 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 671/1338] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:13:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:13:39.434166 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa6a7e-0d86-4e60-a8cf-87899ad7464b None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:13:39.434553 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa6a7e-0d86-4e60-a8cf-87899ad7464b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:13:39.434763 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa6a7e-0d86-4e60-a8cf-87899ad7464b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:13:39.497845 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-35aa6a7e-0d86-4e60-a8cf-87899ad7464b None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:13:39.499037 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-35aa6a7e-0d86-4e60-a8cf-87899ad7464b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:13:39.594006 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 668/1339] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:13:39 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:13:39.629484 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbcdf6a-0c0c-42ad-941f-7c3754e68512 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:13:39.631039 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-5cbcdf6a-0c0c-42ad-941f-7c3754e68512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:13:39.709206 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:13:39.737212 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbcdf6a-0c0c-42ad-941f-7c3754e68512 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:13:39.807996 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52496ed4-dee8-4cb7-8608-54c7062f7f29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:13:39.808640 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52496ed4-dee8-4cb7-8608-54c7062f7f29 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:13:39.808927 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52496ed4-dee8-4cb7-8608-54c7062f7f29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:13:39.809200 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52496ed4-dee8-4cb7-8608-54c7062f7f29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:13:39.810825 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-52496ed4-dee8-4cb7-8608-54c7062f7f29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:13:39.922751 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52496ed4-dee8-4cb7-8608-54c7062f7f29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:13:39.924272 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52496ed4-dee8-4cb7-8608-54c7062f7f29 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:13:39.942254 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 672/1340] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:13:39 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:13:43.818678 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb305adc-38a1-4241-b095-331caea0cc95 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:13:43.819210 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb305adc-38a1-4241-b095-331caea0cc95 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:13:43.819327 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb305adc-38a1-4241-b095-331caea0cc95 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:13:43.820651 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 669/1341] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:13:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:13:43.826447 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0fb60-3bf5-4e6c-94f8-a993ed1e9758 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:13:43.826890 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0fb60-3bf5-4e6c-94f8-a993ed1e9758 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:13:43.827078 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0fb60-3bf5-4e6c-94f8-a993ed1e9758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:13:43.833247 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:13:43.902639 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-49b0fb60-3bf5-4e6c-94f8-a993ed1e9758 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:13:43.903939 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-49b0fb60-3bf5-4e6c-94f8-a993ed1e9758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:13:44.010111 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 673/1342] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:13:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:13:44.048344 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb305adc-38a1-4241-b095-331caea0cc95 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:13:44.050508 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-bb305adc-38a1-4241-b095-331caea0cc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:13:44.100018 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:13:44.146769 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb305adc-38a1-4241-b095-331caea0cc95 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:13:44.150248 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b55f6a-9d52-4988-ae7b-987d291b1146 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:13:44.150891 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b55f6a-9d52-4988-ae7b-987d291b1146 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:13:44.151174 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b55f6a-9d52-4988-ae7b-987d291b1146 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:13:44.151449 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b55f6a-9d52-4988-ae7b-987d291b1146 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:13:44.160307 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b55f6a-9d52-4988-ae7b-987d291b1146 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:13:44.161658 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b55f6a-9d52-4988-ae7b-987d291b1146 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:13:44.171445 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 670/1343] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:13:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:13:46.831443 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53807c28-b173-4f02-bbf1-45ccc8ec1ee6 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:13:46.832135 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53807c28-b173-4f02-bbf1-45ccc8ec1ee6 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:13:46.832135 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53807c28-b173-4f02-bbf1-45ccc8ec1ee6 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:13:46.833417 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 674/1344] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:13:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:13:46.838553 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6c224-6f71-46cd-b494-cec98392d77f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:13:46.838989 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6c224-6f71-46cd-b494-cec98392d77f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:13:46.839162 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6c224-6f71-46cd-b494-cec98392d77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:13:46.867185 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-66b6c224-6f71-46cd-b494-cec98392d77f None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:13:46.868468 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-66b6c224-6f71-46cd-b494-cec98392d77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:13:46.953074 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 671/1345] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:13:46 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:13:46.992792 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53807c28-b173-4f02-bbf1-45ccc8ec1ee6 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:13:47.004553 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53807c28-b173-4f02-bbf1-45ccc8ec1ee6 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:13:47.008347 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01481d0-98ff-40b1-a2c6-d424f3d60bda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:13:47.009081 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01481d0-98ff-40b1-a2c6-d424f3d60bda service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:13:47.009439 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01481d0-98ff-40b1-a2c6-d424f3d60bda service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:13:47.009793 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01481d0-98ff-40b1-a2c6-d424f3d60bda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:13:47.019682 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01481d0-98ff-40b1-a2c6-d424f3d60bda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:13:47.021181 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01481d0-98ff-40b1-a2c6-d424f3d60bda service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:13:47.031711 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 675/1346] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:13:46 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:13:50.964795 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc72ccf-e199-4105-aac4-853bd1c0644e None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:13:50.965947 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc72ccf-e199-4105-aac4-853bd1c0644e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:13:50.965947 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc72ccf-e199-4105-aac4-853bd1c0644e None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:13:50.967418 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 672/1347] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:13:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:13:50.972487 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42be63a-41b8-4200-bfbe-d84320842b3e None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:13:50.972948 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42be63a-41b8-4200-bfbe-d84320842b3e None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:13:50.973108 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42be63a-41b8-4200-bfbe-d84320842b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:13:50.991591 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-c42be63a-41b8-4200-bfbe-d84320842b3e None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:13:50.992944 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-c42be63a-41b8-4200-bfbe-d84320842b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:13:51.001177 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 676/1348] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:13:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:13:51.041718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc72ccf-e199-4105-aac4-853bd1c0644e None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:13:51.053532 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc72ccf-e199-4105-aac4-853bd1c0644e None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:13:51.057186 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d5fdb-fe84-4414-b535-8eb4b162c86a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:13:51.057739 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d5fdb-fe84-4414-b535-8eb4b162c86a service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:13:51.058035 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d5fdb-fe84-4414-b535-8eb4b162c86a service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:13:51.058386 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d5fdb-fe84-4414-b535-8eb4b162c86a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:13:51.067535 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8d5fdb-fe84-4414-b535-8eb4b162c86a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:13:51.068991 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8d5fdb-fe84-4414-b535-8eb4b162c86a service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:13:51.079280 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 673/1349] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:13:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:13:56.029900 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf155a-6d92-44e6-b636-c68ca06025d0 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:13:56.030385 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf155a-6d92-44e6-b636-c68ca06025d0 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:13:56.030491 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf155a-6d92-44e6-b636-c68ca06025d0 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:13:56.031878 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 677/1350] 10.222.0.15 () {54 vars in 921 bytes} [Tue Jun 21 20:13:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:13:56.037096 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69ccbc-98c5-401b-9eed-f5c27ce8a502 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:13:56.037502 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69ccbc-98c5-401b-9eed-f5c27ce8a502 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:13:56.037697 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69ccbc-98c5-401b-9eed-f5c27ce8a502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:13:56.129819 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-5b69ccbc-98c5-401b-9eed-f5c27ce8a502 None None] MFA Rules not processed for user `a59294bff27c4b3f8aaeeab48ed35a0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:13:56.131732 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5b69ccbc-98c5-401b-9eed-f5c27ce8a502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:13:56.160646 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:13:56.251634 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 674/1351] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Jun 21 20:13:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:14:00.549238 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721399d0-81ec-4258-89f2-51e0a64554da None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:00.549773 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721399d0-81ec-4258-89f2-51e0a64554da None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:00.549957 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721399d0-81ec-4258-89f2-51e0a64554da None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:00.551169 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 678/1352] 10.222.0.15 () {54 vars in 921 bytes} [Tue Jun 21 20:14:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:14:00.556270 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31da56-6f21-49dc-ad9c-ebe7a45141d0 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:00.556696 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31da56-6f21-49dc-ad9c-ebe7a45141d0 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:00.557014 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31da56-6f21-49dc-ad9c-ebe7a45141d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:00.577636 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-cd31da56-6f21-49dc-ad9c-ebe7a45141d0 None None] MFA Rules not processed for user `a59294bff27c4b3f8aaeeab48ed35a0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:14:00.578923 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-cd31da56-6f21-49dc-ad9c-ebe7a45141d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:14:00.588712 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 675/1353] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Jun 21 20:14:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:14:00.988364 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=72 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:14:01.961850 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8f89b-4673-402b-8780-1c8b5e8e9349 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:01.962488 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8f89b-4673-402b-8780-1c8b5e8e9349 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:01.962488 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8f89b-4673-402b-8780-1c8b5e8e9349 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:01.963776 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 679/1354] 10.222.0.15 () {54 vars in 921 bytes} [Tue Jun 21 20:14:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:14:01.969662 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90c5e5-1255-4030-adff-206e895a0fbf None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:01.970112 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90c5e5-1255-4030-adff-206e895a0fbf None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:01.970209 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90c5e5-1255-4030-adff-206e895a0fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:01.990286 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-9c90c5e5-1255-4030-adff-206e895a0fbf None None] MFA Rules not processed for user `a59294bff27c4b3f8aaeeab48ed35a0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:14:01.991495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9c90c5e5-1255-4030-adff-206e895a0fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:14:02.001241 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 676/1355] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Jun 21 20:14:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:14:05.666136 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3bce7-0e77-4ae9-9e96-1b1d2e5ccfc6 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:05.666647 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3bce7-0e77-4ae9-9e96-1b1d2e5ccfc6 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:05.666647 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3bce7-0e77-4ae9-9e96-1b1d2e5ccfc6 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:05.668144 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 680/1356] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:14:05.674384 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce073d-59b3-44a4-afac-0ffca46cb40c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:05.675651 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce073d-59b3-44a4-afac-0ffca46cb40c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:05.675971 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce073d-59b3-44a4-afac-0ffca46cb40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:05.694548 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-66ce073d-59b3-44a4-afac-0ffca46cb40c None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:14:05.695858 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-66ce073d-59b3-44a4-afac-0ffca46cb40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:14:05.704846 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 677/1357] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:14:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:14:05.764908 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d350bc-3555-4431-a096-c905c68d91c1 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:05.765502 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d350bc-3555-4431-a096-c905c68d91c1 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:05.765994 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d350bc-3555-4431-a096-c905c68d91c1 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:05.767801 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 681/1358] 10.222.0.15 () {54 vars in 961 bytes} [Tue Jun 21 20:14:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:14:05.780699 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470175e-2d2e-42d3-ac21-6db279637997 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:05.781575 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470175e-2d2e-42d3-ac21-6db279637997 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:05.782065 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470175e-2d2e-42d3-ac21-6db279637997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:05.834516 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-b470175e-2d2e-42d3-ac21-6db279637997 None None] MFA Rules not processed for user `3918fe05c8634bc39f3e295374701465`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:14:05.835738 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b470175e-2d2e-42d3-ac21-6db279637997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:14:05.928111 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 678/1359] 10.222.0.15 () {58 vars in 1058 bytes} [Tue Jun 21 20:14:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 20:14:05.932861 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d350bc-3555-4431-a096-c905c68d91c1 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:14:05.948468 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d350bc-3555-4431-a096-c905c68d91c1 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:14:05.954711 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6bb97a-9a13-402d-aae3-ad0d9bf4ba9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3918fe05c8634bc39f3e295374701465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:14:05.955458 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6bb97a-9a13-402d-aae3-ad0d9bf4ba9e service nova] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:05.955814 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6bb97a-9a13-402d-aae3-ad0d9bf4ba9e service nova] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:05.956196 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6bb97a-9a13-402d-aae3-ad0d9bf4ba9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:05.965177 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6bb97a-9a13-402d-aae3-ad0d9bf4ba9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:14:05.966893 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6bb97a-9a13-402d-aae3-ad0d9bf4ba9e service nova] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:14:05.976881 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 682/1360] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:14:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 20:14:08.236751 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae9b2d-917a-4976-8d14-5393226c6038 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:08.237324 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae9b2d-917a-4976-8d14-5393226c6038 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:08.237324 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae9b2d-917a-4976-8d14-5393226c6038 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:08.238839 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 679/1361] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:14:08.243900 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521bcdb0-3a13-40d7-9ced-7ea35ba8125c None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:08.244358 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521bcdb0-3a13-40d7-9ced-7ea35ba8125c None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:08.244489 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521bcdb0-3a13-40d7-9ced-7ea35ba8125c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:08.263100 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-521bcdb0-3a13-40d7-9ced-7ea35ba8125c None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:14:08.264331 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-521bcdb0-3a13-40d7-9ced-7ea35ba8125c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:14:08.272292 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 683/1362] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:14:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:14:08.318920 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae9b2d-917a-4976-8d14-5393226c6038 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:14:08.335519 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae9b2d-917a-4976-8d14-5393226c6038 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:14:08.341668 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79839b55-e6e5-4128-8d02-38e039fdbd43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3918fe05c8634bc39f3e295374701465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:14:08.342574 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79839b55-e6e5-4128-8d02-38e039fdbd43 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:08.342962 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79839b55-e6e5-4128-8d02-38e039fdbd43 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:08.343539 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79839b55-e6e5-4128-8d02-38e039fdbd43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:08.352768 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79839b55-e6e5-4128-8d02-38e039fdbd43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:14:08.354738 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79839b55-e6e5-4128-8d02-38e039fdbd43 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:14:08.365131 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 680/1363] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:14:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:14:10.711615 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c83f57-123f-4c0d-8677-0c3f91778eee None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:10.712344 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c83f57-123f-4c0d-8677-0c3f91778eee None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:10.712344 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c83f57-123f-4c0d-8677-0c3f91778eee None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:10.716028 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 684/1364] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:14:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:14:10.721459 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2200d14-d197-4a4f-b37b-3d1261ef4fa9 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:10.721908 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2200d14-d197-4a4f-b37b-3d1261ef4fa9 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:10.722020 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2200d14-d197-4a4f-b37b-3d1261ef4fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:10.749316 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e2200d14-d197-4a4f-b37b-3d1261ef4fa9 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:14:10.750516 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e2200d14-d197-4a4f-b37b-3d1261ef4fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:14:10.775110 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 681/1365] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:14:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:14:10.807364 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29763849-5cf1-4492-9dba-088066203f52 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:10.807659 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29763849-5cf1-4492-9dba-088066203f52 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:10.807981 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29763849-5cf1-4492-9dba-088066203f52 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:10.809355 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 685/1366] 10.222.0.15 () {54 vars in 961 bytes} [Tue Jun 21 20:14:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:14:10.814621 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73280c-bdf5-4081-8723-ad39e44ad59c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:10.814918 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73280c-bdf5-4081-8723-ad39e44ad59c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:10.815324 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73280c-bdf5-4081-8723-ad39e44ad59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:10.833281 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ea73280c-bdf5-4081-8723-ad39e44ad59c None None] MFA Rules not processed for user `3918fe05c8634bc39f3e295374701465`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:14:10.834495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ea73280c-bdf5-4081-8723-ad39e44ad59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:14:10.844336 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 682/1367] 10.222.0.15 () {58 vars in 1058 bytes} [Tue Jun 21 20:14:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:14:10.852712 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29763849-5cf1-4492-9dba-088066203f52 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:14:10.870465 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29763849-5cf1-4492-9dba-088066203f52 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:14:10.875826 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9115a1-74e2-4528-882e-c9574ec84f64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3918fe05c8634bc39f3e295374701465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:14:10.876586 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9115a1-74e2-4528-882e-c9574ec84f64 service nova] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:10.876879 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9115a1-74e2-4528-882e-c9574ec84f64 service nova] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:10.877160 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9115a1-74e2-4528-882e-c9574ec84f64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:10.885458 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9115a1-74e2-4528-882e-c9574ec84f64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:14:10.887120 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9115a1-74e2-4528-882e-c9574ec84f64 service nova] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:14:10.896832 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 686/1368] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:14:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:14:13.000811 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e37a8a-7457-40f5-94dd-e80b36d3f465 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:13.001384 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e37a8a-7457-40f5-94dd-e80b36d3f465 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:13.001384 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e37a8a-7457-40f5-94dd-e80b36d3f465 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:13.002779 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 683/1369] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:14:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:14:13.008710 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2a953-17b7-42ff-9c6a-bc9439ac9904 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:13.009274 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2a953-17b7-42ff-9c6a-bc9439ac9904 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:13.009274 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2a953-17b7-42ff-9c6a-bc9439ac9904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:13.028924 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-92e2a953-17b7-42ff-9c6a-bc9439ac9904 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:14:13.030145 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-92e2a953-17b7-42ff-9c6a-bc9439ac9904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:14:13.038361 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 687/1370] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:14:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:14:13.082649 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e37a8a-7457-40f5-94dd-e80b36d3f465 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:14:13.097187 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e37a8a-7457-40f5-94dd-e80b36d3f465 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:14:13.103062 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d32dc50-de31-435f-a114-825d0a621693 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3918fe05c8634bc39f3e295374701465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:14:13.103701 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32dc50-de31-435f-a114-825d0a621693 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:13.104011 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32dc50-de31-435f-a114-825d0a621693 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:13.104288 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32dc50-de31-435f-a114-825d0a621693 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:13.113152 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d32dc50-de31-435f-a114-825d0a621693 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:14:13.114733 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d32dc50-de31-435f-a114-825d0a621693 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:14:13.125044 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 684/1371] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:14:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:14:13.710693 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f3f1c-d4e4-4d57-85b6-a1b6eb40f702 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:13.711063 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f3f1c-d4e4-4d57-85b6-a1b6eb40f702 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:13.711441 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f3f1c-d4e4-4d57-85b6-a1b6eb40f702 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:13.713100 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 688/1372] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:14:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:14:13.718926 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36c551-725c-49c9-b1c6-7ab3a136f5d7 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:13.719321 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36c551-725c-49c9-b1c6-7ab3a136f5d7 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:13.719727 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36c551-725c-49c9-b1c6-7ab3a136f5d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:13.739175 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ef36c551-725c-49c9-b1c6-7ab3a136f5d7 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:14:13.740407 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ef36c551-725c-49c9-b1c6-7ab3a136f5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:14:13.751191 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 685/1373] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:14:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:14:14.090249 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e71cab0-7406-4118-8b18-a476300e64da None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:14.090249 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e71cab0-7406-4118-8b18-a476300e64da None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:14.091023 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e71cab0-7406-4118-8b18-a476300e64da None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:14.091811 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 689/1374] 10.222.0.15 () {54 vars in 963 bytes} [Tue Jun 21 20:14:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:14:14.097018 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e930c8-58d5-444a-b5ec-6fd0c28c6d7e None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:14.097446 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e930c8-58d5-444a-b5ec-6fd0c28c6d7e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:14.097640 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e930c8-58d5-444a-b5ec-6fd0c28c6d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:14.105840 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:14:14.149571 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-a3e930c8-58d5-444a-b5ec-6fd0c28c6d7e None None] MFA Rules not processed for user `d95478de171141ce85876e852d081149`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:14:14.151017 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a3e930c8-58d5-444a-b5ec-6fd0c28c6d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:14:14.215398 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 686/1375] 10.222.0.15 () {58 vars in 1060 bytes} [Tue Jun 21 20:14:14 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:14:14.223079 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e71cab0-7406-4118-8b18-a476300e64da None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:14:14.235977 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e71cab0-7406-4118-8b18-a476300e64da None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:14:14.239905 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83164354-f4b3-4e1e-91d3-e89f7538097a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:14:14.240572 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83164354-f4b3-4e1e-91d3-e89f7538097a service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:14.240858 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83164354-f4b3-4e1e-91d3-e89f7538097a service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:14.241173 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83164354-f4b3-4e1e-91d3-e89f7538097a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:14.250733 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83164354-f4b3-4e1e-91d3-e89f7538097a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:14:14.252198 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83164354-f4b3-4e1e-91d3-e89f7538097a service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:14:14.262968 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 690/1376] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:14:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:14:15.230902 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46890796-fe64-46b9-86e1-11cbad757293 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:15.231834 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46890796-fe64-46b9-86e1-11cbad757293 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:15.232178 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46890796-fe64-46b9-86e1-11cbad757293 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:15.233646 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 687/1377] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:14:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:14:15.238928 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908940b8-edc2-4655-a8e6-33ba03b68048 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:15.239314 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908940b8-edc2-4655-a8e6-33ba03b68048 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:15.239436 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908940b8-edc2-4655-a8e6-33ba03b68048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:15.259010 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-908940b8-edc2-4655-a8e6-33ba03b68048 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:14:15.260934 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-908940b8-edc2-4655-a8e6-33ba03b68048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:14:15.269936 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 691/1378] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:14:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:14:15.314529 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46890796-fe64-46b9-86e1-11cbad757293 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:14:15.329639 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46890796-fe64-46b9-86e1-11cbad757293 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:14:15.335238 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db28e9-7fb0-471d-bbeb-d4b170b1452a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3918fe05c8634bc39f3e295374701465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:14:15.335873 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db28e9-7fb0-471d-bbeb-d4b170b1452a service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:15.336186 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db28e9-7fb0-471d-bbeb-d4b170b1452a service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:15.336462 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db28e9-7fb0-471d-bbeb-d4b170b1452a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:15.345147 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db28e9-7fb0-471d-bbeb-d4b170b1452a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:14:15.346708 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db28e9-7fb0-471d-bbeb-d4b170b1452a service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:14:15.356774 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 688/1379] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:14:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:14:17.417269 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc7178-3544-4ae1-903b-d25c65e8f641 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:17.417934 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc7178-3544-4ae1-903b-d25c65e8f641 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:17.417934 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc7178-3544-4ae1-903b-d25c65e8f641 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:17.419340 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 692/1380] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:14:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:14:17.424726 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002baea8-7b23-467b-a0fe-dcdd388fca80 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:17.425142 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002baea8-7b23-467b-a0fe-dcdd388fca80 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:17.425293 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002baea8-7b23-467b-a0fe-dcdd388fca80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:17.443512 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-002baea8-7b23-467b-a0fe-dcdd388fca80 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:14:17.444734 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-002baea8-7b23-467b-a0fe-dcdd388fca80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:14:17.453548 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 689/1381] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:14:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:14:17.498772 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc7178-3544-4ae1-903b-d25c65e8f641 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:14:17.513831 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc7178-3544-4ae1-903b-d25c65e8f641 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:14:17.519284 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d70235-4dc8-46af-b72c-030fd1f73ea2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3918fe05c8634bc39f3e295374701465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:14:17.519995 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d70235-4dc8-46af-b72c-030fd1f73ea2 service nova] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:17.520311 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d70235-4dc8-46af-b72c-030fd1f73ea2 service nova] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:17.520588 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d70235-4dc8-46af-b72c-030fd1f73ea2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:17.528584 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d70235-4dc8-46af-b72c-030fd1f73ea2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:14:17.530151 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d70235-4dc8-46af-b72c-030fd1f73ea2 service nova] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:14:17.539359 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 693/1382] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:14:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:14:19.615233 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc051a-29c4-44dc-a809-12bdb67e005b None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:19.615745 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc051a-29c4-44dc-a809-12bdb67e005b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:19.615850 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc051a-29c4-44dc-a809-12bdb67e005b None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:19.617201 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 690/1383] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:14:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:14:19.622608 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fb595-d8f5-4d26-9142-6472461b8619 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:19.623049 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fb595-d8f5-4d26-9142-6472461b8619 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:19.623172 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fb595-d8f5-4d26-9142-6472461b8619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:19.641227 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-fb3fb595-d8f5-4d26-9142-6472461b8619 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:14:19.642623 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-fb3fb595-d8f5-4d26-9142-6472461b8619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:14:19.650802 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 694/1384] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:14:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:14:19.694190 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc051a-29c4-44dc-a809-12bdb67e005b None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:14:19.709478 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc051a-29c4-44dc-a809-12bdb67e005b None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:14:19.715648 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74407aea-b231-4243-aa1c-e2a571bf5af9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3918fe05c8634bc39f3e295374701465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:14:19.716447 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74407aea-b231-4243-aa1c-e2a571bf5af9 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:19.716853 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74407aea-b231-4243-aa1c-e2a571bf5af9 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:19.717226 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74407aea-b231-4243-aa1c-e2a571bf5af9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:19.727184 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74407aea-b231-4243-aa1c-e2a571bf5af9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:14:19.729238 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74407aea-b231-4243-aa1c-e2a571bf5af9 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:14:19.741374 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 691/1385] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:14:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:14:21.811297 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4d655-f993-4637-b3b3-de24f3503453 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:21.811827 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4d655-f993-4637-b3b3-de24f3503453 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:21.811955 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4d655-f993-4637-b3b3-de24f3503453 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:21.813383 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 695/1386] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:14:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:14:21.819723 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164dd538-4372-4fe8-a227-896b2f8987fa None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:21.820139 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164dd538-4372-4fe8-a227-896b2f8987fa None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:21.820380 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164dd538-4372-4fe8-a227-896b2f8987fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:21.840643 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-164dd538-4372-4fe8-a227-896b2f8987fa None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:14:21.841919 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-164dd538-4372-4fe8-a227-896b2f8987fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:14:21.850200 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 692/1387] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:14:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:14:21.906698 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a4d655-f993-4637-b3b3-de24f3503453 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:14:21.921511 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a4d655-f993-4637-b3b3-de24f3503453 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:14:21.927077 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ff482a-cfaa-4d90-b738-1585ac09493d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3918fe05c8634bc39f3e295374701465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:14:21.927720 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff482a-cfaa-4d90-b738-1585ac09493d service nova] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:21.928040 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff482a-cfaa-4d90-b738-1585ac09493d service nova] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:21.928323 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff482a-cfaa-4d90-b738-1585ac09493d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:21.936998 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ff482a-cfaa-4d90-b738-1585ac09493d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:14:21.938580 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ff482a-cfaa-4d90-b738-1585ac09493d service nova] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:14:21.947964 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 696/1388] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:14:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:14:23.979763 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b3c916-2490-4d33-a63d-c906fe42ebc6 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:23.980328 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b3c916-2490-4d33-a63d-c906fe42ebc6 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:23.980603 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b3c916-2490-4d33-a63d-c906fe42ebc6 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:23.982399 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 693/1389] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:14:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:14:23.987842 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f1b9e-2108-46fc-a58d-0fcdb154d4ea None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:23.988282 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f1b9e-2108-46fc-a58d-0fcdb154d4ea None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:23.988518 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f1b9e-2108-46fc-a58d-0fcdb154d4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:24.006605 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-117f1b9e-2108-46fc-a58d-0fcdb154d4ea None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:14:24.007805 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-117f1b9e-2108-46fc-a58d-0fcdb154d4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:14:24.016379 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 697/1390] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:14:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:14:24.064091 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b3c916-2490-4d33-a63d-c906fe42ebc6 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:14:24.079475 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b3c916-2490-4d33-a63d-c906fe42ebc6 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:14:24.084835 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5736c35b-a692-4870-a805-23d58f16f5ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3918fe05c8634bc39f3e295374701465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:14:24.085467 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736c35b-a692-4870-a805-23d58f16f5ae service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:24.085921 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736c35b-a692-4870-a805-23d58f16f5ae service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:24.086198 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736c35b-a692-4870-a805-23d58f16f5ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:24.095636 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5736c35b-a692-4870-a805-23d58f16f5ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:14:24.097294 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5736c35b-a692-4870-a805-23d58f16f5ae service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:14:24.107050 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 694/1391] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:14:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:14:26.179875 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3c5f4-b93f-4fe7-ad59-132e3205b6c4 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:26.180431 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3c5f4-b93f-4fe7-ad59-132e3205b6c4 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:26.180643 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3c5f4-b93f-4fe7-ad59-132e3205b6c4 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:26.183129 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 698/1392] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:14:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:14:26.188403 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ee950-41a1-4055-bca2-695a1b67ceed None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:26.189008 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ee950-41a1-4055-bca2-695a1b67ceed None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:26.189106 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ee950-41a1-4055-bca2-695a1b67ceed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:26.208538 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-0e2ee950-41a1-4055-bca2-695a1b67ceed None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:14:26.209836 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0e2ee950-41a1-4055-bca2-695a1b67ceed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:14:26.218167 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 695/1393] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:14:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 20:14:26.264256 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c3c5f4-b93f-4fe7-ad59-132e3205b6c4 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:14:26.279405 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c3c5f4-b93f-4fe7-ad59-132e3205b6c4 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:14:26.285105 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a2a61c-12aa-4a0a-9fa2-3b317be2de41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3918fe05c8634bc39f3e295374701465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:14:26.285769 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2a61c-12aa-4a0a-9fa2-3b317be2de41 service nova] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:26.286052 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2a61c-12aa-4a0a-9fa2-3b317be2de41 service nova] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:26.286347 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2a61c-12aa-4a0a-9fa2-3b317be2de41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:26.295433 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a2a61c-12aa-4a0a-9fa2-3b317be2de41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:14:26.297142 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a2a61c-12aa-4a0a-9fa2-3b317be2de41 service nova] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:14:26.307314 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 699/1394] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:14:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 20:14:28.371517 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520f60c-df05-4099-b185-82e23c20862a None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:28.372080 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520f60c-df05-4099-b185-82e23c20862a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:28.372164 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520f60c-df05-4099-b185-82e23c20862a None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:28.373692 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 696/1395] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:14:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:14:28.379267 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89497989-0284-41f5-8135-8428504dcdd5 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:28.379844 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89497989-0284-41f5-8135-8428504dcdd5 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:28.379844 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89497989-0284-41f5-8135-8428504dcdd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:28.398018 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-89497989-0284-41f5-8135-8428504dcdd5 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:14:28.399227 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-89497989-0284-41f5-8135-8428504dcdd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:14:28.407298 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 700/1396] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:14:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:14:28.452282 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2520f60c-df05-4099-b185-82e23c20862a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:14:28.467028 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2520f60c-df05-4099-b185-82e23c20862a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:14:28.472368 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc7b8e-0888-4b83-b8f8-5f1c8bb00c59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3918fe05c8634bc39f3e295374701465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:14:28.473017 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc7b8e-0888-4b83-b8f8-5f1c8bb00c59 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:28.473307 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc7b8e-0888-4b83-b8f8-5f1c8bb00c59 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:28.473588 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc7b8e-0888-4b83-b8f8-5f1c8bb00c59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:28.482619 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cc7b8e-0888-4b83-b8f8-5f1c8bb00c59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:14:28.484227 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cc7b8e-0888-4b83-b8f8-5f1c8bb00c59 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:14:28.493733 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 697/1397] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:14:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:14:29.306177 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b96e54-eeed-4d68-8bc5-14d7ab3de4b5 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:29.306466 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b96e54-eeed-4d68-8bc5-14d7ab3de4b5 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:29.306745 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b96e54-eeed-4d68-8bc5-14d7ab3de4b5 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:29.308187 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 701/1398] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:14:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:14:29.313328 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bed7c3-f7c6-434b-b63b-9f08669a19fd None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:29.313623 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bed7c3-f7c6-434b-b63b-9f08669a19fd None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:29.313909 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bed7c3-f7c6-434b-b63b-9f08669a19fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:29.331624 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-57bed7c3-f7c6-434b-b63b-9f08669a19fd None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:14:29.332851 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-57bed7c3-f7c6-434b-b63b-9f08669a19fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:14:29.341113 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 698/1399] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:14:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 20:14:29.396590 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a81dcd-02ad-4c00-82ff-c689de2ff442 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:29.397053 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a81dcd-02ad-4c00-82ff-c689de2ff442 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:29.397161 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a81dcd-02ad-4c00-82ff-c689de2ff442 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:29.398518 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 702/1400] 10.222.0.15 () {54 vars in 962 bytes} [Tue Jun 21 20:14:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:14:29.403464 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377a0f3-99dc-4f9d-ab40-027d24fddca5 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:29.403891 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377a0f3-99dc-4f9d-ab40-027d24fddca5 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:29.404183 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377a0f3-99dc-4f9d-ab40-027d24fddca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:29.452586 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-d377a0f3-99dc-4f9d-ab40-027d24fddca5 None None] MFA Rules not processed for user `30400df887ee433086d1810331785891`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:14:29.453772 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d377a0f3-99dc-4f9d-ab40-027d24fddca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:14:29.486062 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:14:29.515305 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 699/1401] 10.222.0.15 () {58 vars in 1059 bytes} [Tue Jun 21 20:14:29 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:14:29.523137 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a81dcd-02ad-4c00-82ff-c689de2ff442 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:14:29.533526 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a81dcd-02ad-4c00-82ff-c689de2ff442 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:14:29.536921 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2200c-a63c-40e0-bd27-a2102d1a8410 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30400df887ee433086d1810331785891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:14:29.537552 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2200c-a63c-40e0-bd27-a2102d1a8410 service glance] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:29.537834 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2200c-a63c-40e0-bd27-a2102d1a8410 service glance] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:29.538110 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2200c-a63c-40e0-bd27-a2102d1a8410 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:29.546777 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c2200c-a63c-40e0-bd27-a2102d1a8410 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:14:29.548250 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c2200c-a63c-40e0-bd27-a2102d1a8410 service glance] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:14:29.557974 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 703/1402] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:14:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:14:30.257447 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c40a8e-72e9-49b2-845a-ee55039cfe32 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:30.257743 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c40a8e-72e9-49b2-845a-ee55039cfe32 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:30.258027 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c40a8e-72e9-49b2-845a-ee55039cfe32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:30.306302 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-48c40a8e-72e9-49b2-845a-ee55039cfe32 None None] MFA Rules not processed for user `5cf067b8833f4596a1b91073a66768f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:14:30.307606 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-48c40a8e-72e9-49b2-845a-ee55039cfe32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:14:30.372119 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 700/1403] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jun 21 20:14:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:14:30.416548 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0758f-020f-4bc9-bee7-fc56a584455e None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:30.417567 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0758f-020f-4bc9-bee7-fc56a584455e None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:30.417721 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0758f-020f-4bc9-bee7-fc56a584455e None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:30.419359 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 704/1404] 10.222.0.15 () {54 vars in 942 bytes} [Tue Jun 21 20:14:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:14:30.425449 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3ed50-1c66-4daa-b2f5-a9a69079cee7 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:30.425859 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3ed50-1c66-4daa-b2f5-a9a69079cee7 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:30.426037 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3ed50-1c66-4daa-b2f5-a9a69079cee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:30.473943 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-90a3ed50-1c66-4daa-b2f5-a9a69079cee7 None None] MFA Rules not processed for user `038537bd12174154ba259e097b97b8bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:14:30.475061 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-90a3ed50-1c66-4daa-b2f5-a9a69079cee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:14:30.541468 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076cc0ad-5e70-48e9-b43c-6598ff892b3c None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:30.541796 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076cc0ad-5e70-48e9-b43c-6598ff892b3c None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:30.542085 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076cc0ad-5e70-48e9-b43c-6598ff892b3c None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:30.543454 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 705/1405] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:14:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 20:14:30.545711 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 701/1406] 10.222.0.15 () {58 vars in 1039 bytes} [Tue Jun 21 20:14:30 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 20:14:30.548212 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a418a-84ae-4560-8e2a-7632dd0f599b None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:30.548508 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a418a-84ae-4560-8e2a-7632dd0f599b None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:30.548791 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a418a-84ae-4560-8e2a-7632dd0f599b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:30.555340 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a3ed50-1c66-4daa-b2f5-a9a69079cee7 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:14:30.565784 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a3ed50-1c66-4daa-b2f5-a9a69079cee7 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:14:30.567292 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-630a418a-84ae-4560-8e2a-7632dd0f599b None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:14:30.568656 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-630a418a-84ae-4560-8e2a-7632dd0f599b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:14:30.570730 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b56852-6d77-4973-a529-bceb623d5676 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '038537bd12174154ba259e097b97b8bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:14:30.571654 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b56852-6d77-4973-a529-bceb623d5676 service swift] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:30.572021 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b56852-6d77-4973-a529-bceb623d5676 service swift] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:30.572306 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b56852-6d77-4973-a529-bceb623d5676 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:30.577052 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 706/1407] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:14:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:14:30.580825 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b56852-6d77-4973-a529-bceb623d5676 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:14:30.582395 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b56852-6d77-4973-a529-bceb623d5676 service swift] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:14:30.586851 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:14:30.591847 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 702/1408] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jun 21 20:14:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 21 20:14:30.621463 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a418a-84ae-4560-8e2a-7632dd0f599b None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:14:30.634937 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a418a-84ae-4560-8e2a-7632dd0f599b None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:14:30.641033 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6878a121-608a-42c1-b24b-1a57bb8a0590 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3918fe05c8634bc39f3e295374701465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:14:30.641683 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878a121-608a-42c1-b24b-1a57bb8a0590 service nova] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:30.641967 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878a121-608a-42c1-b24b-1a57bb8a0590 service nova] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:30.642247 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878a121-608a-42c1-b24b-1a57bb8a0590 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:30.652417 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6878a121-608a-42c1-b24b-1a57bb8a0590 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:14:30.654361 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6878a121-608a-42c1-b24b-1a57bb8a0590 service nova] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:14:30.665020 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 707/1409] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:14:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:14:40.660740 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=69 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:14:52.917430 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1353f7b-744a-43a8-89bb-8ae973d07f9c None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:52.917865 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1353f7b-744a-43a8-89bb-8ae973d07f9c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:52.917969 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1353f7b-744a-43a8-89bb-8ae973d07f9c None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:52.919368 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 703/1410] 10.222.0.15 () {54 vars in 918 bytes} [Tue Jun 21 20:14:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:14:52.924631 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aff4cf-c3c1-496d-bc1c-563ca2bd49d1 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:52.925064 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aff4cf-c3c1-496d-bc1c-563ca2bd49d1 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:52.925200 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aff4cf-c3c1-496d-bc1c-563ca2bd49d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:52.943019 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-21aff4cf-c3c1-496d-bc1c-563ca2bd49d1 None None] MFA Rules not processed for user `a59294bff27c4b3f8aaeeab48ed35a0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:14:52.944251 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-21aff4cf-c3c1-496d-bc1c-563ca2bd49d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:14:52.952852 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 708/1411] 10.222.0.15 () {58 vars in 1015 bytes} [Tue Jun 21 20:14:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:14:52.968064 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463a9bb-8974-49a5-9ee9-767f054bf334 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:52.968363 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463a9bb-8974-49a5-9ee9-767f054bf334 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:52.968646 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463a9bb-8974-49a5-9ee9-767f054bf334 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:52.970016 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 704/1412] 10.222.0.15 () {54 vars in 918 bytes} [Tue Jun 21 20:14:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:14:52.974428 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173a14e-c26b-4654-9a18-22933c07abe4 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:52.974722 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173a14e-c26b-4654-9a18-22933c07abe4 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:52.975006 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173a14e-c26b-4654-9a18-22933c07abe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:52.993422 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-0173a14e-c26b-4654-9a18-22933c07abe4 None None] MFA Rules not processed for user `3918fe05c8634bc39f3e295374701465`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:14:52.994595 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-0173a14e-c26b-4654-9a18-22933c07abe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:14:53.003559 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 709/1413] 10.222.0.15 () {58 vars in 1015 bytes} [Tue Jun 21 20:14:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:14:55.493422 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04ac63-7e15-4489-b915-a6d890cf4040 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:55.494009 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04ac63-7e15-4489-b915-a6d890cf4040 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:55.494009 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04ac63-7e15-4489-b915-a6d890cf4040 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:55.495514 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 705/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 20:14:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:14:55.500757 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d7874-73fc-495d-b261-3b6d9aa35de8 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:55.501182 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d7874-73fc-495d-b261-3b6d9aa35de8 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:55.501330 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d7874-73fc-495d-b261-3b6d9aa35de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:55.519282 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-b57d7874-73fc-495d-b261-3b6d9aa35de8 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:14:55.520506 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-b57d7874-73fc-495d-b261-3b6d9aa35de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:14:55.528858 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 710/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 20:14:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:14:55.570774 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04ac63-7e15-4489-b915-a6d890cf4040 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:14:55.585949 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04ac63-7e15-4489-b915-a6d890cf4040 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:14:55.591842 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9d838-9cff-4469-960b-ed941aee2ea3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3918fe05c8634bc39f3e295374701465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:14:55.592500 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9d838-9cff-4469-960b-ed941aee2ea3 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:55.592784 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9d838-9cff-4469-960b-ed941aee2ea3 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:55.593328 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9d838-9cff-4469-960b-ed941aee2ea3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:55.601526 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b9d838-9cff-4469-960b-ed941aee2ea3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:14:55.603075 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b9d838-9cff-4469-960b-ed941aee2ea3 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:14:55.612449 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 706/1416] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:14:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:14:56.503564 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a277b-1a40-4f55-9c8c-e5d69e717b14 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:56.504159 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a277b-1a40-4f55-9c8c-e5d69e717b14 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:56.504159 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a277b-1a40-4f55-9c8c-e5d69e717b14 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:56.505544 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 711/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 20:14:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:14:56.510583 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea86e51-15df-4c53-a2ba-1825ae49a240 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:56.511030 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea86e51-15df-4c53-a2ba-1825ae49a240 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:56.511129 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea86e51-15df-4c53-a2ba-1825ae49a240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:56.529810 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-cea86e51-15df-4c53-a2ba-1825ae49a240 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:14:56.531001 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-cea86e51-15df-4c53-a2ba-1825ae49a240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:14:56.538628 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 707/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 20:14:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:14:56.689698 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a277b-1a40-4f55-9c8c-e5d69e717b14 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:14:56.703781 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a277b-1a40-4f55-9c8c-e5d69e717b14 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:14:56.709075 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129e088-d15d-47ce-8fc0-60b56930a86f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3918fe05c8634bc39f3e295374701465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:14:56.709707 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129e088-d15d-47ce-8fc0-60b56930a86f service nova] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:56.709992 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129e088-d15d-47ce-8fc0-60b56930a86f service nova] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:56.710296 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129e088-d15d-47ce-8fc0-60b56930a86f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:56.718729 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5129e088-d15d-47ce-8fc0-60b56930a86f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:14:56.720403 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5129e088-d15d-47ce-8fc0-60b56930a86f service nova] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:14:56.730425 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 712/1419] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:14:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:14:57.608479 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe451f-db9e-4a81-8985-1c59722acb5f None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:57.609015 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe451f-db9e-4a81-8985-1c59722acb5f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:57.609015 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe451f-db9e-4a81-8985-1c59722acb5f None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:57.610404 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 708/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 20:14:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:14:57.615431 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8970a15-ca37-4116-8e11-0691e2a6fc10 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:57.615845 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8970a15-ca37-4116-8e11-0691e2a6fc10 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:57.615980 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8970a15-ca37-4116-8e11-0691e2a6fc10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:57.634205 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-b8970a15-ca37-4116-8e11-0691e2a6fc10 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:14:57.635393 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-b8970a15-ca37-4116-8e11-0691e2a6fc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:14:57.643127 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 713/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 20:14:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:14:57.792826 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe451f-db9e-4a81-8985-1c59722acb5f None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:14:57.807422 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe451f-db9e-4a81-8985-1c59722acb5f None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:14:57.812773 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0ef13-4f55-48d6-aebb-51bde0caa16b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3918fe05c8634bc39f3e295374701465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:14:57.813403 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0ef13-4f55-48d6-aebb-51bde0caa16b service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:57.813686 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0ef13-4f55-48d6-aebb-51bde0caa16b service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:57.813961 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0ef13-4f55-48d6-aebb-51bde0caa16b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:57.821876 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a0ef13-4f55-48d6-aebb-51bde0caa16b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:14:57.823462 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a0ef13-4f55-48d6-aebb-51bde0caa16b service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:14:57.832588 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 709/1422] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:14:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:14:58.694867 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd572a4f-2c02-43ad-9365-2f743ea90e87 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:58.695437 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd572a4f-2c02-43ad-9365-2f743ea90e87 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:58.695558 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd572a4f-2c02-43ad-9365-2f743ea90e87 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:58.696992 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 714/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 20:14:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 20:14:58.702398 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a84b1-fcef-4986-a7ce-28dbfae09f57 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:58.702792 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a84b1-fcef-4986-a7ce-28dbfae09f57 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:58.702991 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a84b1-fcef-4986-a7ce-28dbfae09f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:58.721119 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-347a84b1-fcef-4986-a7ce-28dbfae09f57 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:14:58.722325 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-347a84b1-fcef-4986-a7ce-28dbfae09f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:14:58.730904 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 710/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 20:14:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:14:58.880065 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd572a4f-2c02-43ad-9365-2f743ea90e87 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:14:58.894108 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd572a4f-2c02-43ad-9365-2f743ea90e87 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:14:58.899423 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0dd58-59c4-45bb-89e1-4a2b4e452af2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3918fe05c8634bc39f3e295374701465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:14:58.900574 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0dd58-59c4-45bb-89e1-4a2b4e452af2 service nova] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:58.900858 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0dd58-59c4-45bb-89e1-4a2b4e452af2 service nova] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:58.901128 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0dd58-59c4-45bb-89e1-4a2b4e452af2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:58.909047 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0dd58-59c4-45bb-89e1-4a2b4e452af2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:14:58.910607 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0dd58-59c4-45bb-89e1-4a2b4e452af2 service nova] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:14:58.920549 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 715/1425] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:14:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:14:59.770467 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6a53d-1515-40b4-b234-3237266611ba None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:59.771057 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6a53d-1515-40b4-b234-3237266611ba None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:59.771057 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6a53d-1515-40b4-b234-3237266611ba None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:59.772447 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 711/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 20:14:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:14:59.777954 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564325d-ebb9-4c6a-b942-cf0f790a739e None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:59.778404 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564325d-ebb9-4c6a-b942-cf0f790a739e None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:59.778511 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564325d-ebb9-4c6a-b942-cf0f790a739e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:59.795872 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-b564325d-ebb9-4c6a-b942-cf0f790a739e None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:14:59.797104 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-b564325d-ebb9-4c6a-b942-cf0f790a739e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:14:59.804696 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 716/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 20:14:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:14:59.955961 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6a53d-1515-40b4-b234-3237266611ba None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:14:59.970784 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6a53d-1515-40b4-b234-3237266611ba None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:14:59.976515 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6bbc5-1e0f-4528-8703-6090b98c676e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3918fe05c8634bc39f3e295374701465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:14:59.977147 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6bbc5-1e0f-4528-8703-6090b98c676e service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:14:59.977431 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6bbc5-1e0f-4528-8703-6090b98c676e service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:14:59.977707 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6bbc5-1e0f-4528-8703-6090b98c676e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:14:59.985775 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea6bbc5-1e0f-4528-8703-6090b98c676e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:14:59.987331 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea6bbc5-1e0f-4528-8703-6090b98c676e service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:14:59.996422 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 712/1428] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:14:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:15:00.792700 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd18d03-0898-41ad-8dbf-dd6d932b0305 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:00.793270 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd18d03-0898-41ad-8dbf-dd6d932b0305 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:00.793270 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd18d03-0898-41ad-8dbf-dd6d932b0305 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:00.794648 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 717/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 20:15:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:15:00.799636 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a86b9-be95-44e2-9a16-ccc1842c47cb None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:00.800042 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a86b9-be95-44e2-9a16-ccc1842c47cb None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:00.800226 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a86b9-be95-44e2-9a16-ccc1842c47cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:00.818389 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-002a86b9-be95-44e2-9a16-ccc1842c47cb None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:15:00.819593 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-002a86b9-be95-44e2-9a16-ccc1842c47cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:15:00.827332 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 713/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 20:15:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:15:00.978993 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd18d03-0898-41ad-8dbf-dd6d932b0305 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:15:00.993190 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd18d03-0898-41ad-8dbf-dd6d932b0305 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:15:00.998604 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4829df13-73cd-4d88-b5fa-d0c573c0f449 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3918fe05c8634bc39f3e295374701465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:15:00.999259 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4829df13-73cd-4d88-b5fa-d0c573c0f449 service nova] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:00.999532 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4829df13-73cd-4d88-b5fa-d0c573c0f449 service nova] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:00.999821 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4829df13-73cd-4d88-b5fa-d0c573c0f449 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:01.007981 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4829df13-73cd-4d88-b5fa-d0c573c0f449 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:15:01.009559 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4829df13-73cd-4d88-b5fa-d0c573c0f449 service nova] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:15:01.018962 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 718/1431] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:15:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:15:01.819946 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44fdf32-8f51-49e8-8454-4eddc4e64a79 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:01.820519 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44fdf32-8f51-49e8-8454-4eddc4e64a79 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:01.820519 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44fdf32-8f51-49e8-8454-4eddc4e64a79 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:01.822573 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 714/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 20:15:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:15:01.827539 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2b9fd-72de-416f-a880-750b5f0b2fe4 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:01.828074 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2b9fd-72de-416f-a880-750b5f0b2fe4 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:01.828182 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2b9fd-72de-416f-a880-750b5f0b2fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:01.846237 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-66b2b9fd-72de-416f-a880-750b5f0b2fe4 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:15:01.847461 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-66b2b9fd-72de-416f-a880-750b5f0b2fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:15:01.855652 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 719/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 20:15:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 20:15:02.007199 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44fdf32-8f51-49e8-8454-4eddc4e64a79 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:15:02.023806 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44fdf32-8f51-49e8-8454-4eddc4e64a79 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:15:02.029503 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803fd225-293e-4daa-9e07-cb05957e0715 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3918fe05c8634bc39f3e295374701465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:15:02.030181 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803fd225-293e-4daa-9e07-cb05957e0715 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:02.030471 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803fd225-293e-4daa-9e07-cb05957e0715 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:02.030754 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803fd225-293e-4daa-9e07-cb05957e0715 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:02.039947 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803fd225-293e-4daa-9e07-cb05957e0715 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:15:02.042102 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803fd225-293e-4daa-9e07-cb05957e0715 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:15:02.051793 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 715/1434] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:15:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:15:02.859210 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c326ce-2f50-486f-ba25-84135e550828 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:02.859605 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c326ce-2f50-486f-ba25-84135e550828 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:02.859785 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c326ce-2f50-486f-ba25-84135e550828 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:02.861215 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 720/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 20:15:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:15:02.866168 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a31103-9e65-46b9-bb2f-0ade87581a35 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:02.866546 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a31103-9e65-46b9-bb2f-0ade87581a35 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:02.866725 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a31103-9e65-46b9-bb2f-0ade87581a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:02.885662 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-38a31103-9e65-46b9-bb2f-0ade87581a35 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:15:02.886859 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-38a31103-9e65-46b9-bb2f-0ade87581a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:15:02.894675 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 716/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 20:15:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:15:03.045685 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c326ce-2f50-486f-ba25-84135e550828 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:15:03.059895 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c326ce-2f50-486f-ba25-84135e550828 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:15:03.065308 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b40223-8d42-45e5-b609-415e77e114bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3918fe05c8634bc39f3e295374701465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:15:03.065950 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b40223-8d42-45e5-b609-415e77e114bc service nova] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:03.066239 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b40223-8d42-45e5-b609-415e77e114bc service nova] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:03.066540 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b40223-8d42-45e5-b609-415e77e114bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:03.075054 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b40223-8d42-45e5-b609-415e77e114bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:15:03.076673 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b40223-8d42-45e5-b609-415e77e114bc service nova] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:15:03.086002 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 721/1437] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:15:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:15:03.884066 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38e6ce-868b-40a6-acf4-c56f52ef1121 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:03.884545 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38e6ce-868b-40a6-acf4-c56f52ef1121 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:03.884649 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38e6ce-868b-40a6-acf4-c56f52ef1121 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:03.886013 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 717/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 20:15:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:15:03.890808 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4052f1-7425-437b-9198-f01f556bc1e8 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:03.891252 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4052f1-7425-437b-9198-f01f556bc1e8 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:03.891371 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4052f1-7425-437b-9198-f01f556bc1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:03.909362 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-ba4052f1-7425-437b-9198-f01f556bc1e8 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:15:03.910544 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-ba4052f1-7425-437b-9198-f01f556bc1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:15:03.918809 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 722/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 20:15:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:15:04.066424 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d38e6ce-868b-40a6-acf4-c56f52ef1121 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:15:04.080660 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d38e6ce-868b-40a6-acf4-c56f52ef1121 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:15:04.086126 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7122243-3b79-482c-9a58-a15986a289b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3918fe05c8634bc39f3e295374701465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:15:04.086763 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7122243-3b79-482c-9a58-a15986a289b6 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:04.087543 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7122243-3b79-482c-9a58-a15986a289b6 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:04.087826 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7122243-3b79-482c-9a58-a15986a289b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:04.095977 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7122243-3b79-482c-9a58-a15986a289b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:15:04.097552 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7122243-3b79-482c-9a58-a15986a289b6 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:15:04.107777 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 718/1440] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:15:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:15:06.002780 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5ee23-d76f-40b4-a5c0-d6260d9e02dd None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:06.003326 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5ee23-d76f-40b4-a5c0-d6260d9e02dd None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:06.003326 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5ee23-d76f-40b4-a5c0-d6260d9e02dd None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:06.004734 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 723/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 20:15:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:15:06.010307 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71142fd3-b231-4a7c-8b68-f458dcb43b5f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:06.010733 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71142fd3-b231-4a7c-8b68-f458dcb43b5f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:06.010875 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71142fd3-b231-4a7c-8b68-f458dcb43b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:06.029349 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-71142fd3-b231-4a7c-8b68-f458dcb43b5f None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:15:06.030550 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-71142fd3-b231-4a7c-8b68-f458dcb43b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:15:06.038426 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 719/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 20:15:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:15:06.076076 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b5ee23-d76f-40b4-a5c0-d6260d9e02dd None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:15:06.086519 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b5ee23-d76f-40b4-a5c0-d6260d9e02dd None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:15:06.090606 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d5cb01-4a65-45f6-918b-5fc7e545bb98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:15:06.091231 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5cb01-4a65-45f6-918b-5fc7e545bb98 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:06.091514 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5cb01-4a65-45f6-918b-5fc7e545bb98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:06.091791 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5cb01-4a65-45f6-918b-5fc7e545bb98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:06.100749 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d5cb01-4a65-45f6-918b-5fc7e545bb98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:15:06.102162 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d5cb01-4a65-45f6-918b-5fc7e545bb98 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:15:06.111416 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 724/1443] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:15:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:15:08.273606 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506df70c-e6f7-4fb8-b5d2-6cb41abe5335 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:08.274182 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506df70c-e6f7-4fb8-b5d2-6cb41abe5335 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:08.274182 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506df70c-e6f7-4fb8-b5d2-6cb41abe5335 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:08.275576 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 720/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 20:15:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:15:08.280836 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d16bdf3-3d16-4856-8e63-2ea1db4989a6 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:08.281258 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d16bdf3-3d16-4856-8e63-2ea1db4989a6 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:08.281395 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d16bdf3-3d16-4856-8e63-2ea1db4989a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:08.299074 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-7d16bdf3-3d16-4856-8e63-2ea1db4989a6 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:15:08.300283 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-7d16bdf3-3d16-4856-8e63-2ea1db4989a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:15:08.308671 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 725/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 20:15:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:15:08.346068 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506df70c-e6f7-4fb8-b5d2-6cb41abe5335 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:15:08.357622 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506df70c-e6f7-4fb8-b5d2-6cb41abe5335 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:15:08.361095 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c9ef42-8a0b-4acf-ad55-0faaa9693995 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:15:08.361730 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9ef42-8a0b-4acf-ad55-0faaa9693995 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:08.362014 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9ef42-8a0b-4acf-ad55-0faaa9693995 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:08.362292 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9ef42-8a0b-4acf-ad55-0faaa9693995 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:08.371111 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c9ef42-8a0b-4acf-ad55-0faaa9693995 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:15:08.372573 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c9ef42-8a0b-4acf-ad55-0faaa9693995 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:15:08.382122 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 721/1446] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:15:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:15:10.685342 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e4ee2-38cc-4ba3-924d-38b9a8b452bb None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:10.685896 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e4ee2-38cc-4ba3-924d-38b9a8b452bb None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:10.685896 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e4ee2-38cc-4ba3-924d-38b9a8b452bb None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:10.687299 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 726/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 20:15:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:15:10.692566 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d5215-e128-4811-9a0f-f79bcfb27d97 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:10.692956 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d5215-e128-4811-9a0f-f79bcfb27d97 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:10.693128 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d5215-e128-4811-9a0f-f79bcfb27d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:10.714798 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-845d5215-e128-4811-9a0f-f79bcfb27d97 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:15:10.716026 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-845d5215-e128-4811-9a0f-f79bcfb27d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:15:10.723688 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 722/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 20:15:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:15:10.762300 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e4ee2-38cc-4ba3-924d-38b9a8b452bb None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:15:10.773138 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e4ee2-38cc-4ba3-924d-38b9a8b452bb None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:15:10.776684 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a39559-bf1e-44be-90a8-70f3e53b25a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:15:10.777325 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a39559-bf1e-44be-90a8-70f3e53b25a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:10.777614 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a39559-bf1e-44be-90a8-70f3e53b25a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:10.777895 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a39559-bf1e-44be-90a8-70f3e53b25a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:10.786767 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a39559-bf1e-44be-90a8-70f3e53b25a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:15:10.788230 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a39559-bf1e-44be-90a8-70f3e53b25a8 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:15:10.797649 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 727/1449] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:15:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:15:12.932752 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f93423-4f08-46ad-a3d7-ea5bd31c161e None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:12.933231 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f93423-4f08-46ad-a3d7-ea5bd31c161e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:12.933326 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f93423-4f08-46ad-a3d7-ea5bd31c161e None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:12.934710 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 723/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 20:15:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:15:12.939976 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedbc740-7f9c-4d7d-9225-be333827b012 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:12.940418 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedbc740-7f9c-4d7d-9225-be333827b012 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:12.940606 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedbc740-7f9c-4d7d-9225-be333827b012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:12.958527 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-cedbc740-7f9c-4d7d-9225-be333827b012 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:15:12.959725 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-cedbc740-7f9c-4d7d-9225-be333827b012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:15:12.967559 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 728/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 20:15:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:15:13.005654 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f93423-4f08-46ad-a3d7-ea5bd31c161e None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:15:13.016948 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f93423-4f08-46ad-a3d7-ea5bd31c161e None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:15:13.020436 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b45edc-5249-438c-bf97-d84803582739 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:15:13.021068 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b45edc-5249-438c-bf97-d84803582739 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:13.021353 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b45edc-5249-438c-bf97-d84803582739 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:13.021635 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b45edc-5249-438c-bf97-d84803582739 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:13.030423 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b45edc-5249-438c-bf97-d84803582739 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:15:13.031838 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b45edc-5249-438c-bf97-d84803582739 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:15:13.041117 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 724/1452] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:15:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:15:15.115666 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222a917-54c8-4966-a779-e99124f949d8 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:15.116218 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222a917-54c8-4966-a779-e99124f949d8 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:15.116339 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222a917-54c8-4966-a779-e99124f949d8 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:15.117652 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 729/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 20:15:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:15:15.123004 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e04b9-196a-4382-beae-786413aa288c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:15.123447 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e04b9-196a-4382-beae-786413aa288c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:15.123546 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e04b9-196a-4382-beae-786413aa288c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:15.141184 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ca2e04b9-196a-4382-beae-786413aa288c None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:15:15.142378 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ca2e04b9-196a-4382-beae-786413aa288c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:15:15.150599 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 725/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 20:15:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:15:15.188060 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b222a917-54c8-4966-a779-e99124f949d8 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:15:15.198597 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b222a917-54c8-4966-a779-e99124f949d8 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:15:15.202134 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32549fc3-01a9-4654-9358-9fb7a3775c6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:15:15.202773 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32549fc3-01a9-4654-9358-9fb7a3775c6b service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:15.203063 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32549fc3-01a9-4654-9358-9fb7a3775c6b service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:15.203347 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32549fc3-01a9-4654-9358-9fb7a3775c6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:15.212643 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32549fc3-01a9-4654-9358-9fb7a3775c6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:15:15.214065 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32549fc3-01a9-4654-9358-9fb7a3775c6b service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:15:15.223385 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 730/1455] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:15:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:15:17.295780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e710cbf-4283-494b-b42c-ae25d68b762f None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:17.296376 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e710cbf-4283-494b-b42c-ae25d68b762f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:17.296376 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e710cbf-4283-494b-b42c-ae25d68b762f None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:17.297771 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 726/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 20:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:15:17.302865 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34ad35-9569-4497-b6bd-d85248b55a9c None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:17.303296 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34ad35-9569-4497-b6bd-d85248b55a9c None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:17.303441 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34ad35-9569-4497-b6bd-d85248b55a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:17.322401 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-ca34ad35-9569-4497-b6bd-d85248b55a9c None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:15:17.323585 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-ca34ad35-9569-4497-b6bd-d85248b55a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:15:17.331600 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 731/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 20:15:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:15:17.371006 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e710cbf-4283-494b-b42c-ae25d68b762f None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:15:17.382612 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e710cbf-4283-494b-b42c-ae25d68b762f None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:15:17.386813 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2678ba3d-fe0c-4279-9777-13cd68549afb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:15:17.387459 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678ba3d-fe0c-4279-9777-13cd68549afb service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:17.387778 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678ba3d-fe0c-4279-9777-13cd68549afb service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:17.388116 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678ba3d-fe0c-4279-9777-13cd68549afb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:17.397128 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2678ba3d-fe0c-4279-9777-13cd68549afb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:15:17.398560 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2678ba3d-fe0c-4279-9777-13cd68549afb service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:15:17.407888 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 727/1458] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:15:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 20:15:19.574634 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06591aaa-6ac3-46d4-88e5-fb65f40081fd None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:19.575197 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06591aaa-6ac3-46d4-88e5-fb65f40081fd None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:19.575197 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06591aaa-6ac3-46d4-88e5-fb65f40081fd None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:19.576599 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 732/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 20:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:15:19.581928 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399d066-a889-47d0-8c47-9c57af2a0c35 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:19.582325 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399d066-a889-47d0-8c47-9c57af2a0c35 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:19.582497 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399d066-a889-47d0-8c47-9c57af2a0c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:19.600672 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e399d066-a889-47d0-8c47-9c57af2a0c35 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:15:19.601869 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e399d066-a889-47d0-8c47-9c57af2a0c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:15:19.610215 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 728/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 20:15:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:15:19.646900 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06591aaa-6ac3-46d4-88e5-fb65f40081fd None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:15:19.658355 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06591aaa-6ac3-46d4-88e5-fb65f40081fd None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:15:19.661794 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c077b05e-92a0-45a6-8955-0d2a85b008f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:15:19.662427 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077b05e-92a0-45a6-8955-0d2a85b008f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:19.662711 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077b05e-92a0-45a6-8955-0d2a85b008f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:19.662986 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077b05e-92a0-45a6-8955-0d2a85b008f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:19.672402 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c077b05e-92a0-45a6-8955-0d2a85b008f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:15:19.673821 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c077b05e-92a0-45a6-8955-0d2a85b008f7 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:15:19.683032 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 733/1461] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:15:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:15:21.744141 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4b936-a22a-44e9-9959-756b626f9ce8 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:21.744708 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4b936-a22a-44e9-9959-756b626f9ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:21.744827 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4b936-a22a-44e9-9959-756b626f9ce8 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:21.746144 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 729/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 20:15:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:15:21.751397 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65302c8d-54dc-4a6a-8218-3f03b165e1dd None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:21.751806 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65302c8d-54dc-4a6a-8218-3f03b165e1dd None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:21.751991 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65302c8d-54dc-4a6a-8218-3f03b165e1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:21.758561 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=79 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:15:21.771520 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-65302c8d-54dc-4a6a-8218-3f03b165e1dd None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:15:21.772754 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-65302c8d-54dc-4a6a-8218-3f03b165e1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:15:21.781500 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 734/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 20:15:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:15:21.818152 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f4b936-a22a-44e9-9959-756b626f9ce8 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:15:21.824174 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=73 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:15:21.830557 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f4b936-a22a-44e9-9959-756b626f9ce8 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:15:21.834086 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff0212-8cbf-4781-81e5-860a3ffbc40b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:15:21.834722 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff0212-8cbf-4781-81e5-860a3ffbc40b service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:21.835004 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff0212-8cbf-4781-81e5-860a3ffbc40b service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:21.835280 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff0212-8cbf-4781-81e5-860a3ffbc40b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:21.844923 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff0212-8cbf-4781-81e5-860a3ffbc40b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:15:21.846340 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff0212-8cbf-4781-81e5-860a3ffbc40b service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:15:21.855903 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 730/1464] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:15:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:15:23.894371 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612694c1-0000-4b76-a85d-844dd0a8fa46 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:23.894854 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612694c1-0000-4b76-a85d-844dd0a8fa46 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:23.894970 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612694c1-0000-4b76-a85d-844dd0a8fa46 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:23.896406 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 735/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 20:15:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:15:23.902173 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e1cef-83e7-49bb-94be-2588617f7beb None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:23.902557 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e1cef-83e7-49bb-94be-2588617f7beb None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:23.902728 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e1cef-83e7-49bb-94be-2588617f7beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:23.919839 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ee5e1cef-83e7-49bb-94be-2588617f7beb None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:15:23.921043 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ee5e1cef-83e7-49bb-94be-2588617f7beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:15:23.928642 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 731/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 20:15:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:15:23.964838 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612694c1-0000-4b76-a85d-844dd0a8fa46 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:15:23.975712 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612694c1-0000-4b76-a85d-844dd0a8fa46 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:15:23.979323 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3adf21e-b7cd-4a63-beff-490527514ae2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:15:23.979970 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adf21e-b7cd-4a63-beff-490527514ae2 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:23.980260 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adf21e-b7cd-4a63-beff-490527514ae2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:23.980539 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adf21e-b7cd-4a63-beff-490527514ae2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:23.989331 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3adf21e-b7cd-4a63-beff-490527514ae2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:15:23.990750 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3adf21e-b7cd-4a63-beff-490527514ae2 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:15:24.000033 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 736/1467] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:15:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:15:26.031842 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b68be-feef-4e04-97ce-e077fc1273f7 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:26.032423 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b68be-feef-4e04-97ce-e077fc1273f7 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:26.032423 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b68be-feef-4e04-97ce-e077fc1273f7 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:26.033788 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 732/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 20:15:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:15:26.039804 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cbc240-2c3a-463c-b518-746b945a3158 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:26.040257 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cbc240-2c3a-463c-b518-746b945a3158 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:26.040397 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cbc240-2c3a-463c-b518-746b945a3158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:26.058862 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-f8cbc240-2c3a-463c-b518-746b945a3158 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:15:26.060098 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-f8cbc240-2c3a-463c-b518-746b945a3158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:15:26.067769 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 737/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 20:15:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 20:15:26.103697 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898b68be-feef-4e04-97ce-e077fc1273f7 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:15:26.114216 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898b68be-feef-4e04-97ce-e077fc1273f7 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:15:26.118276 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496a7d7a-f397-4d25-b6c3-9c1776cc9cc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:15:26.118912 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a7d7a-f397-4d25-b6c3-9c1776cc9cc4 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:26.119199 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a7d7a-f397-4d25-b6c3-9c1776cc9cc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:26.119477 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a7d7a-f397-4d25-b6c3-9c1776cc9cc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:26.128237 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496a7d7a-f397-4d25-b6c3-9c1776cc9cc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:15:26.129657 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496a7d7a-f397-4d25-b6c3-9c1776cc9cc4 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:15:26.138848 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 733/1470] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:15:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:15:36.052582 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=11 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:15:36.134714 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=14 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:15:45.809504 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751d888-abd9-4d5d-b962-9b4b62194807 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:45.810145 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751d888-abd9-4d5d-b962-9b4b62194807 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:45.810145 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751d888-abd9-4d5d-b962-9b4b62194807 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:45.811507 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 738/1471] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:15:45.816960 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679fd5c-5a13-4597-90ae-b3231240beab None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:45.817406 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679fd5c-5a13-4597-90ae-b3231240beab None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:45.817533 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679fd5c-5a13-4597-90ae-b3231240beab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:45.835724 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-6679fd5c-5a13-4597-90ae-b3231240beab None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:15:45.836968 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6679fd5c-5a13-4597-90ae-b3231240beab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:15:45.844721 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 734/1472] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:15:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:15:45.892416 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c372e-bdbb-47cc-b202-65ef3f2c806b None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:45.892712 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c372e-bdbb-47cc-b202-65ef3f2c806b None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:45.892998 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c372e-bdbb-47cc-b202-65ef3f2c806b None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:45.894358 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 739/1473] 10.222.0.15 () {54 vars in 962 bytes} [Tue Jun 21 20:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:15:45.899166 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2c403-ceff-4d3b-a553-ab375d82402a None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:45.899490 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2c403-ceff-4d3b-a553-ab375d82402a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:45.899779 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2c403-ceff-4d3b-a553-ab375d82402a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:45.917578 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-66c2c403-ceff-4d3b-a553-ab375d82402a None None] MFA Rules not processed for user `30400df887ee433086d1810331785891`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:15:45.918778 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-66c2c403-ceff-4d3b-a553-ab375d82402a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:15:45.925197 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 735/1474] 10.222.0.15 () {58 vars in 1059 bytes} [Tue Jun 21 20:15:45 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:15:45.932641 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c372e-bdbb-47cc-b202-65ef3f2c806b None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:15:45.943039 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c372e-bdbb-47cc-b202-65ef3f2c806b None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:15:45.947234 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2849cc3c-cb17-4b6f-924c-f2dca5a9f0bf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30400df887ee433086d1810331785891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:15:45.947860 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849cc3c-cb17-4b6f-924c-f2dca5a9f0bf service glance] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:45.948180 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849cc3c-cb17-4b6f-924c-f2dca5a9f0bf service glance] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:45.948459 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849cc3c-cb17-4b6f-924c-f2dca5a9f0bf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:45.957151 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2849cc3c-cb17-4b6f-924c-f2dca5a9f0bf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:15:45.958566 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2849cc3c-cb17-4b6f-924c-f2dca5a9f0bf service glance] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:15:45.967808 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 740/1475] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:15:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:15:48.047877 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98424532-384f-4345-a6d6-6e38217deed6 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:48.048455 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98424532-384f-4345-a6d6-6e38217deed6 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:48.048455 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98424532-384f-4345-a6d6-6e38217deed6 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:48.049821 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 736/1476] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:15:48.055547 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab8194-e4e0-47ef-af2d-fe8c6597a3eb None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:48.056030 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab8194-e4e0-47ef-af2d-fe8c6597a3eb None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:48.056186 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab8194-e4e0-47ef-af2d-fe8c6597a3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:48.073248 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-58ab8194-e4e0-47ef-af2d-fe8c6597a3eb None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:15:48.074426 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-58ab8194-e4e0-47ef-af2d-fe8c6597a3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:15:48.082042 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 741/1477] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:15:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:15:48.105958 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98424532-384f-4345-a6d6-6e38217deed6 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:15:48.118135 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98424532-384f-4345-a6d6-6e38217deed6 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:15:48.122571 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f92b9-2f5b-4468-8bf9-f7355472a37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:15:48.123205 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f92b9-2f5b-4468-8bf9-f7355472a37d admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:48.123486 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f92b9-2f5b-4468-8bf9-f7355472a37d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:48.123761 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f92b9-2f5b-4468-8bf9-f7355472a37d admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:48.124522 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6f92b9-2f5b-4468-8bf9-f7355472a37d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:15:48.126241 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: WARNING py.warnings [None req-be6f92b9-2f5b-4468-8bf9-f7355472a37d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 20:15:48.126241 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: warnings.warn(msg) Jun 21 20:15:48.126241 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: Jun 21 20:15:48.127358 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6f92b9-2f5b-4468-8bf9-f7355472a37d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:15:48.145933 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 737/1478] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jun 21 20:15:48 2022] GET /identity/v3/projects => generated 2553 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:15:50.170308 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3afa5-90f4-4420-829d-ac81309e9147 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:50.170886 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3afa5-90f4-4420-829d-ac81309e9147 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:50.170886 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3afa5-90f4-4420-829d-ac81309e9147 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:50.172288 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 742/1479] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:15:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:15:50.177353 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb42e70e-9355-4533-a06c-4c5f092f8cb4 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:50.177781 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb42e70e-9355-4533-a06c-4c5f092f8cb4 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:50.177928 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb42e70e-9355-4533-a06c-4c5f092f8cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:50.196074 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-eb42e70e-9355-4533-a06c-4c5f092f8cb4 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:15:50.197274 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-eb42e70e-9355-4533-a06c-4c5f092f8cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:15:50.205093 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 738/1480] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:15:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:15:50.247757 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f3afa5-90f4-4420-829d-ac81309e9147 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:15:50.262465 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f3afa5-90f4-4420-829d-ac81309e9147 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:15:50.267840 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba04a9-fd1e-4b11-9a09-ab09e1df21c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3918fe05c8634bc39f3e295374701465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:15:50.268513 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba04a9-fd1e-4b11-9a09-ab09e1df21c9 service nova] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:50.268802 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba04a9-fd1e-4b11-9a09-ab09e1df21c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:50.269082 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba04a9-fd1e-4b11-9a09-ab09e1df21c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:50.277696 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba04a9-fd1e-4b11-9a09-ab09e1df21c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:15:50.279273 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba04a9-fd1e-4b11-9a09-ab09e1df21c9 service nova] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:15:50.288563 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 743/1481] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:15:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:15:52.453793 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d61819-b001-4283-8f41-a40a2ea0148e None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:52.454368 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d61819-b001-4283-8f41-a40a2ea0148e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:52.454368 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d61819-b001-4283-8f41-a40a2ea0148e None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:52.455779 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 739/1482] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:15:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:15:52.461658 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ec097-0361-4a4f-beab-7aee8d6276a5 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:52.462087 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ec097-0361-4a4f-beab-7aee8d6276a5 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:52.462247 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ec097-0361-4a4f-beab-7aee8d6276a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:52.479889 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-382ec097-0361-4a4f-beab-7aee8d6276a5 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:15:52.481124 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-382ec097-0361-4a4f-beab-7aee8d6276a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:15:52.488852 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 744/1483] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:15:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:15:52.526532 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d61819-b001-4283-8f41-a40a2ea0148e None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:15:52.537138 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d61819-b001-4283-8f41-a40a2ea0148e None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:15:52.540599 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ba166-61ab-4ea7-8480-eb7b8851120f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:15:52.541230 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ba166-61ab-4ea7-8480-eb7b8851120f service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:52.541514 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ba166-61ab-4ea7-8480-eb7b8851120f service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:52.541789 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ba166-61ab-4ea7-8480-eb7b8851120f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:52.550428 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70ba166-61ab-4ea7-8480-eb7b8851120f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:15:52.551838 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70ba166-61ab-4ea7-8480-eb7b8851120f service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:15:52.560996 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 740/1484] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:15:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:15:54.662387 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238feff6-3802-4b04-a493-1f9cf04322e2 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:54.663428 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238feff6-3802-4b04-a493-1f9cf04322e2 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:54.663851 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238feff6-3802-4b04-a493-1f9cf04322e2 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:54.665417 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 745/1485] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:15:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:15:54.670730 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11bf03a-33ad-46e8-b366-7f3059bb1e0b None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:54.671146 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11bf03a-33ad-46e8-b366-7f3059bb1e0b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:54.671287 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11bf03a-33ad-46e8-b366-7f3059bb1e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:54.689615 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f11bf03a-33ad-46e8-b366-7f3059bb1e0b None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:15:54.690816 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f11bf03a-33ad-46e8-b366-7f3059bb1e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:15:54.698603 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 741/1486] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:15:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:15:54.736860 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238feff6-3802-4b04-a493-1f9cf04322e2 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:15:54.748004 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238feff6-3802-4b04-a493-1f9cf04322e2 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:15:54.751459 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72107f7-a32c-479f-9247-94314fa60be1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:15:54.752117 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72107f7-a32c-479f-9247-94314fa60be1 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:54.752403 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72107f7-a32c-479f-9247-94314fa60be1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:54.752678 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72107f7-a32c-479f-9247-94314fa60be1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:54.761708 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72107f7-a32c-479f-9247-94314fa60be1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:15:54.763116 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72107f7-a32c-479f-9247-94314fa60be1 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:15:54.772323 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 746/1487] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:15:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:15:56.885336 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baddc045-09e7-4f22-8777-0d9fa5d7b175 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:56.885838 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baddc045-09e7-4f22-8777-0d9fa5d7b175 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:56.885936 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baddc045-09e7-4f22-8777-0d9fa5d7b175 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:56.887287 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 742/1488] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:15:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:15:56.892601 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859d095-ac1d-4d95-ac2c-67b6c599bad7 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:56.893015 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859d095-ac1d-4d95-ac2c-67b6c599bad7 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:56.893171 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859d095-ac1d-4d95-ac2c-67b6c599bad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:56.910542 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-5859d095-ac1d-4d95-ac2c-67b6c599bad7 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:15:56.911730 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-5859d095-ac1d-4d95-ac2c-67b6c599bad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:15:56.920028 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 747/1489] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:15:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:15:56.959480 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baddc045-09e7-4f22-8777-0d9fa5d7b175 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:15:56.970077 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baddc045-09e7-4f22-8777-0d9fa5d7b175 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:15:56.973743 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded7c43-0b2f-4417-ad83-be89f43dba1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:15:56.974639 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded7c43-0b2f-4417-ad83-be89f43dba1d service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:56.974934 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded7c43-0b2f-4417-ad83-be89f43dba1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:56.975710 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded7c43-0b2f-4417-ad83-be89f43dba1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:56.984685 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ded7c43-0b2f-4417-ad83-be89f43dba1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:15:56.986115 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ded7c43-0b2f-4417-ad83-be89f43dba1d service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:15:56.995913 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 743/1490] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:15:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:15:59.177434 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8e8bb-7788-4a14-ae1c-247f92f28a4e None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:59.177991 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8e8bb-7788-4a14-ae1c-247f92f28a4e None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:59.177991 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8e8bb-7788-4a14-ae1c-247f92f28a4e None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:59.180003 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 748/1491] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jun 21 20:15:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:15:59.185328 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc8fda6-404a-4d4e-adaf-af009425a320 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:59.185778 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc8fda6-404a-4d4e-adaf-af009425a320 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:59.185878 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc8fda6-404a-4d4e-adaf-af009425a320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:59.203375 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-8fc8fda6-404a-4d4e-adaf-af009425a320 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:15:59.204606 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8fc8fda6-404a-4d4e-adaf-af009425a320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:15:59.212393 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 744/1492] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jun 21 20:15:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:15:59.251702 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8e8bb-7788-4a14-ae1c-247f92f28a4e None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:15:59.262380 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8e8bb-7788-4a14-ae1c-247f92f28a4e None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:15:59.265978 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22f1bb6-f94e-477b-baad-e6a14a747842 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:15:59.266614 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f1bb6-f94e-477b-baad-e6a14a747842 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:15:59.266901 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f1bb6-f94e-477b-baad-e6a14a747842 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:15:59.267180 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f1bb6-f94e-477b-baad-e6a14a747842 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:15:59.276113 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22f1bb6-f94e-477b-baad-e6a14a747842 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:15:59.277534 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22f1bb6-f94e-477b-baad-e6a14a747842 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:15:59.286834 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 749/1493] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:15:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:16:09.198328 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=33 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:16:09.282637 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=33 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:17:41.052354 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502f3f6-d163-4121-9878-c1256990fe77 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:17:41.052876 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502f3f6-d163-4121-9878-c1256990fe77 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:17:41.052989 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502f3f6-d163-4121-9878-c1256990fe77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:17:41.072129 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-1502f3f6-d163-4121-9878-c1256990fe77 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:17:41.073340 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1502f3f6-d163-4121-9878-c1256990fe77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:17:41.081119 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 745/1494] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:17:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:17:41.090883 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1ee9a-af54-401d-ac6f-116ee288fa15 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:17:41.091402 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1ee9a-af54-401d-ac6f-116ee288fa15 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:17:41.091515 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1ee9a-af54-401d-ac6f-116ee288fa15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:17:41.109357 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-1fc1ee9a-af54-401d-ac6f-116ee288fa15 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:17:41.110484 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-1fc1ee9a-af54-401d-ac6f-116ee288fa15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:17:41.118230 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 750/1495] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:17:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:17:41.122607 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1502f3f6-d163-4121-9878-c1256990fe77 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:17:41.132642 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1502f3f6-d163-4121-9878-c1256990fe77 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:17:41.137058 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47793129-e95b-4c4b-a64b-f8a99de78561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:17:41.137703 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47793129-e95b-4c4b-a64b-f8a99de78561 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:17:41.137986 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47793129-e95b-4c4b-a64b-f8a99de78561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:17:41.138287 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47793129-e95b-4c4b-a64b-f8a99de78561 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:17:41.138997 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47793129-e95b-4c4b-a64b-f8a99de78561 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:17:41.139300 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47793129-e95b-4c4b-a64b-f8a99de78561 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:17:41.140332 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: WARNING py.warnings [None req-47793129-e95b-4c4b-a64b-f8a99de78561 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 20:17:41.140332 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: warnings.warn(msg) Jun 21 20:17:41.140332 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: Jun 21 20:17:41.141199 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47793129-e95b-4c4b-a64b-f8a99de78561 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:17:41.154906 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 746/1496] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:17:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:17:41.162641 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1ee9a-af54-401d-ac6f-116ee288fa15 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:17:41.171725 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1ee9a-af54-401d-ac6f-116ee288fa15 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:17:41.176317 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0aff0-6525-448a-b908-ac3fe50863c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:17:41.176969 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0aff0-6525-448a-b908-ac3fe50863c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:17:41.177258 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0aff0-6525-448a-b908-ac3fe50863c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:17:41.177541 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0aff0-6525-448a-b908-ac3fe50863c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:17:41.178230 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a0aff0-6525-448a-b908-ac3fe50863c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:17:41.180035 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: WARNING py.warnings [None req-70a0aff0-6525-448a-b908-ac3fe50863c5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 20:17:41.180035 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: warnings.warn(msg) Jun 21 20:17:41.180035 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: Jun 21 20:17:41.181229 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a0aff0-6525-448a-b908-ac3fe50863c5 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:17:41.216808 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 751/1497] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:17:41 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 20:17:41.221151 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47793129-e95b-4c4b-a64b-f8a99de78561 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:17:41.230810 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47793129-e95b-4c4b-a64b-f8a99de78561 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:17:41.284810 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8315400a-60ee-4603-8ac9-d4e0092fdbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:17:41.285465 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315400a-60ee-4603-8ac9-d4e0092fdbc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:17:41.285748 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315400a-60ee-4603-8ac9-d4e0092fdbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:17:41.286024 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315400a-60ee-4603-8ac9-d4e0092fdbc4 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:17:41.286712 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8315400a-60ee-4603-8ac9-d4e0092fdbc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:17:41.287718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: WARNING py.warnings [None req-8315400a-60ee-4603-8ac9-d4e0092fdbc4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 20:17:41.287718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: warnings.warn(msg) Jun 21 20:17:41.287718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: Jun 21 20:17:41.288996 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8315400a-60ee-4603-8ac9-d4e0092fdbc4 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:17:41.309048 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 747/1498] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:17:41 2022] POST /identity/v3/users => generated 289 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 20:17:41.313259 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0aff0-6525-448a-b908-ac3fe50863c5 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:17:41.323992 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0aff0-6525-448a-b908-ac3fe50863c5 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:17:41.328764 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26353d10-497f-4773-9364-6bc10558cd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:17:41.329458 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26353d10-497f-4773-9364-6bc10558cd4d admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:17:41.329745 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26353d10-497f-4773-9364-6bc10558cd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:17:41.330027 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26353d10-497f-4773-9364-6bc10558cd4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:17:41.330762 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26353d10-497f-4773-9364-6bc10558cd4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:17:41.331769 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: WARNING py.warnings [None req-26353d10-497f-4773-9364-6bc10558cd4d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 20:17:41.331769 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: warnings.warn(msg) Jun 21 20:17:41.331769 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: Jun 21 20:17:41.332707 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26353d10-497f-4773-9364-6bc10558cd4d admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:17:41.345457 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 752/1499] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:17:41.349503 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8315400a-60ee-4603-8ac9-d4e0092fdbc4 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:17:41.359451 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8315400a-60ee-4603-8ac9-d4e0092fdbc4 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:17:41.364402 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad9b89f-1d21-4a53-9491-1267d411c582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:17:41.365056 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9b89f-1d21-4a53-9491-1267d411c582 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:17:41.365345 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9b89f-1d21-4a53-9491-1267d411c582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:17:41.365624 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9b89f-1d21-4a53-9491-1267d411c582 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:17:41.366349 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad9b89f-1d21-4a53-9491-1267d411c582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:17:41.367351 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: WARNING py.warnings [None req-1ad9b89f-1d21-4a53-9491-1267d411c582 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 20:17:41.367351 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: warnings.warn(msg) Jun 21 20:17:41.367351 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: Jun 21 20:17:41.368252 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad9b89f-1d21-4a53-9491-1267d411c582 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:17:41.381935 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 748/1500] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:17:41.385781 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26353d10-497f-4773-9364-6bc10558cd4d admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:17:41.395428 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26353d10-497f-4773-9364-6bc10558cd4d admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:17:41.399884 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dade95-1a78-4529-b594-75c4716f3772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:17:41.400841 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dade95-1a78-4529-b594-75c4716f3772 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:17:41.401131 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dade95-1a78-4529-b594-75c4716f3772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:17:41.401410 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dade95-1a78-4529-b594-75c4716f3772 admin admin] PATH_INFO: `/v3/projects/23fc64b0c0094bdaa042c509cc7bb24e/users/872c6cc7689f405b97ff2417054152fa/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:17:41.415665 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dade95-1a78-4529-b594-75c4716f3772 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23fc64b0c0094bdaa042c509cc7bb24e, user_id=872c6cc7689f405b97ff2417054152fa, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:17:41.416736 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: WARNING py.warnings [None req-f6dade95-1a78-4529-b594-75c4716f3772 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 20:17:41.416736 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: warnings.warn(msg) Jun 21 20:17:41.416736 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: Jun 21 20:17:41.418651 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dade95-1a78-4529-b594-75c4716f3772 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:17:41.431837 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 753/1501] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:17:41 2022] PUT /identity/v3/projects/23fc64b0c0094bdaa042c509cc7bb24e/users/872c6cc7689f405b97ff2417054152fa/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:17:41.443544 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30802d-00b8-40fe-a435-5f55f3699af2 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:17:41.443841 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30802d-00b8-40fe-a435-5f55f3699af2 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:17:41.444170 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30802d-00b8-40fe-a435-5f55f3699af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:17:41.470215 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-bb30802d-00b8-40fe-a435-5f55f3699af2 None None] MFA Rules not processed for user `872c6cc7689f405b97ff2417054152fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:17:41.471696 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-bb30802d-00b8-40fe-a435-5f55f3699af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:17:41.533459 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 749/1502] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:17:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:17:41.547174 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61e24b-c054-4990-ba50-19cf7fc1b17d None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:17:41.547471 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61e24b-c054-4990-ba50-19cf7fc1b17d None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:17:41.547760 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61e24b-c054-4990-ba50-19cf7fc1b17d None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:17:41.549178 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 754/1503] 10.222.0.15 () {54 vars in 963 bytes} [Tue Jun 21 20:17:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:17:41.554125 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0875d-08bd-49f5-ba4b-0645104fe605 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:17:41.554421 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0875d-08bd-49f5-ba4b-0645104fe605 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:17:41.554704 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0875d-08bd-49f5-ba4b-0645104fe605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:17:41.572054 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-bee0875d-08bd-49f5-ba4b-0645104fe605 None None] MFA Rules not processed for user `d95478de171141ce85876e852d081149`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:17:41.573246 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-bee0875d-08bd-49f5-ba4b-0645104fe605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:17:41.615633 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:17:41.623890 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 750/1504] 10.222.0.15 () {58 vars in 1060 bytes} [Tue Jun 21 20:17:41 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:17:41.631416 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e61e24b-c054-4990-ba50-19cf7fc1b17d None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:17:41.641904 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e61e24b-c054-4990-ba50-19cf7fc1b17d None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:17:41.645938 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f233c-5c1d-4c32-a662-e216db41ed94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:17:41.646567 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f233c-5c1d-4c32-a662-e216db41ed94 service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:17:41.646855 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f233c-5c1d-4c32-a662-e216db41ed94 service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:17:41.647138 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f233c-5c1d-4c32-a662-e216db41ed94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:17:41.655251 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97f233c-5c1d-4c32-a662-e216db41ed94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:17:41.656705 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97f233c-5c1d-4c32-a662-e216db41ed94 service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:17:41.666078 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 755/1505] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:17:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 20:17:41.707497 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f02900-132d-4f6c-8bf7-d5e1abe6d18f None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:17:41.707796 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f02900-132d-4f6c-8bf7-d5e1abe6d18f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:17:41.708122 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f02900-132d-4f6c-8bf7-d5e1abe6d18f None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:17:41.709432 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 751/1506] 10.222.0.15 () {52 vars in 829 bytes} [Tue Jun 21 20:17:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:17:41.713133 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f233c-5c1d-4c32-a662-e216db41ed94 service cinder] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:17:41.774803 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f233c-5c1d-4c32-a662-e216db41ed94 service cinder] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:17:41.779547 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc33e17-a93a-44d1-ac39-7ba2bff7380e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:17:41.780453 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc33e17-a93a-44d1-ac39-7ba2bff7380e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:17:41.780743 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc33e17-a93a-44d1-ac39-7ba2bff7380e admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:17:41.781023 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc33e17-a93a-44d1-ac39-7ba2bff7380e admin admin] PATH_INFO: `/v3/users/872c6cc7689f405b97ff2417054152fa` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:17:41.782212 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc33e17-a93a-44d1-ac39-7ba2bff7380e admin admin] RBAC: Authorizing `identity:delete_user(user_id=872c6cc7689f405b97ff2417054152fa)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:17:41.783217 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: WARNING py.warnings [None req-9dc33e17-a93a-44d1-ac39-7ba2bff7380e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 20:17:41.783217 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: warnings.warn(msg) Jun 21 20:17:41.783217 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: Jun 21 20:17:41.784592 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc33e17-a93a-44d1-ac39-7ba2bff7380e admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:17:41.854266 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-9dc33e17-a93a-44d1-ac39-7ba2bff7380e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '872c6cc7689f405b97ff2417054152fa'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:17:41.859247 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-9dc33e17-a93a-44d1-ac39-7ba2bff7380e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '872c6cc7689f405b97ff2417054152fa'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:17:41.869550 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-9dc33e17-a93a-44d1-ac39-7ba2bff7380e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '872c6cc7689f405b97ff2417054152fa'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:17:41.888121 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-9dc33e17-a93a-44d1-ac39-7ba2bff7380e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '872c6cc7689f405b97ff2417054152fa'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:17:41.888871 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-9dc33e17-a93a-44d1-ac39-7ba2bff7380e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '872c6cc7689f405b97ff2417054152fa'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:17:41.897967 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:17:41.909721 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 756/1507] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:17:41 2022] DELETE /identity/v3/users/872c6cc7689f405b97ff2417054152fa => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:17:41.914332 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1161d53-8ea7-4122-9531-5580d93931c6 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:17:41.914668 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1161d53-8ea7-4122-9531-5580d93931c6 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:17:41.914968 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1161d53-8ea7-4122-9531-5580d93931c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:17:41.931820 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-a1161d53-8ea7-4122-9531-5580d93931c6 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:17:41.933038 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a1161d53-8ea7-4122-9531-5580d93931c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:17:41.995438 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 752/1508] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:17:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:17:42.009229 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc33e17-a93a-44d1-ac39-7ba2bff7380e admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:17:42.010633 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-9dc33e17-a93a-44d1-ac39-7ba2bff7380e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:17:42.068642 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc33e17-a93a-44d1-ac39-7ba2bff7380e admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:17:42.072181 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b976756b-4fa7-4927-bd2b-132cf85a5f40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:17:42.072823 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976756b-4fa7-4927-bd2b-132cf85a5f40 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:17:42.073107 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976756b-4fa7-4927-bd2b-132cf85a5f40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:17:42.073382 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976756b-4fa7-4927-bd2b-132cf85a5f40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:17:42.082032 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b976756b-4fa7-4927-bd2b-132cf85a5f40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:17:42.083459 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b976756b-4fa7-4927-bd2b-132cf85a5f40 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:17:42.092596 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 757/1509] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:17:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:17:42.441475 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1161d53-8ea7-4122-9531-5580d93931c6 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:17:42.442971 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a1161d53-8ea7-4122-9531-5580d93931c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:17:42.454652 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1161d53-8ea7-4122-9531-5580d93931c6 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:17:42.459550 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc9aef2-5c68-49c2-974f-9146f3c11b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:17:42.460705 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9aef2-5c68-49c2-974f-9146f3c11b63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:17:42.461102 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9aef2-5c68-49c2-974f-9146f3c11b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:17:42.461378 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9aef2-5c68-49c2-974f-9146f3c11b63 admin admin] PATH_INFO: `/v3/projects/23fc64b0c0094bdaa042c509cc7bb24e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:17:42.462693 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc9aef2-5c68-49c2-974f-9146f3c11b63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23fc64b0c0094bdaa042c509cc7bb24e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:17:42.466258 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: WARNING py.warnings [None req-5bc9aef2-5c68-49c2-974f-9146f3c11b63 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 20:17:42.466258 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: warnings.warn(msg) Jun 21 20:17:42.466258 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: Jun 21 20:17:42.466258 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc9aef2-5c68-49c2-974f-9146f3c11b63 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:17:42.527998 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5bc9aef2-5c68-49c2-974f-9146f3c11b63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23fc64b0c0094bdaa042c509cc7bb24e', 'request_id': 'req-5bc9aef2-5c68-49c2-974f-9146f3c11b63'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:17:42.538511 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5bc9aef2-5c68-49c2-974f-9146f3c11b63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23fc64b0c0094bdaa042c509cc7bb24e', 'request_id': 'req-5bc9aef2-5c68-49c2-974f-9146f3c11b63'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:17:42.544723 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5bc9aef2-5c68-49c2-974f-9146f3c11b63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23fc64b0c0094bdaa042c509cc7bb24e', 'request_id': 'req-5bc9aef2-5c68-49c2-974f-9146f3c11b63'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:17:42.563370 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5bc9aef2-5c68-49c2-974f-9146f3c11b63 admin admin] The token cache is being invalidate because project 23fc64b0c0094bdaa042c509cc7bb24e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:17:42.563658 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5bc9aef2-5c68-49c2-974f-9146f3c11b63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:17:42.564428 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5bc9aef2-5c68-49c2-974f-9146f3c11b63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:17:42.565964 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 753/1510] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:17:42 2022] DELETE /identity/v3/projects/23fc64b0c0094bdaa042c509cc7bb24e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:17:52.088672 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=29 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:17:52.560456 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:19:20.883395 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfd2ea-aa8b-4034-94ed-bf6790456e39 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:19:20.883884 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfd2ea-aa8b-4034-94ed-bf6790456e39 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:19:20.884035 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfd2ea-aa8b-4034-94ed-bf6790456e39 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:19:20.885408 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 758/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 20:19:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:19:20.890226 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c4904-d87d-4778-b36a-e897c523d7ed None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:19:20.890625 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c4904-d87d-4778-b36a-e897c523d7ed None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:19:20.890798 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c4904-d87d-4778-b36a-e897c523d7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:19:20.910722 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ab8c4904-d87d-4778-b36a-e897c523d7ed None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:19:20.911947 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ab8c4904-d87d-4778-b36a-e897c523d7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:19:20.968540 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 754/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 20:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:19:21.122415 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cfd2ea-aa8b-4034-94ed-bf6790456e39 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:19:21.124144 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-20cfd2ea-aa8b-4034-94ed-bf6790456e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:19:21.196965 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cfd2ea-aa8b-4034-94ed-bf6790456e39 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:19:21.202280 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee6153-8a11-4667-a89a-13f4eef97e94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3918fe05c8634bc39f3e295374701465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:19:21.202921 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee6153-8a11-4667-a89a-13f4eef97e94 service nova] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:19:21.203208 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee6153-8a11-4667-a89a-13f4eef97e94 service nova] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:19:21.203487 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee6153-8a11-4667-a89a-13f4eef97e94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:19:21.211909 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eee6153-8a11-4667-a89a-13f4eef97e94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:19:21.213519 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eee6153-8a11-4667-a89a-13f4eef97e94 service nova] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:19:21.223028 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 759/1513] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:19:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:19:22.043890 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b29ec4-bb95-4f71-be52-4efbbe189c43 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:19:22.044472 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b29ec4-bb95-4f71-be52-4efbbe189c43 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:19:22.044472 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b29ec4-bb95-4f71-be52-4efbbe189c43 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:19:22.045836 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 755/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 20:19:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:19:22.050611 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea58f6-6b08-42db-a971-24bd1a959820 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:19:22.051166 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea58f6-6b08-42db-a971-24bd1a959820 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:19:22.051166 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea58f6-6b08-42db-a971-24bd1a959820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:19:22.068950 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-93ea58f6-6b08-42db-a971-24bd1a959820 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:19:22.070254 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-93ea58f6-6b08-42db-a971-24bd1a959820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:19:22.078117 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 760/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 20:19:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:19:22.231015 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b29ec4-bb95-4f71-be52-4efbbe189c43 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:19:22.244979 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b29ec4-bb95-4f71-be52-4efbbe189c43 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:19:22.251400 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee0a478-9916-4bf6-bb62-24333bc12882 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3918fe05c8634bc39f3e295374701465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:19:22.252611 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0a478-9916-4bf6-bb62-24333bc12882 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:19:22.252898 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0a478-9916-4bf6-bb62-24333bc12882 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:19:22.253178 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0a478-9916-4bf6-bb62-24333bc12882 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:19:22.261390 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee0a478-9916-4bf6-bb62-24333bc12882 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:19:22.262982 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee0a478-9916-4bf6-bb62-24333bc12882 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:19:22.272930 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 756/1516] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:19:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:19:24.560018 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46e84f-5951-43f6-8151-5af1822e461d None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:19:24.560565 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46e84f-5951-43f6-8151-5af1822e461d None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:19:24.560565 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46e84f-5951-43f6-8151-5af1822e461d None None] PATH_INFO: `/v3` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:19:24.561887 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 761/1517] 10.222.0.43 () {54 vars in 925 bytes} [Tue Jun 21 20:19:24 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:19:24.568032 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a0ca1-0ace-4106-b5ae-0f3ef5dbc501 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:19:24.568472 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a0ca1-0ace-4106-b5ae-0f3ef5dbc501 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:19:24.568606 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a0ca1-0ace-4106-b5ae-0f3ef5dbc501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:19:24.586881 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ae0a0ca1-0ace-4106-b5ae-0f3ef5dbc501 None None] MFA Rules not processed for user `a59294bff27c4b3f8aaeeab48ed35a0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:19:24.588225 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ae0a0ca1-0ace-4106-b5ae-0f3ef5dbc501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:19:24.649217 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 757/1518] 10.222.0.43 () {58 vars in 1015 bytes} [Tue Jun 21 20:19:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:19:28.507942 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c43a65-5ff1-496a-845e-7bda2bb20510 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:19:28.508471 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c43a65-5ff1-496a-845e-7bda2bb20510 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:19:28.508471 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c43a65-5ff1-496a-845e-7bda2bb20510 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:19:28.509819 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 762/1519] 10.222.0.15 () {54 vars in 960 bytes} [Tue Jun 21 20:19:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:19:28.514929 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec56d7a-5b0e-4042-9c5d-5d555f048c87 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:19:28.515368 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec56d7a-5b0e-4042-9c5d-5d555f048c87 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:19:28.515496 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec56d7a-5b0e-4042-9c5d-5d555f048c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:19:28.533206 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-eec56d7a-5b0e-4042-9c5d-5d555f048c87 None None] MFA Rules not processed for user `a59294bff27c4b3f8aaeeab48ed35a0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:19:28.534386 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-eec56d7a-5b0e-4042-9c5d-5d555f048c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:19:28.543257 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 758/1520] 10.222.0.15 () {58 vars in 1057 bytes} [Tue Jun 21 20:19:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:19:28.551204 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c43a65-5ff1-496a-845e-7bda2bb20510 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:19:28.564117 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c43a65-5ff1-496a-845e-7bda2bb20510 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:19:28.568924 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ae110-bd3f-4aa2-a413-295665cfe669 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59294bff27c4b3f8aaeeab48ed35a0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:19:28.569563 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ae110-bd3f-4aa2-a413-295665cfe669 service placement] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:19:28.569853 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ae110-bd3f-4aa2-a413-295665cfe669 service placement] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:19:28.570129 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ae110-bd3f-4aa2-a413-295665cfe669 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:19:28.578176 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ae110-bd3f-4aa2-a413-295665cfe669 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:19:28.579728 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ae110-bd3f-4aa2-a413-295665cfe669 service placement] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:19:28.589097 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 763/1521] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:19:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 20:19:33.504575 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbfa5c-407b-4984-bf96-7e12e96b7ba8 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:19:33.505147 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbfa5c-407b-4984-bf96-7e12e96b7ba8 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:19:33.505147 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbfa5c-407b-4984-bf96-7e12e96b7ba8 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:19:33.506573 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 759/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 20:19:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:19:33.511458 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cdd5d5-d914-4104-9a77-f25f995b5874 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:19:33.511893 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cdd5d5-d914-4104-9a77-f25f995b5874 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:19:33.512123 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cdd5d5-d914-4104-9a77-f25f995b5874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:19:33.530408 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-69cdd5d5-d914-4104-9a77-f25f995b5874 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:19:33.531601 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-69cdd5d5-d914-4104-9a77-f25f995b5874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:19:33.540077 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 764/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 20:19:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 20:19:33.695700 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfbfa5c-407b-4984-bf96-7e12e96b7ba8 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:19:33.710762 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfbfa5c-407b-4984-bf96-7e12e96b7ba8 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:19:33.716074 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75fc9e7-b420-4dae-9f66-2eaa8489e9ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3918fe05c8634bc39f3e295374701465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:19:33.716709 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75fc9e7-b420-4dae-9f66-2eaa8489e9ec service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:19:33.716994 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75fc9e7-b420-4dae-9f66-2eaa8489e9ec service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:19:33.717270 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75fc9e7-b420-4dae-9f66-2eaa8489e9ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:19:33.725544 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75fc9e7-b420-4dae-9f66-2eaa8489e9ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:19:33.727106 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75fc9e7-b420-4dae-9f66-2eaa8489e9ec service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:19:33.736296 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 760/1524] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:19:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:19:34.546722 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf6f14-e114-463f-89af-000515a22a30 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:19:34.547264 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf6f14-e114-463f-89af-000515a22a30 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:19:34.547264 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf6f14-e114-463f-89af-000515a22a30 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:19:34.548688 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 765/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 20:19:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:19:34.554126 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd84f27e-b9d3-412c-8aed-850ca7faf72a None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:19:34.554528 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd84f27e-b9d3-412c-8aed-850ca7faf72a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:19:34.554688 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd84f27e-b9d3-412c-8aed-850ca7faf72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:19:34.572201 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-bd84f27e-b9d3-412c-8aed-850ca7faf72a None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:19:34.573392 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-bd84f27e-b9d3-412c-8aed-850ca7faf72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:19:34.581101 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 761/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 20:19:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:19:34.733055 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf6f14-e114-463f-89af-000515a22a30 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:19:34.747983 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf6f14-e114-463f-89af-000515a22a30 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:19:34.753401 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d5c23-210d-442f-b80a-e94c2ac6da15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3918fe05c8634bc39f3e295374701465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:19:34.754039 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d5c23-210d-442f-b80a-e94c2ac6da15 service nova] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:19:34.754325 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d5c23-210d-442f-b80a-e94c2ac6da15 service nova] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:19:34.754606 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d5c23-210d-442f-b80a-e94c2ac6da15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:19:34.762703 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8d5c23-210d-442f-b80a-e94c2ac6da15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:19:34.764318 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8d5c23-210d-442f-b80a-e94c2ac6da15 service nova] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:19:34.773581 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 766/1527] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:19:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:19:38.716616 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c39167-6298-45fb-b842-187f704a9f8c None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:19:38.717193 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c39167-6298-45fb-b842-187f704a9f8c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:19:38.717193 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c39167-6298-45fb-b842-187f704a9f8c None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:19:38.718848 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 762/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 20:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:19:38.724256 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54ad60-ddd2-4df7-a281-4377432645ac None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:19:38.724724 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54ad60-ddd2-4df7-a281-4377432645ac None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:19:38.724834 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54ad60-ddd2-4df7-a281-4377432645ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:19:38.743312 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-7f54ad60-ddd2-4df7-a281-4377432645ac None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:19:38.744545 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-7f54ad60-ddd2-4df7-a281-4377432645ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:19:38.752341 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 767/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 20:19:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:19:38.789227 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c39167-6298-45fb-b842-187f704a9f8c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:19:38.790949 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b9c39167-6298-45fb-b842-187f704a9f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:19:38.848408 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c39167-6298-45fb-b842-187f704a9f8c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:19:38.851891 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f2a92b-7468-4ff4-af3f-7519f0f72bfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:19:38.852577 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2a92b-7468-4ff4-af3f-7519f0f72bfc service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:19:38.852863 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2a92b-7468-4ff4-af3f-7519f0f72bfc service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:19:38.853141 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2a92b-7468-4ff4-af3f-7519f0f72bfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:19:38.862159 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f2a92b-7468-4ff4-af3f-7519f0f72bfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:19:38.864104 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f2a92b-7468-4ff4-af3f-7519f0f72bfc service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:19:38.868971 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:19:38.874250 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 763/1530] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:19:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:19:40.877688 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3bc0d-c58c-445f-aa2a-eb553b25c95d None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:19:40.878807 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3bc0d-c58c-445f-aa2a-eb553b25c95d None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:19:40.878928 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3bc0d-c58c-445f-aa2a-eb553b25c95d None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:19:40.880321 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 768/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 20:19:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:19:40.885491 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729069cd-7f80-4054-9d4e-87303edfb7f9 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:19:40.885904 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729069cd-7f80-4054-9d4e-87303edfb7f9 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:19:40.886039 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729069cd-7f80-4054-9d4e-87303edfb7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:19:40.903619 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-729069cd-7f80-4054-9d4e-87303edfb7f9 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:19:40.904847 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-729069cd-7f80-4054-9d4e-87303edfb7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:19:40.912573 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 764/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 20:19:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:19:40.948717 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f3bc0d-c58c-445f-aa2a-eb553b25c95d None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:19:40.959285 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f3bc0d-c58c-445f-aa2a-eb553b25c95d None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:19:40.962858 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c24b2-8955-41c6-a34b-a93aa5fa2167 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:19:40.963512 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c24b2-8955-41c6-a34b-a93aa5fa2167 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:19:40.963801 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c24b2-8955-41c6-a34b-a93aa5fa2167 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:19:40.964114 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c24b2-8955-41c6-a34b-a93aa5fa2167 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:19:40.973358 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7c24b2-8955-41c6-a34b-a93aa5fa2167 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:19:40.974775 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7c24b2-8955-41c6-a34b-a93aa5fa2167 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:19:40.984140 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 769/1533] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:19:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:19:44.499852 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e605d3f-da1e-4062-9a50-4e49c8ed726a None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:19:44.500450 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e605d3f-da1e-4062-9a50-4e49c8ed726a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:19:44.500450 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e605d3f-da1e-4062-9a50-4e49c8ed726a None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:19:44.501806 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 765/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 20:19:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:19:44.507550 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecd151-5a28-4bc8-a02d-308fd1ae9b7c None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:19:44.507961 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecd151-5a28-4bc8-a02d-308fd1ae9b7c None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:19:44.508141 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecd151-5a28-4bc8-a02d-308fd1ae9b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:19:44.514408 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=62 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:19:44.527655 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-60ecd151-5a28-4bc8-a02d-308fd1ae9b7c None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:19:44.528896 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-60ecd151-5a28-4bc8-a02d-308fd1ae9b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:19:44.536669 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 770/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 20:19:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:19:44.840003 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e605d3f-da1e-4062-9a50-4e49c8ed726a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:19:44.844231 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8e605d3f-da1e-4062-9a50-4e49c8ed726a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:19:44.901475 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e605d3f-da1e-4062-9a50-4e49c8ed726a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:19:44.905173 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3afa660-6e52-4a46-a49c-bc4a84feaccf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:19:44.905827 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3afa660-6e52-4a46-a49c-bc4a84feaccf service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:19:44.906114 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3afa660-6e52-4a46-a49c-bc4a84feaccf service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:19:44.906397 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3afa660-6e52-4a46-a49c-bc4a84feaccf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:19:44.915258 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3afa660-6e52-4a46-a49c-bc4a84feaccf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:19:44.916715 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3afa660-6e52-4a46-a49c-bc4a84feaccf service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:19:44.926457 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 766/1536] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:19:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:19:46.971364 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe07d2-0fbd-4700-b468-03ff2f8a3afa None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:19:46.971970 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe07d2-0fbd-4700-b468-03ff2f8a3afa None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:19:46.972088 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe07d2-0fbd-4700-b468-03ff2f8a3afa None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:19:46.973400 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 771/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 20:19:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:19:46.978599 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3771f3f-fecb-4d31-85d9-cbbe306923b1 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:19:46.979007 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3771f3f-fecb-4d31-85d9-cbbe306923b1 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:19:46.979267 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3771f3f-fecb-4d31-85d9-cbbe306923b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:19:46.997419 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e3771f3f-fecb-4d31-85d9-cbbe306923b1 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:19:46.998614 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e3771f3f-fecb-4d31-85d9-cbbe306923b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:19:47.006973 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 767/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 20:19:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:19:47.306670 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe07d2-0fbd-4700-b468-03ff2f8a3afa None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:19:47.308386 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-56fe07d2-0fbd-4700-b468-03ff2f8a3afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:19:47.321526 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe07d2-0fbd-4700-b468-03ff2f8a3afa None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:19:47.325010 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593352df-2b49-4b30-bca2-e74b7e8c8c72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:19:47.325648 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593352df-2b49-4b30-bca2-e74b7e8c8c72 service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:19:47.325934 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593352df-2b49-4b30-bca2-e74b7e8c8c72 service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:19:47.326477 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593352df-2b49-4b30-bca2-e74b7e8c8c72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:19:47.335206 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593352df-2b49-4b30-bca2-e74b7e8c8c72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:19:47.336654 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593352df-2b49-4b30-bca2-e74b7e8c8c72 service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:19:47.346122 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 772/1539] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:19:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:19:56.992261 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=32 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:19:57.341720 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=8 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:21:15.815819 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282084b2-3261-4360-b090-ce7e31189b40 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:15.818782 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282084b2-3261-4360-b090-ce7e31189b40 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:15.818782 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282084b2-3261-4360-b090-ce7e31189b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:15.818978 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4a873-43e7-48ef-a498-5432535515b1 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:15.818978 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4a873-43e7-48ef-a498-5432535515b1 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:15.820028 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4a873-43e7-48ef-a498-5432535515b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:15.840083 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-9fe4a873-43e7-48ef-a498-5432535515b1 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:15.841672 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-9fe4a873-43e7-48ef-a498-5432535515b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:15.848008 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-282084b2-3261-4360-b090-ce7e31189b40 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:15.848008 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-282084b2-3261-4360-b090-ce7e31189b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:15.858136 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 768/1540] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:21:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:15.862928 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 773/1541] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:21:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:15.869880 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665bddaa-91c5-4deb-b1a5-b4dd123f7291 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:15.870174 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665bddaa-91c5-4deb-b1a5-b4dd123f7291 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:15.870634 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665bddaa-91c5-4deb-b1a5-b4dd123f7291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:15.873292 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6430f7fb-bfc1-4e20-a0a2-95a9b049c523 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:15.873584 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6430f7fb-bfc1-4e20-a0a2-95a9b049c523 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:15.873866 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6430f7fb-bfc1-4e20-a0a2-95a9b049c523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:15.895580 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-665bddaa-91c5-4deb-b1a5-b4dd123f7291 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:15.897381 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-665bddaa-91c5-4deb-b1a5-b4dd123f7291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:15.904544 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-6430f7fb-bfc1-4e20-a0a2-95a9b049c523 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:15.905768 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-6430f7fb-bfc1-4e20-a0a2-95a9b049c523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:15.915740 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 769/1542] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:21:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:15.923078 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665bddaa-91c5-4deb-b1a5-b4dd123f7291 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:15.931088 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 774/1543] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:21:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 20:21:15.936887 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6430f7fb-bfc1-4e20-a0a2-95a9b049c523 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:15.943956 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665bddaa-91c5-4deb-b1a5-b4dd123f7291 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:15.954628 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6430f7fb-bfc1-4e20-a0a2-95a9b049c523 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:15.964869 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace5a0db-44ce-4bb6-99bf-29112d33becb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:15.965578 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace5a0db-44ce-4bb6-99bf-29112d33becb admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:15.965865 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace5a0db-44ce-4bb6-99bf-29112d33becb admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:15.966144 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace5a0db-44ce-4bb6-99bf-29112d33becb admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:15.966886 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace5a0db-44ce-4bb6-99bf-29112d33becb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:21:15.967192 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace5a0db-44ce-4bb6-99bf-29112d33becb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:15.969400 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace5a0db-44ce-4bb6-99bf-29112d33becb admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:15.974039 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0d8ac-4866-4dbd-8d3c-bdd79e02acf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:15.974939 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0d8ac-4866-4dbd-8d3c-bdd79e02acf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:15.975231 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0d8ac-4866-4dbd-8d3c-bdd79e02acf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:15.975509 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0d8ac-4866-4dbd-8d3c-bdd79e02acf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:15.980512 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad0d8ac-4866-4dbd-8d3c-bdd79e02acf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:21:15.980862 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad0d8ac-4866-4dbd-8d3c-bdd79e02acf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:15.981908 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: WARNING py.warnings [None req-3ad0d8ac-4866-4dbd-8d3c-bdd79e02acf1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 20:21:15.981908 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: warnings.warn(msg) Jun 21 20:21:15.981908 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: Jun 21 20:21:15.982836 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad0d8ac-4866-4dbd-8d3c-bdd79e02acf1 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:16.006662 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 770/1544] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:21:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:21:16.008060 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88e356-b98a-4e05-b90b-c457b8cc4a4f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:16.008358 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88e356-b98a-4e05-b90b-c457b8cc4a4f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:16.008640 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88e356-b98a-4e05-b90b-c457b8cc4a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:16.016950 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 775/1545] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:21:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:21:16.018318 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3cf9a7-1f60-4c61-abb5-5ed35e777d49 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:16.018614 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3cf9a7-1f60-4c61-abb5-5ed35e777d49 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:16.018894 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3cf9a7-1f60-4c61-abb5-5ed35e777d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:16.060897 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-af88e356-b98a-4e05-b90b-c457b8cc4a4f None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:16.062685 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-af88e356-b98a-4e05-b90b-c457b8cc4a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:16.068882 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-3a3cf9a7-1f60-4c61-abb5-5ed35e777d49 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:16.071870 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-3a3cf9a7-1f60-4c61-abb5-5ed35e777d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:16.082594 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 771/1546] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:21:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:16.085054 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af88e356-b98a-4e05-b90b-c457b8cc4a4f None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:16.092309 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 776/1547] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:21:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:16.094164 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3cf9a7-1f60-4c61-abb5-5ed35e777d49 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:16.113758 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af88e356-b98a-4e05-b90b-c457b8cc4a4f None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:16.115877 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3cf9a7-1f60-4c61-abb5-5ed35e777d49 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:16.123161 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac653d-4064-4694-83ca-a14c30556510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:16.124279 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac653d-4064-4694-83ca-a14c30556510 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:16.124864 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac653d-4064-4694-83ca-a14c30556510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:16.125818 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac653d-4064-4694-83ca-a14c30556510 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:16.127542 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac653d-4064-4694-83ca-a14c30556510 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:16.128478 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73369f5-07f2-4725-a39b-5e6537baa319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:16.129843 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: WARNING py.warnings [None req-29ac653d-4064-4694-83ca-a14c30556510 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 20:21:16.129843 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: warnings.warn(msg) Jun 21 20:21:16.129843 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: Jun 21 20:21:16.131039 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73369f5-07f2-4725-a39b-5e6537baa319 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:16.132603 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac653d-4064-4694-83ca-a14c30556510 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:16.133216 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73369f5-07f2-4725-a39b-5e6537baa319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:16.133727 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73369f5-07f2-4725-a39b-5e6537baa319 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:16.134725 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73369f5-07f2-4725-a39b-5e6537baa319 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:16.138589 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73369f5-07f2-4725-a39b-5e6537baa319 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:16.180642 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 772/1548] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:21:16 2022] POST /identity/v3/projects => generated 365 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:21:16.182523 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae2fd9-a639-4d92-8dd2-428c3cca9366 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:16.183081 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae2fd9-a639-4d92-8dd2-428c3cca9366 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:16.183949 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae2fd9-a639-4d92-8dd2-428c3cca9366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:16.186268 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 777/1549] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:21:16 2022] POST /identity/v3/projects => generated 375 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:21:16.188137 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09313ade-04a0-44b0-b2ea-9ec4254bb47e None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:16.188433 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09313ade-04a0-44b0-b2ea-9ec4254bb47e None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:16.188718 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09313ade-04a0-44b0-b2ea-9ec4254bb47e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:16.206315 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-4dae2fd9-a639-4d92-8dd2-428c3cca9366 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:16.208149 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4dae2fd9-a639-4d92-8dd2-428c3cca9366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:16.211013 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-09313ade-04a0-44b0-b2ea-9ec4254bb47e None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:16.212289 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-09313ade-04a0-44b0-b2ea-9ec4254bb47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:16.279334 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 773/1550] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:21:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:16.281818 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a06f77-327e-4c1a-84f2-4a628d98f630 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:16.282348 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a06f77-327e-4c1a-84f2-4a628d98f630 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:16.282852 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a06f77-327e-4c1a-84f2-4a628d98f630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:16.301396 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-98a06f77-327e-4c1a-84f2-4a628d98f630 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:16.302604 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-98a06f77-327e-4c1a-84f2-4a628d98f630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:16.303111 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 778/1551] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:21:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:16.304496 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a328a-c730-4746-a0e1-9d7e3fea4795 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:16.304792 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a328a-c730-4746-a0e1-9d7e3fea4795 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:16.305074 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a328a-c730-4746-a0e1-9d7e3fea4795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:16.311192 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 774/1552] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:21:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:16.312802 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a06f77-327e-4c1a-84f2-4a628d98f630 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:16.321600 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a06f77-327e-4c1a-84f2-4a628d98f630 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:16.324424 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-527a328a-c730-4746-a0e1-9d7e3fea4795 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:16.325660 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-527a328a-c730-4746-a0e1-9d7e3fea4795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:16.326077 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06344acd-5779-4403-b1cb-d33302f8a62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:16.326737 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06344acd-5779-4403-b1cb-d33302f8a62c admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:16.327023 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06344acd-5779-4403-b1cb-d33302f8a62c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:16.327308 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06344acd-5779-4403-b1cb-d33302f8a62c admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:16.328552 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06344acd-5779-4403-b1cb-d33302f8a62c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:16.330454 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06344acd-5779-4403-b1cb-d33302f8a62c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:16.334547 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 779/1553] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:21:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:16.335358 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a328a-c730-4746-a0e1-9d7e3fea4795 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:16.348136 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a328a-c730-4746-a0e1-9d7e3fea4795 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:16.353289 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acd1b3a-8ed2-4dfa-9cf4-762fab24e163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:16.353974 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd1b3a-8ed2-4dfa-9cf4-762fab24e163 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:16.354263 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd1b3a-8ed2-4dfa-9cf4-762fab24e163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:16.357981 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 775/1554] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:21:16 2022] POST /identity/v3/users => generated 283 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:21:16.358135 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd1b3a-8ed2-4dfa-9cf4-762fab24e163 admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:16.358135 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acd1b3a-8ed2-4dfa-9cf4-762fab24e163 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:16.358319 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e25d1-864f-4e50-9c56-015a6740a7ce None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:16.358398 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: WARNING py.warnings [None req-3acd1b3a-8ed2-4dfa-9cf4-762fab24e163 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 20:21:16.358398 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: warnings.warn(msg) Jun 21 20:21:16.358398 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: Jun 21 20:21:16.358612 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e25d1-864f-4e50-9c56-015a6740a7ce None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:16.358612 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e25d1-864f-4e50-9c56-015a6740a7ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:16.358761 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acd1b3a-8ed2-4dfa-9cf4-762fab24e163 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:16.375354 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-da6e25d1-864f-4e50-9c56-015a6740a7ce None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:16.376591 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-da6e25d1-864f-4e50-9c56-015a6740a7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:16.377808 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 780/1555] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:21:16 2022] POST /identity/v3/users => generated 288 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:21:16.379077 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3ab6a-c149-4bab-bf2b-53231d19484e None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:16.379373 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3ab6a-c149-4bab-bf2b-53231d19484e None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:16.379653 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3ab6a-c149-4bab-bf2b-53231d19484e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:16.386667 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 776/1556] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:21:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:16.387895 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78008f3c-b4d7-4560-a5e6-194a14c75063 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:16.388212 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78008f3c-b4d7-4560-a5e6-194a14c75063 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:16.388492 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78008f3c-b4d7-4560-a5e6-194a14c75063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:16.399165 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-87f3ab6a-c149-4bab-bf2b-53231d19484e None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:16.400404 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-87f3ab6a-c149-4bab-bf2b-53231d19484e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:16.407944 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-78008f3c-b4d7-4560-a5e6-194a14c75063 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:16.408700 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 781/1557] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:21:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:16.409115 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-78008f3c-b4d7-4560-a5e6-194a14c75063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:16.409464 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f3ab6a-c149-4bab-bf2b-53231d19484e None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:16.419689 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 777/1558] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:21:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:16.420383 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78008f3c-b4d7-4560-a5e6-194a14c75063 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:16.421361 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f3ab6a-c149-4bab-bf2b-53231d19484e None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:16.426883 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f9f59c-5b89-489f-b46d-ae71342a200e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:16.427597 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f9f59c-5b89-489f-b46d-ae71342a200e admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:16.427882 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f9f59c-5b89-489f-b46d-ae71342a200e admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:16.428185 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f9f59c-5b89-489f-b46d-ae71342a200e admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:16.428913 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f9f59c-5b89-489f-b46d-ae71342a200e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:21:16.429221 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f9f59c-5b89-489f-b46d-ae71342a200e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:16.430460 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78008f3c-b4d7-4560-a5e6-194a14c75063 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:16.430839 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f9f59c-5b89-489f-b46d-ae71342a200e admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:16.435312 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad90f9-d881-48de-937b-3cc8ea29d23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:16.436009 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad90f9-d881-48de-937b-3cc8ea29d23f admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:16.436299 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad90f9-d881-48de-937b-3cc8ea29d23f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:16.436579 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad90f9-d881-48de-937b-3cc8ea29d23f admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:16.437871 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad90f9-d881-48de-937b-3cc8ea29d23f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:21:16.438183 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad90f9-d881-48de-937b-3cc8ea29d23f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:16.439763 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad90f9-d881-48de-937b-3cc8ea29d23f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:16.450082 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 782/1559] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:21:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:21:16.450082 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5815e35-b6c6-4c98-85fc-f7518decf7bc None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:16.450082 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5815e35-b6c6-4c98-85fc-f7518decf7bc None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:16.450082 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5815e35-b6c6-4c98-85fc-f7518decf7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:16.452055 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 778/1560] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:21:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:21:16.453478 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad90f9-d881-48de-937b-3cc8ea29d23f admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:16.463193 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad90f9-d881-48de-937b-3cc8ea29d23f admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:16.468200 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e625266a-1e2d-450f-ba03-7b44a9f6ac64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:16.468887 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625266a-1e2d-450f-ba03-7b44a9f6ac64 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:16.469171 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625266a-1e2d-450f-ba03-7b44a9f6ac64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:16.469448 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625266a-1e2d-450f-ba03-7b44a9f6ac64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:16.470166 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e625266a-1e2d-450f-ba03-7b44a9f6ac64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:16.470372 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-b5815e35-b6c6-4c98-85fc-f7518decf7bc None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:16.471606 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-b5815e35-b6c6-4c98-85fc-f7518decf7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:16.471803 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e625266a-1e2d-450f-ba03-7b44a9f6ac64 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:16.480640 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 783/1561] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:21:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:16.481426 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5815e35-b6c6-4c98-85fc-f7518decf7bc None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:16.484845 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 779/1562] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:21:16.484845 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1d989-2e10-420e-833d-3f85e0b67bb3 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:16.484845 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1d989-2e10-420e-833d-3f85e0b67bb3 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:16.484845 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1d989-2e10-420e-833d-3f85e0b67bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:16.490961 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5815e35-b6c6-4c98-85fc-f7518decf7bc None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:16.495449 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a88d798-74b2-40dc-811d-c9b03834706b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:16.496130 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88d798-74b2-40dc-811d-c9b03834706b admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:16.496420 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88d798-74b2-40dc-811d-c9b03834706b admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:16.496703 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88d798-74b2-40dc-811d-c9b03834706b admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:16.497459 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a88d798-74b2-40dc-811d-c9b03834706b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:16.499044 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a88d798-74b2-40dc-811d-c9b03834706b admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:16.501074 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-68f1d989-2e10-420e-833d-3f85e0b67bb3 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:16.502249 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-68f1d989-2e10-420e-833d-3f85e0b67bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:16.509471 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 784/1563] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:21:16.510055 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 780/1564] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:21:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:16.510256 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a88d798-74b2-40dc-811d-c9b03834706b admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:16.515844 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79824d34-ff40-43aa-a79b-ed29a6b2b4ec None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:16.516516 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79824d34-ff40-43aa-a79b-ed29a6b2b4ec None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:16.517879 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79824d34-ff40-43aa-a79b-ed29a6b2b4ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:16.520675 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a88d798-74b2-40dc-811d-c9b03834706b admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:16.525225 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4a2cc6-e2a0-4dbc-ba86-74a80753afbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:16.525898 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a2cc6-e2a0-4dbc-ba86-74a80753afbc admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:16.526186 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a2cc6-e2a0-4dbc-ba86-74a80753afbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:16.526464 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a2cc6-e2a0-4dbc-ba86-74a80753afbc admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:16.527183 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4a2cc6-e2a0-4dbc-ba86-74a80753afbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:21:16.527490 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4a2cc6-e2a0-4dbc-ba86-74a80753afbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:16.529088 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4a2cc6-e2a0-4dbc-ba86-74a80753afbc admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:16.535999 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-79824d34-ff40-43aa-a79b-ed29a6b2b4ec None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:16.537187 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-79824d34-ff40-43aa-a79b-ed29a6b2b4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:16.540832 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 785/1565] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:21:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:21:16.541581 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4a2cc6-e2a0-4dbc-ba86-74a80753afbc admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:16.549913 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 781/1566] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:21:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:16.550733 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79824d34-ff40-43aa-a79b-ed29a6b2b4ec None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:16.550930 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4a2cc6-e2a0-4dbc-ba86-74a80753afbc admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:16.555447 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2dde5e-a552-4add-a2ef-b98208e45888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:16.556124 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2dde5e-a552-4add-a2ef-b98208e45888 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:16.556411 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2dde5e-a552-4add-a2ef-b98208e45888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:16.556690 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2dde5e-a552-4add-a2ef-b98208e45888 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:16.557370 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2dde5e-a552-4add-a2ef-b98208e45888 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:16.559228 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2dde5e-a552-4add-a2ef-b98208e45888 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:16.560191 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79824d34-ff40-43aa-a79b-ed29a6b2b4ec None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:16.565166 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e322cb3-d688-49e7-9a45-4a63e51058be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:16.565828 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e322cb3-d688-49e7-9a45-4a63e51058be admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:16.566117 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e322cb3-d688-49e7-9a45-4a63e51058be admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:16.566396 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e322cb3-d688-49e7-9a45-4a63e51058be admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:16.567076 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e322cb3-d688-49e7-9a45-4a63e51058be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:16.568992 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e322cb3-d688-49e7-9a45-4a63e51058be admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:16.585517 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 786/1567] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:21:16 2022] POST /identity/v3/projects => generated 389 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:21:16.586737 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2dde5e-a552-4add-a2ef-b98208e45888 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:16.597051 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:21:16.598004 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 782/1568] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:21:16 2022] POST /identity/v3/projects => generated 363 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:21:16.598968 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e322cb3-d688-49e7-9a45-4a63e51058be admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:16.608762 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:21:16.654551 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2dde5e-a552-4add-a2ef-b98208e45888 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:16.659547 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be45e09-848b-4052-b424-1267f07b9ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:16.660238 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be45e09-848b-4052-b424-1267f07b9ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:16.660527 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be45e09-848b-4052-b424-1267f07b9ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:16.660661 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e322cb3-d688-49e7-9a45-4a63e51058be admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:16.660808 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be45e09-848b-4052-b424-1267f07b9ad8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:16.661537 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be45e09-848b-4052-b424-1267f07b9ad8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:21:16.661848 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be45e09-848b-4052-b424-1267f07b9ad8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:16.663439 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be45e09-848b-4052-b424-1267f07b9ad8 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:16.665207 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ac1eb-51ca-4d05-a1ab-2a5fb40562ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:16.665876 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ac1eb-51ca-4d05-a1ab-2a5fb40562ad admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:16.666160 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ac1eb-51ca-4d05-a1ab-2a5fb40562ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:16.666438 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ac1eb-51ca-4d05-a1ab-2a5fb40562ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:16.667167 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119ac1eb-51ca-4d05-a1ab-2a5fb40562ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:16.668774 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119ac1eb-51ca-4d05-a1ab-2a5fb40562ad admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:16.675014 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 787/1569] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:21:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:21:16.675809 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be45e09-848b-4052-b424-1267f07b9ad8 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:16.681390 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 783/1570] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:21:16.681390 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ac1eb-51ca-4d05-a1ab-2a5fb40562ad admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:16.685662 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be45e09-848b-4052-b424-1267f07b9ad8 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:16.691051 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6c388-5390-4a9e-8490-8387ff882f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:16.691740 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6c388-5390-4a9e-8490-8387ff882f38 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:16.692055 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6c388-5390-4a9e-8490-8387ff882f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:16.692340 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6c388-5390-4a9e-8490-8387ff882f38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:16.692495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ac1eb-51ca-4d05-a1ab-2a5fb40562ad admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:16.693070 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a6c388-5390-4a9e-8490-8387ff882f38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:16.694656 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a6c388-5390-4a9e-8490-8387ff882f38 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:16.696910 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6203b29-a9a8-4f08-9258-926d1575d47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:16.697545 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6203b29-a9a8-4f08-9258-926d1575d47b admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:16.697827 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6203b29-a9a8-4f08-9258-926d1575d47b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:16.698100 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6203b29-a9a8-4f08-9258-926d1575d47b admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:16.698816 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6203b29-a9a8-4f08-9258-926d1575d47b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:21:16.699120 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6203b29-a9a8-4f08-9258-926d1575d47b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:16.700748 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6203b29-a9a8-4f08-9258-926d1575d47b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:16.705860 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 788/1571] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:21:16.706628 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6c388-5390-4a9e-8490-8387ff882f38 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:16.722099 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 784/1572] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:21:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:21:16.722099 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6203b29-a9a8-4f08-9258-926d1575d47b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:16.722372 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6c388-5390-4a9e-8490-8387ff882f38 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:16.722372 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582843c-3c37-42d4-a622-7405df5b10c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:16.722372 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582843c-3c37-42d4-a622-7405df5b10c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:16.722372 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582843c-3c37-42d4-a622-7405df5b10c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:16.722723 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582843c-3c37-42d4-a622-7405df5b10c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:16.722723 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d582843c-3c37-42d4-a622-7405df5b10c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:16.724349 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d582843c-3c37-42d4-a622-7405df5b10c5 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:16.728126 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6203b29-a9a8-4f08-9258-926d1575d47b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:16.732662 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0a70c-b15a-47f4-b21d-11a69d22060b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:16.733298 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0a70c-b15a-47f4-b21d-11a69d22060b admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:16.733588 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0a70c-b15a-47f4-b21d-11a69d22060b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:16.733863 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0a70c-b15a-47f4-b21d-11a69d22060b admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:16.734618 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d0a70c-b15a-47f4-b21d-11a69d22060b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:21:16.734924 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d0a70c-b15a-47f4-b21d-11a69d22060b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:16.736525 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d0a70c-b15a-47f4-b21d-11a69d22060b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:16.749144 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 785/1573] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:21:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:21:16.750557 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0a70c-b15a-47f4-b21d-11a69d22060b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:16.751959 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 789/1574] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:21:16 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:21:16.751959 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582843c-3c37-42d4-a622-7405df5b10c5 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:16.766400 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0a70c-b15a-47f4-b21d-11a69d22060b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:16.816349 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582843c-3c37-42d4-a622-7405df5b10c5 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:16.820994 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca89866d-9d8a-49dd-83fe-87d364bb7fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:16.821640 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e4c52a-8974-437b-beb7-89fdaf06b055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:16.822060 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89866d-9d8a-49dd-83fe-87d364bb7fe6 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:16.822060 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89866d-9d8a-49dd-83fe-87d364bb7fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:16.822248 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4c52a-8974-437b-beb7-89fdaf06b055 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:16.822336 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89866d-9d8a-49dd-83fe-87d364bb7fe6 admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:16.822873 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca89866d-9d8a-49dd-83fe-87d364bb7fe6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:16.823382 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4c52a-8974-437b-beb7-89fdaf06b055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:16.823678 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4c52a-8974-437b-beb7-89fdaf06b055 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:16.824438 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e4c52a-8974-437b-beb7-89fdaf06b055 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:16.824820 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca89866d-9d8a-49dd-83fe-87d364bb7fe6 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:16.826359 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e4c52a-8974-437b-beb7-89fdaf06b055 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:16.847547 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 790/1575] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:21:16 2022] POST /identity/v3/users => generated 282 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:21:16.848303 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca89866d-9d8a-49dd-83fe-87d364bb7fe6 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:16.849382 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 786/1576] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:21:16 2022] POST /identity/v3/users => generated 295 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:21:16.852844 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e4c52a-8974-437b-beb7-89fdaf06b055 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:16.858121 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca89866d-9d8a-49dd-83fe-87d364bb7fe6 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:16.863365 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657201fe-674f-4397-b078-f277b9e54553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:16.864007 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e4c52a-8974-437b-beb7-89fdaf06b055 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:16.864277 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657201fe-674f-4397-b078-f277b9e54553 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:16.864566 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657201fe-674f-4397-b078-f277b9e54553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:16.864845 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657201fe-674f-4397-b078-f277b9e54553 admin admin] PATH_INFO: `/v3/projects/6c6f0565e8ce4ef9b175008162b48cf1/users/18e85b718c5f49f8a4ac6d06681d6b75/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:16.868682 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0ef85-5b5d-4ef5-a1bd-0ec08422747e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:16.869326 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0ef85-5b5d-4ef5-a1bd-0ec08422747e admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:16.869611 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0ef85-5b5d-4ef5-a1bd-0ec08422747e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:16.869888 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0ef85-5b5d-4ef5-a1bd-0ec08422747e admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:16.870574 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d0ef85-5b5d-4ef5-a1bd-0ec08422747e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:16.872607 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d0ef85-5b5d-4ef5-a1bd-0ec08422747e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:16.880474 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657201fe-674f-4397-b078-f277b9e54553 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c6f0565e8ce4ef9b175008162b48cf1, user_id=18e85b718c5f49f8a4ac6d06681d6b75, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:16.883296 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657201fe-674f-4397-b078-f277b9e54553 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:16.897566 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 791/1577] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:21:16 2022] PUT /identity/v3/projects/6c6f0565e8ce4ef9b175008162b48cf1/users/18e85b718c5f49f8a4ac6d06681d6b75/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:21:16.898719 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657201fe-674f-4397-b078-f277b9e54553 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:16.902683 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 787/1578] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:21:16 2022] POST /identity/v3/projects => generated 393 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:21:16.902683 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0ef85-5b5d-4ef5-a1bd-0ec08422747e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:16.944635 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:21:16.954526 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:21:16.967834 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657201fe-674f-4397-b078-f277b9e54553 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:16.970104 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0ef85-5b5d-4ef5-a1bd-0ec08422747e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:16.972918 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91abf30e-b5cd-4b6d-b88f-31969de28faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:16.973914 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91abf30e-b5cd-4b6d-b88f-31969de28faf admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:16.974304 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91abf30e-b5cd-4b6d-b88f-31969de28faf admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:16.974738 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70d38c0-8710-4a44-8fd1-d7f63d920345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:16.974904 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91abf30e-b5cd-4b6d-b88f-31969de28faf admin admin] PATH_INFO: `/v3/projects/2ae73ae596ed45a080e3f0b8dcc4b389/users/4f3b5970d9534441a2d208633b2e9942/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:16.975691 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d38c0-8710-4a44-8fd1-d7f63d920345 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:16.976245 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d38c0-8710-4a44-8fd1-d7f63d920345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:16.976722 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d38c0-8710-4a44-8fd1-d7f63d920345 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:16.977928 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70d38c0-8710-4a44-8fd1-d7f63d920345 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:16.981485 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70d38c0-8710-4a44-8fd1-d7f63d920345 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:16.994823 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91abf30e-b5cd-4b6d-b88f-31969de28faf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ae73ae596ed45a080e3f0b8dcc4b389, user_id=4f3b5970d9534441a2d208633b2e9942, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:16.997510 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91abf30e-b5cd-4b6d-b88f-31969de28faf admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:17.010417 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 788/1579] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:21:16 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:21:17.011459 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70d38c0-8710-4a44-8fd1-d7f63d920345 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:17.012023 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 792/1580] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:21:16 2022] PUT /identity/v3/projects/2ae73ae596ed45a080e3f0b8dcc4b389/users/4f3b5970d9534441a2d208633b2e9942/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:21:17.013051 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91abf30e-b5cd-4b6d-b88f-31969de28faf admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:17.073404 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91abf30e-b5cd-4b6d-b88f-31969de28faf admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:17.076294 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70d38c0-8710-4a44-8fd1-d7f63d920345 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:17.077986 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dbf345-45c0-454d-95b4-b8662fc2aae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:17.078647 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dbf345-45c0-454d-95b4-b8662fc2aae7 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:17.078935 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dbf345-45c0-454d-95b4-b8662fc2aae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:17.079215 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dbf345-45c0-454d-95b4-b8662fc2aae7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:17.079902 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dbf345-45c0-454d-95b4-b8662fc2aae7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:17.080926 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8387a80d-e2ac-4bab-82fb-938a3f514371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:17.081597 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387a80d-e2ac-4bab-82fb-938a3f514371 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:17.081838 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dbf345-45c0-454d-95b4-b8662fc2aae7 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:17.081936 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387a80d-e2ac-4bab-82fb-938a3f514371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:17.082216 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387a80d-e2ac-4bab-82fb-938a3f514371 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:17.082907 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8387a80d-e2ac-4bab-82fb-938a3f514371 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:17.084951 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8387a80d-e2ac-4bab-82fb-938a3f514371 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:17.106189 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 789/1581] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:21:17 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:21:17.108365 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 793/1582] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:21:17 2022] POST /identity/v3/projects => generated 379 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:21:17.110385 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8387a80d-e2ac-4bab-82fb-938a3f514371 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:17.110798 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dbf345-45c0-454d-95b4-b8662fc2aae7 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:17.120245 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8387a80d-e2ac-4bab-82fb-938a3f514371 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:17.174162 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dbf345-45c0-454d-95b4-b8662fc2aae7 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:17.178574 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffac390-6736-4400-b50f-71039e07a81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:17.178716 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37183d-874a-4645-80c3-d367f89f389e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:17.179253 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffac390-6736-4400-b50f-71039e07a81f admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:17.179357 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37183d-874a-4645-80c3-d367f89f389e admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:17.179543 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffac390-6736-4400-b50f-71039e07a81f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:17.179643 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37183d-874a-4645-80c3-d367f89f389e admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:17.179824 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffac390-6736-4400-b50f-71039e07a81f admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:17.179958 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37183d-874a-4645-80c3-d367f89f389e admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:17.180580 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e37183d-874a-4645-80c3-d367f89f389e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:17.180691 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffac390-6736-4400-b50f-71039e07a81f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:17.182169 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffac390-6736-4400-b50f-71039e07a81f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:17.182328 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e37183d-874a-4645-80c3-d367f89f389e admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:17.192488 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 794/1583] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:21:17.195740 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 790/1584] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:21:17.195883 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37183d-874a-4645-80c3-d367f89f389e admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:17.196039 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8451713-a599-4a9a-bdd2-cfeca225fdf3 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:17.196039 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8451713-a599-4a9a-bdd2-cfeca225fdf3 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:17.196039 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8451713-a599-4a9a-bdd2-cfeca225fdf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:17.205566 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37183d-874a-4645-80c3-d367f89f389e admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:17.210673 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63fa4cd-5594-4ce9-8cb4-78170e671e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:17.211442 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63fa4cd-5594-4ce9-8cb4-78170e671e7a admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:17.211735 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63fa4cd-5594-4ce9-8cb4-78170e671e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:17.212072 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63fa4cd-5594-4ce9-8cb4-78170e671e7a admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:17.212793 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63fa4cd-5594-4ce9-8cb4-78170e671e7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:17.214992 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63fa4cd-5594-4ce9-8cb4-78170e671e7a admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:17.220747 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-d8451713-a599-4a9a-bdd2-cfeca225fdf3 None None] MFA Rules not processed for user `18e85b718c5f49f8a4ac6d06681d6b75`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:17.221956 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d8451713-a599-4a9a-bdd2-cfeca225fdf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:17.235389 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 795/1585] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:21:17 2022] POST /identity/v3/users => generated 297 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:21:17.236347 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63fa4cd-5594-4ce9-8cb4-78170e671e7a admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:17.245578 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63fa4cd-5594-4ce9-8cb4-78170e671e7a admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:17.250160 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b5d42-bbdc-49e1-ba3e-0880dbbad6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:17.250800 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b5d42-bbdc-49e1-ba3e-0880dbbad6f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:17.251087 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b5d42-bbdc-49e1-ba3e-0880dbbad6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:17.251363 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b5d42-bbdc-49e1-ba3e-0880dbbad6f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:17.252073 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4b5d42-bbdc-49e1-ba3e-0880dbbad6f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:17.254010 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4b5d42-bbdc-49e1-ba3e-0880dbbad6f3 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:17.269036 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:21:17.275657 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 796/1586] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:21:17 2022] POST /identity/v3/users => generated 293 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:21:17.276943 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba55bc-fff6-4035-a982-0aa82a334efb None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:17.277234 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba55bc-fff6-4035-a982-0aa82a334efb None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:17.277516 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba55bc-fff6-4035-a982-0aa82a334efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:17.284178 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:21:17.293101 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 791/1587] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:21:17 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:17.293786 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8451713-a599-4a9a-bdd2-cfeca225fdf3 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:17.296174 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-edba55bc-fff6-4035-a982-0aa82a334efb None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:17.298254 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-edba55bc-fff6-4035-a982-0aa82a334efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:17.304940 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8451713-a599-4a9a-bdd2-cfeca225fdf3 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:17.305994 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 797/1588] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:21:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:17.306888 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba55bc-fff6-4035-a982-0aa82a334efb None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:17.309863 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe913376-94eb-4c56-9c12-7bdb0caae6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:17.310394 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe913376-94eb-4c56-9c12-7bdb0caae6b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:17.310690 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe913376-94eb-4c56-9c12-7bdb0caae6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:17.310976 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe913376-94eb-4c56-9c12-7bdb0caae6b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:17.311716 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe913376-94eb-4c56-9c12-7bdb0caae6b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:17.313462 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe913376-94eb-4c56-9c12-7bdb0caae6b5 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:17.316508 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba55bc-fff6-4035-a982-0aa82a334efb None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:17.321288 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ab4e4-b1c2-490a-93ec-e378d718ddec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:17.321975 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ab4e4-b1c2-490a-93ec-e378d718ddec admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:17.322264 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ab4e4-b1c2-490a-93ec-e378d718ddec admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:17.322549 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ab4e4-b1c2-490a-93ec-e378d718ddec admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:17.323296 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ab4e4-b1c2-490a-93ec-e378d718ddec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:17.326862 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 792/1589] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:21:17.326862 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe913376-94eb-4c56-9c12-7bdb0caae6b5 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:17.327078 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ab4e4-b1c2-490a-93ec-e378d718ddec admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:17.336132 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe913376-94eb-4c56-9c12-7bdb0caae6b5 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:17.341459 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf0611d-6335-481f-882c-a7c3deaeeab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:17.342109 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf0611d-6335-481f-882c-a7c3deaeeab7 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:17.342403 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf0611d-6335-481f-882c-a7c3deaeeab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:17.342689 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf0611d-6335-481f-882c-a7c3deaeeab7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:17.343971 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf0611d-6335-481f-882c-a7c3deaeeab7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:17.345546 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf0611d-6335-481f-882c-a7c3deaeeab7 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:17.346782 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 798/1590] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:21:17 2022] POST /identity/v3/users => generated 290 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:21:17.347589 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ab4e4-b1c2-490a-93ec-e378d718ddec admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:17.356127 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 793/1591] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:21:17.356984 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf0611d-6335-481f-882c-a7c3deaeeab7 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:17.361052 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ab4e4-b1c2-490a-93ec-e378d718ddec admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:17.365865 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f465670-5871-4f64-b430-fc15b0495d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:17.366529 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f465670-5871-4f64-b430-fc15b0495d1f admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:17.366852 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f465670-5871-4f64-b430-fc15b0495d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:17.367134 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f465670-5871-4f64-b430-fc15b0495d1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:17.367239 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf0611d-6335-481f-882c-a7c3deaeeab7 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:17.367866 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f465670-5871-4f64-b430-fc15b0495d1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:17.369523 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f465670-5871-4f64-b430-fc15b0495d1f admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:17.372515 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792060d2-35f2-4f2c-b75a-d97d53ea4d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:17.373165 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792060d2-35f2-4f2c-b75a-d97d53ea4d5f admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:17.373482 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792060d2-35f2-4f2c-b75a-d97d53ea4d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:17.373768 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792060d2-35f2-4f2c-b75a-d97d53ea4d5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:17.374490 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792060d2-35f2-4f2c-b75a-d97d53ea4d5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:17.376589 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792060d2-35f2-4f2c-b75a-d97d53ea4d5f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:17.379732 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 799/1592] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:21:17.380573 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f465670-5871-4f64-b430-fc15b0495d1f admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:17.387120 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 794/1593] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:21:17.387777 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792060d2-35f2-4f2c-b75a-d97d53ea4d5f admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:17.390334 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f465670-5871-4f64-b430-fc15b0495d1f admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:17.394863 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4006b43-90d7-430a-b272-de5bf1b9819c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:17.395540 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4006b43-90d7-430a-b272-de5bf1b9819c admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:17.395832 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4006b43-90d7-430a-b272-de5bf1b9819c admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:17.396157 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4006b43-90d7-430a-b272-de5bf1b9819c admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:17.396881 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4006b43-90d7-430a-b272-de5bf1b9819c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:17.397422 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792060d2-35f2-4f2c-b75a-d97d53ea4d5f admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:17.398446 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4006b43-90d7-430a-b272-de5bf1b9819c admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:17.402756 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b6582-1653-40fd-990d-333840ce7f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:17.403390 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b6582-1653-40fd-990d-333840ce7f84 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:17.403683 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b6582-1653-40fd-990d-333840ce7f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:17.403995 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b6582-1653-40fd-990d-333840ce7f84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:17.404677 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941b6582-1653-40fd-990d-333840ce7f84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:17.407071 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941b6582-1653-40fd-990d-333840ce7f84 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:17.409473 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 800/1594] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:21:17.410330 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4006b43-90d7-430a-b272-de5bf1b9819c admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:17.440544 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 795/1595] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:21:17 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:21:17.440544 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b6582-1653-40fd-990d-333840ce7f84 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:17.469527 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4006b43-90d7-430a-b272-de5bf1b9819c admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:17.498970 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b6582-1653-40fd-990d-333840ce7f84 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:17.503643 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaaf5b7-f0dc-49da-920a-5429be233a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:17.504340 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaaf5b7-f0dc-49da-920a-5429be233a88 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:17.504628 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaaf5b7-f0dc-49da-920a-5429be233a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:17.504910 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaaf5b7-f0dc-49da-920a-5429be233a88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:17.505676 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaaf5b7-f0dc-49da-920a-5429be233a88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:17.507330 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaaf5b7-f0dc-49da-920a-5429be233a88 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:17.517049 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 796/1596] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:21:17.517539 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1563768e-5ebd-4196-a592-d9ae2cf58bc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:17.517840 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaaf5b7-f0dc-49da-920a-5429be233a88 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:17.518370 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563768e-5ebd-4196-a592-d9ae2cf58bc9 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:17.518666 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563768e-5ebd-4196-a592-d9ae2cf58bc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:17.518954 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563768e-5ebd-4196-a592-d9ae2cf58bc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:17.527041 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaaf5b7-f0dc-49da-920a-5429be233a88 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:17.528561 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1563768e-5ebd-4196-a592-d9ae2cf58bc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:17.530017 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1563768e-5ebd-4196-a592-d9ae2cf58bc9 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:17.532187 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf293d-5aa6-417b-9071-e49c5f3ae2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:17.532825 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf293d-5aa6-417b-9071-e49c5f3ae2fe admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:17.533111 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf293d-5aa6-417b-9071-e49c5f3ae2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:17.533392 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf293d-5aa6-417b-9071-e49c5f3ae2fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:17.534101 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf293d-5aa6-417b-9071-e49c5f3ae2fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:17.535696 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf293d-5aa6-417b-9071-e49c5f3ae2fe admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:17.540271 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 801/1597] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:21:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:21:17.541118 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1563768e-5ebd-4196-a592-d9ae2cf58bc9 service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:17.545662 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 797/1598] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:21:17.547105 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf293d-5aa6-417b-9071-e49c5f3ae2fe admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:17.554104 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1563768e-5ebd-4196-a592-d9ae2cf58bc9 service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:17.558407 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf293d-5aa6-417b-9071-e49c5f3ae2fe admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:17.559641 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d46d02-6618-487b-a8dd-eaedb391cc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:17.560563 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d46d02-6618-487b-a8dd-eaedb391cc3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:17.560850 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d46d02-6618-487b-a8dd-eaedb391cc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:17.561132 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d46d02-6618-487b-a8dd-eaedb391cc3b admin admin] PATH_INFO: `/v3/projects/1bf055d91e7f47a090641c0ca0436442/users/4080825b9e154e808a9418fa8d6db987/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:17.563871 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d1876-539c-4ce0-a3e1-ed400eeca4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:17.565581 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d1876-539c-4ce0-a3e1-ed400eeca4fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:17.565867 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d1876-539c-4ce0-a3e1-ed400eeca4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:17.566154 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d1876-539c-4ce0-a3e1-ed400eeca4fe admin admin] PATH_INFO: `/v3/projects/ea01142cea2d4988b33d67637538673a/users/7f08655a955d45e4809a3f4d52a7e01e/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:17.577409 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d46d02-6618-487b-a8dd-eaedb391cc3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bf055d91e7f47a090641c0ca0436442, user_id=4080825b9e154e808a9418fa8d6db987, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:17.581053 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d46d02-6618-487b-a8dd-eaedb391cc3b admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:17.583779 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9d1876-539c-4ce0-a3e1-ed400eeca4fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea01142cea2d4988b33d67637538673a, user_id=7f08655a955d45e4809a3f4d52a7e01e, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:17.584906 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: WARNING py.warnings [None req-5b9d1876-539c-4ce0-a3e1-ed400eeca4fe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 20:21:17.584906 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: warnings.warn(msg) Jun 21 20:21:17.584906 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: Jun 21 20:21:17.587416 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9d1876-539c-4ce0-a3e1-ed400eeca4fe admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:17.597559 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 802/1599] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:21:17 2022] PUT /identity/v3/projects/1bf055d91e7f47a090641c0ca0436442/users/4080825b9e154e808a9418fa8d6db987/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:21:17.598598 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d46d02-6618-487b-a8dd-eaedb391cc3b admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:17.606830 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 798/1600] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:21:17 2022] PUT /identity/v3/projects/ea01142cea2d4988b33d67637538673a/users/7f08655a955d45e4809a3f4d52a7e01e/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:21:17.609593 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d1876-539c-4ce0-a3e1-ed400eeca4fe admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:17.661347 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:21:17.674140 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d46d02-6618-487b-a8dd-eaedb391cc3b admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:17.675430 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:21:17.687770 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d1876-539c-4ce0-a3e1-ed400eeca4fe admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:17.694178 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7489383-37fb-40c6-a198-80fcfbb3a3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:17.694873 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7489383-37fb-40c6-a198-80fcfbb3a3c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:17.695165 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7489383-37fb-40c6-a198-80fcfbb3a3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:17.695822 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7489383-37fb-40c6-a198-80fcfbb3a3c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:17.696210 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7489383-37fb-40c6-a198-80fcfbb3a3c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:17.698352 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7489383-37fb-40c6-a198-80fcfbb3a3c7 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:17.714993 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 799/1601] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:21:17.714993 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7489383-37fb-40c6-a198-80fcfbb3a3c7 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:17.724479 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7489383-37fb-40c6-a198-80fcfbb3a3c7 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:17.730519 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a892a-2d57-4865-bbd1-066c7bdb5dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:17.731219 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a892a-2d57-4865-bbd1-066c7bdb5dde admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:17.731565 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a892a-2d57-4865-bbd1-066c7bdb5dde admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:17.731854 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a892a-2d57-4865-bbd1-066c7bdb5dde admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:17.732909 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99a892a-2d57-4865-bbd1-066c7bdb5dde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:17.735706 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99a892a-2d57-4865-bbd1-066c7bdb5dde admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:17.747388 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28790689-f90e-4dd4-bf4a-e2b067238a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:17.748273 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28790689-f90e-4dd4-bf4a-e2b067238a91 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:17.748726 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28790689-f90e-4dd4-bf4a-e2b067238a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:17.749208 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28790689-f90e-4dd4-bf4a-e2b067238a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:17.750327 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28790689-f90e-4dd4-bf4a-e2b067238a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:17.752338 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28790689-f90e-4dd4-bf4a-e2b067238a91 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:17.760146 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 800/1602] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:21:17 2022] POST /identity/v3/users => generated 289 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:21:17.763518 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a892a-2d57-4865-bbd1-066c7bdb5dde admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:17.771327 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 803/1603] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:21:17.774243 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28790689-f90e-4dd4-bf4a-e2b067238a91 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:17.777286 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a892a-2d57-4865-bbd1-066c7bdb5dde admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:17.783775 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11f953-cf4f-4bb4-9c15-782fc4b5b36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:17.785124 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11f953-cf4f-4bb4-9c15-782fc4b5b36a admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:17.785487 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11f953-cf4f-4bb4-9c15-782fc4b5b36a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:17.785841 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11f953-cf4f-4bb4-9c15-782fc4b5b36a admin admin] PATH_INFO: `/v3/projects/85f6a60140dd499abaae7cb7f0554921/users/fc95af68a6d640699f788d5438cae607/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:17.790905 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28790689-f90e-4dd4-bf4a-e2b067238a91 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:17.796328 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469695e-b1a9-4409-bd63-ff340e01905c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:17.797487 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469695e-b1a9-4409-bd63-ff340e01905c admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:17.797857 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469695e-b1a9-4409-bd63-ff340e01905c admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:17.798203 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469695e-b1a9-4409-bd63-ff340e01905c admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:17.799500 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8469695e-b1a9-4409-bd63-ff340e01905c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:17.801574 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8469695e-b1a9-4409-bd63-ff340e01905c admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:17.802178 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa11f953-cf4f-4bb4-9c15-782fc4b5b36a admin admin] RBAC: Authorizing `identity:create_grant(project_id=85f6a60140dd499abaae7cb7f0554921, user_id=fc95af68a6d640699f788d5438cae607, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:17.805231 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa11f953-cf4f-4bb4-9c15-782fc4b5b36a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:17.815599 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 804/1604] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:21:17.817115 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705cab92-980a-4cff-aedb-bef61369026d None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:17.817505 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705cab92-980a-4cff-aedb-bef61369026d None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:17.818023 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705cab92-980a-4cff-aedb-bef61369026d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:17.823473 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 801/1605] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:21:17 2022] PUT /identity/v3/projects/85f6a60140dd499abaae7cb7f0554921/users/fc95af68a6d640699f788d5438cae607/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:21:17.825333 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d2599-7313-40b5-8c82-eb0486234939 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:17.825622 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d2599-7313-40b5-8c82-eb0486234939 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:17.825905 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d2599-7313-40b5-8c82-eb0486234939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:17.846528 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-705cab92-980a-4cff-aedb-bef61369026d None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:17.848289 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-705cab92-980a-4cff-aedb-bef61369026d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:17.860959 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-364d2599-7313-40b5-8c82-eb0486234939 None None] MFA Rules not processed for user `7f08655a955d45e4809a3f4d52a7e01e`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:17.862458 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-364d2599-7313-40b5-8c82-eb0486234939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:17.920933 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 805/1606] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:21:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:17.921893 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705cab92-980a-4cff-aedb-bef61369026d None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:17.933055 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705cab92-980a-4cff-aedb-bef61369026d None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:17.939113 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2949c4ae-9329-463b-9aea-0a2c7bbc7077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:17.940051 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949c4ae-9329-463b-9aea-0a2c7bbc7077 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:17.940440 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 802/1607] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:21:17 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:17.940574 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949c4ae-9329-463b-9aea-0a2c7bbc7077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:17.940574 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949c4ae-9329-463b-9aea-0a2c7bbc7077 admin admin] PATH_INFO: `/v3/projects/f64603ea8f8b4308b338915836e05ac3/users/482db0f325464de78d099376d5c7df00/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:17.944371 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d2599-7313-40b5-8c82-eb0486234939 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:17.955303 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d2599-7313-40b5-8c82-eb0486234939 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:17.958127 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2949c4ae-9329-463b-9aea-0a2c7bbc7077 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f64603ea8f8b4308b338915836e05ac3, user_id=482db0f325464de78d099376d5c7df00, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:17.960058 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b6202-6a57-4819-8e3e-515f2c755d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:17.960717 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b6202-6a57-4819-8e3e-515f2c755d3b admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:17.961002 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b6202-6a57-4819-8e3e-515f2c755d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:17.961103 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2949c4ae-9329-463b-9aea-0a2c7bbc7077 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:17.961274 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b6202-6a57-4819-8e3e-515f2c755d3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:17.962014 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b6202-6a57-4819-8e3e-515f2c755d3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:17.963605 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b6202-6a57-4819-8e3e-515f2c755d3b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:17.979211 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 806/1608] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:21:17 2022] PUT /identity/v3/projects/f64603ea8f8b4308b338915836e05ac3/users/482db0f325464de78d099376d5c7df00/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:21:17.979211 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2949c4ae-9329-463b-9aea-0a2c7bbc7077 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:17.979475 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 803/1609] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:21:17.979475 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b6202-6a57-4819-8e3e-515f2c755d3b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:17.989516 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b6202-6a57-4819-8e3e-515f2c755d3b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:18.055228 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e3d3fe-d1b8-45fd-96cc-1daa2479e616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:18.056272 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3d3fe-d1b8-45fd-96cc-1daa2479e616 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:18.056419 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2949c4ae-9329-463b-9aea-0a2c7bbc7077 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:18.058209 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3d3fe-d1b8-45fd-96cc-1daa2479e616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:18.058482 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3d3fe-d1b8-45fd-96cc-1daa2479e616 admin admin] PATH_INFO: `/v3/projects/8f4f74cb25c94ad78be8c8217c83f1b3/users/3fd51eea10924c9eb901382510d485a7/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:18.061350 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4865b-8180-48a9-af2b-7b91a2fcbfcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:18.063326 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4865b-8180-48a9-af2b-7b91a2fcbfcb admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:18.063615 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4865b-8180-48a9-af2b-7b91a2fcbfcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:18.063894 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4865b-8180-48a9-af2b-7b91a2fcbfcb admin admin] PATH_INFO: `/v3/projects/1f57677aeccd40b18fddf7968fdf8214/users/e41fb552c794495fa27a1ff74768b9d9/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:18.068388 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:21:18.081145 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e3d3fe-d1b8-45fd-96cc-1daa2479e616 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f4f74cb25c94ad78be8c8217c83f1b3, user_id=3fd51eea10924c9eb901382510d485a7, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:18.084343 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e3d3fe-d1b8-45fd-96cc-1daa2479e616 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:18.084486 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a4865b-8180-48a9-af2b-7b91a2fcbfcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f57677aeccd40b18fddf7968fdf8214, user_id=e41fb552c794495fa27a1ff74768b9d9, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:18.087220 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a4865b-8180-48a9-af2b-7b91a2fcbfcb admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:18.099209 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 804/1610] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:21:17 2022] PUT /identity/v3/projects/8f4f74cb25c94ad78be8c8217c83f1b3/users/3fd51eea10924c9eb901382510d485a7/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:21:18.100702 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471a185-2beb-405a-9fa1-7105cbb72215 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:18.101056 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471a185-2beb-405a-9fa1-7105cbb72215 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:18.101403 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471a185-2beb-405a-9fa1-7105cbb72215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:18.107257 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 807/1611] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:21:17 2022] PUT /identity/v3/projects/1f57677aeccd40b18fddf7968fdf8214/users/e41fb552c794495fa27a1ff74768b9d9/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:21:18.111420 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4865b-8180-48a9-af2b-7b91a2fcbfcb admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:18.113047 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-b1a4865b-8180-48a9-af2b-7b91a2fcbfcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:18.120520 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-a471a185-2beb-405a-9fa1-7105cbb72215 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:18.122882 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a471a185-2beb-405a-9fa1-7105cbb72215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:18.127642 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:21:18.203565 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 805/1612] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:21:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:18.212452 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4865b-8180-48a9-af2b-7b91a2fcbfcb admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:18.213271 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a471a185-2beb-405a-9fa1-7105cbb72215 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:18.216872 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae7c30-3f59-4f6a-aa3e-b81f19de4db4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:18.217616 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae7c30-3f59-4f6a-aa3e-b81f19de4db4 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:18.217981 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae7c30-3f59-4f6a-aa3e-b81f19de4db4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:18.218389 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae7c30-3f59-4f6a-aa3e-b81f19de4db4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:18.224716 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a471a185-2beb-405a-9fa1-7105cbb72215 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:18.229906 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e861982-7d85-43e8-8289-5cf37cccd30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:18.230090 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae7c30-3f59-4f6a-aa3e-b81f19de4db4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:18.230735 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e861982-7d85-43e8-8289-5cf37cccd30a admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:18.231120 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e861982-7d85-43e8-8289-5cf37cccd30a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:18.231467 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e861982-7d85-43e8-8289-5cf37cccd30a admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:18.231773 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae7c30-3f59-4f6a-aa3e-b81f19de4db4 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:18.232320 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e861982-7d85-43e8-8289-5cf37cccd30a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:18.234342 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e861982-7d85-43e8-8289-5cf37cccd30a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:18.243444 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 808/1613] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:21:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:21:18.246610 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae7c30-3f59-4f6a-aa3e-b81f19de4db4 service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:18.269504 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae7c30-3f59-4f6a-aa3e-b81f19de4db4 service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:18.275732 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e1aeb2-7649-4dbb-a8d8-5f8b263ead64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:18.276710 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1aeb2-7649-4dbb-a8d8-5f8b263ead64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:18.276998 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1aeb2-7649-4dbb-a8d8-5f8b263ead64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:18.277336 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1aeb2-7649-4dbb-a8d8-5f8b263ead64 admin admin] PATH_INFO: `/v3/projects/fe4bc97b43674dfab9ec4bd53aeabeb0/users/77f7c2f751ac4b31abb6df7d661f454d/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:18.283045 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 806/1614] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:21:18 2022] POST /identity/v3/projects => generated 355 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:21:18.283045 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c10f3-a6fb-422f-b36e-7605fddacf89 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:18.283045 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c10f3-a6fb-422f-b36e-7605fddacf89 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:18.283045 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c10f3-a6fb-422f-b36e-7605fddacf89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:18.300429 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e1aeb2-7649-4dbb-a8d8-5f8b263ead64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe4bc97b43674dfab9ec4bd53aeabeb0, user_id=77f7c2f751ac4b31abb6df7d661f454d, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:18.303710 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e1aeb2-7649-4dbb-a8d8-5f8b263ead64 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:18.324999 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 809/1615] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:21:18 2022] PUT /identity/v3/projects/fe4bc97b43674dfab9ec4bd53aeabeb0/users/77f7c2f751ac4b31abb6df7d661f454d/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:21:18.326744 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e1e75-e3e9-4b92-8a2d-a51465de5dfa None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:18.327163 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e1e75-e3e9-4b92-8a2d-a51465de5dfa None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:18.327474 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-6c8c10f3-a6fb-422f-b36e-7605fddacf89 None None] MFA Rules not processed for user `482db0f325464de78d099376d5c7df00`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:18.328670 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e1e75-e3e9-4b92-8a2d-a51465de5dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:18.331080 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6c8c10f3-a6fb-422f-b36e-7605fddacf89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:18.351172 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-c84e1e75-e3e9-4b92-8a2d-a51465de5dfa None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:18.352851 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-c84e1e75-e3e9-4b92-8a2d-a51465de5dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:18.424895 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 807/1616] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:21:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:18.424895 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97e698-07e8-495b-99ae-6f9828c25aa7 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:18.424895 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97e698-07e8-495b-99ae-6f9828c25aa7 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:18.424895 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97e698-07e8-495b-99ae-6f9828c25aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:18.448235 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 810/1617] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:21:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:18.449368 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84e1e75-e3e9-4b92-8a2d-a51465de5dfa None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:18.454492 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-3d97e698-07e8-495b-99ae-6f9828c25aa7 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:18.457262 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3d97e698-07e8-495b-99ae-6f9828c25aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:18.476200 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 808/1618] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:21:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:18.477556 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97e698-07e8-495b-99ae-6f9828c25aa7 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:18.494260 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97e698-07e8-495b-99ae-6f9828c25aa7 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:18.516188 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe4c0e-1162-472c-bf38-250443291947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:18.516861 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe4c0e-1162-472c-bf38-250443291947 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:18.517250 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe4c0e-1162-472c-bf38-250443291947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:18.517429 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe4c0e-1162-472c-bf38-250443291947 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:18.518176 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fe4c0e-1162-472c-bf38-250443291947 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:18.522754 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fe4c0e-1162-472c-bf38-250443291947 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:18.548794 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84e1e75-e3e9-4b92-8a2d-a51465de5dfa None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:18.553572 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad5942c-988b-4541-a886-638e4852702e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:18.554274 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5942c-988b-4541-a886-638e4852702e service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:18.554567 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5942c-988b-4541-a886-638e4852702e service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:18.554882 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5942c-988b-4541-a886-638e4852702e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:18.569686 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 809/1619] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:21:18 2022] POST /identity/v3/users => generated 284 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:21:18.570903 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe4c0e-1162-472c-bf38-250443291947 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:18.583664 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe4c0e-1162-472c-bf38-250443291947 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:18.588147 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad5942c-988b-4541-a886-638e4852702e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:18.590629 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d083d875-1019-4088-b238-508aca524526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:18.591416 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083d875-1019-4088-b238-508aca524526 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:18.591971 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083d875-1019-4088-b238-508aca524526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:18.592305 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083d875-1019-4088-b238-508aca524526 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:18.593099 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d083d875-1019-4088-b238-508aca524526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:18.593680 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad5942c-988b-4541-a886-638e4852702e service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:18.594844 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d083d875-1019-4088-b238-508aca524526 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:18.608409 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 810/1620] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:21:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:21:18.611112 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a53294-f1d2-416c-8535-a1f161e6ceb4 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:18.611411 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a53294-f1d2-416c-8535-a1f161e6ceb4 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:18.612312 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a53294-f1d2-416c-8535-a1f161e6ceb4 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:18.613753 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 811/1621] 10.222.0.15 () {54 vars in 961 bytes} [Tue Jun 21 20:21:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:21:18.614374 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a53294-f1d2-416c-8535-a1f161e6ceb4 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:18.627354 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a53294-f1d2-416c-8535-a1f161e6ceb4 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:18.627641 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 811/1622] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:21:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:21:18.629025 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad5942c-988b-4541-a886-638e4852702e service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:18.636138 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f1220-fa02-4fab-927e-39edc9d518f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:18.636806 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f1220-fa02-4fab-927e-39edc9d518f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:18.637094 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f1220-fa02-4fab-927e-39edc9d518f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:18.637385 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f1220-fa02-4fab-927e-39edc9d518f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:18.640857 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad5942c-988b-4541-a886-638e4852702e service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:18.648533 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e66caf-9040-4a75-9ba2-ae419690f270 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:18.649465 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e66caf-9040-4a75-9ba2-ae419690f270 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:18.651104 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e66caf-9040-4a75-9ba2-ae419690f270 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:18.652975 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e66caf-9040-4a75-9ba2-ae419690f270 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:18.663859 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:21:18.664750 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58f1220-fa02-4fab-927e-39edc9d518f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:18.666303 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58f1220-fa02-4fab-927e-39edc9d518f6 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:18.679501 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e66caf-9040-4a75-9ba2-ae419690f270 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:18.681274 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 812/1623] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:21:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:21:18.681851 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e66caf-9040-4a75-9ba2-ae419690f270 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:18.682200 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f1220-fa02-4fab-927e-39edc9d518f6 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:18.695675 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f1220-fa02-4fab-927e-39edc9d518f6 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:18.702006 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a71d72-be20-4ea8-a6ad-2aa2e894df1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:18.703634 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a71d72-be20-4ea8-a6ad-2aa2e894df1d admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:18.703955 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a71d72-be20-4ea8-a6ad-2aa2e894df1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:18.704238 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a71d72-be20-4ea8-a6ad-2aa2e894df1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:18.705127 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a71d72-be20-4ea8-a6ad-2aa2e894df1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:18.706925 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a71d72-be20-4ea8-a6ad-2aa2e894df1d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:18.709239 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 812/1624] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:21:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:21:18.709941 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e66caf-9040-4a75-9ba2-ae419690f270 service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:18.719740 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 813/1625] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:21:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:21:18.721143 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df65016-fee5-4924-bc54-cd8ccf1faf4e None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:18.721440 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df65016-fee5-4924-bc54-cd8ccf1faf4e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:18.721721 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df65016-fee5-4924-bc54-cd8ccf1faf4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:18.739426 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e66caf-9040-4a75-9ba2-ae419690f270 service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:18.741685 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-7df65016-fee5-4924-bc54-cd8ccf1faf4e None None] MFA Rules not processed for user `3918fe05c8634bc39f3e295374701465`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:18.742919 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7df65016-fee5-4924-bc54-cd8ccf1faf4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:18.752492 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491532c1-ec71-4f88-a54f-ff764cf91695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:18.753763 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491532c1-ec71-4f88-a54f-ff764cf91695 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:18.754103 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491532c1-ec71-4f88-a54f-ff764cf91695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:18.754384 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491532c1-ec71-4f88-a54f-ff764cf91695 admin admin] PATH_INFO: `/v3/projects/fe4bc97b43674dfab9ec4bd53aeabeb0/users/77f7c2f751ac4b31abb6df7d661f454d/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:18.757487 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:21:18.760528 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491532c1-ec71-4f88-a54f-ff764cf91695 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe4bc97b43674dfab9ec4bd53aeabeb0, user_id=77f7c2f751ac4b31abb6df7d661f454d, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:18.764326 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491532c1-ec71-4f88-a54f-ff764cf91695 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:18.786921 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 813/1626] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:21:18 2022] PUT /identity/v3/projects/fe4bc97b43674dfab9ec4bd53aeabeb0/users/77f7c2f751ac4b31abb6df7d661f454d/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:21:18.787862 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491532c1-ec71-4f88-a54f-ff764cf91695 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:18.842030 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 814/1627] 10.222.0.15 () {58 vars in 1058 bytes} [Tue Jun 21 20:21:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:18.844187 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db612c02-52d5-4aac-a221-4f8c6987fb64 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:18.844628 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db612c02-52d5-4aac-a221-4f8c6987fb64 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:18.844913 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db612c02-52d5-4aac-a221-4f8c6987fb64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:18.880272 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-db612c02-52d5-4aac-a221-4f8c6987fb64 None None] MFA Rules not processed for user `77f7c2f751ac4b31abb6df7d661f454d`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:18.881500 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-db612c02-52d5-4aac-a221-4f8c6987fb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:18.933444 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491532c1-ec71-4f88-a54f-ff764cf91695 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:18.939079 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035cb104-af7c-4044-84a1-225b4d6a1249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:18.940406 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035cb104-af7c-4044-84a1-225b4d6a1249 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:18.940740 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035cb104-af7c-4044-84a1-225b4d6a1249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:18.941026 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035cb104-af7c-4044-84a1-225b4d6a1249 admin admin] PATH_INFO: `/v3/projects/f94ef2748965403aae3b8ca4d73d3a7b/users/d11de28d1344495c830c78181e264f95/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:18.966397 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035cb104-af7c-4044-84a1-225b4d6a1249 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f94ef2748965403aae3b8ca4d73d3a7b, user_id=d11de28d1344495c830c78181e264f95, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:18.972461 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035cb104-af7c-4044-84a1-225b4d6a1249 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:18.984615 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 815/1628] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:21:18 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:18.986341 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db612c02-52d5-4aac-a221-4f8c6987fb64 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:19.002934 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 814/1629] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:21:18 2022] PUT /identity/v3/projects/f94ef2748965403aae3b8ca4d73d3a7b/users/d11de28d1344495c830c78181e264f95/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:21:19.003861 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035cb104-af7c-4044-84a1-225b4d6a1249 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:19.132688 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035cb104-af7c-4044-84a1-225b4d6a1249 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:19.133534 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db612c02-52d5-4aac-a221-4f8c6987fb64 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:19.143778 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc1558c-5574-4370-ba46-7355b2820197 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:19.144642 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1558c-5574-4370-ba46-7355b2820197 service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:19.146091 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1558c-5574-4370-ba46-7355b2820197 service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:19.146398 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1558c-5574-4370-ba46-7355b2820197 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:19.199618 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:21:19.264939 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ea49b-126d-4603-94d1-b66c4d72f894 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3918fe05c8634bc39f3e295374701465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:19.266634 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ea49b-126d-4603-94d1-b66c4d72f894 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:19.267023 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ea49b-126d-4603-94d1-b66c4d72f894 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:19.268003 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ea49b-126d-4603-94d1-b66c4d72f894 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:19.276157 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc1558c-5574-4370-ba46-7355b2820197 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:19.279136 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc1558c-5574-4370-ba46-7355b2820197 service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:19.305778 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 815/1630] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:21:19 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:21:19.306889 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc1558c-5574-4370-ba46-7355b2820197 service cinder] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:19.323131 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:21:19.387736 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4ea49b-126d-4603-94d1-b66c4d72f894 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:19.392451 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4ea49b-126d-4603-94d1-b66c4d72f894 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:19.400965 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc1558c-5574-4370-ba46-7355b2820197 service cinder] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:19.408866 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8360da8f-97fe-40db-b72f-bc4a98d6d970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:19.410159 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360da8f-97fe-40db-b72f-bc4a98d6d970 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:19.410756 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360da8f-97fe-40db-b72f-bc4a98d6d970 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:19.411335 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360da8f-97fe-40db-b72f-bc4a98d6d970 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:19.412518 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8360da8f-97fe-40db-b72f-bc4a98d6d970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:19.414382 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 816/1631] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:21:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:21:19.414969 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8360da8f-97fe-40db-b72f-bc4a98d6d970 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:19.432632 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 816/1632] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:21:19 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:21:19.436469 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ea49b-126d-4603-94d1-b66c4d72f894 service nova] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:19.450571 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ea49b-126d-4603-94d1-b66c4d72f894 service nova] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:19.457224 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431252f8-28e6-4bb0-9cb8-23372af7dcad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:19.458161 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431252f8-28e6-4bb0-9cb8-23372af7dcad admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:19.458452 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431252f8-28e6-4bb0-9cb8-23372af7dcad admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:19.459217 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431252f8-28e6-4bb0-9cb8-23372af7dcad admin admin] PATH_INFO: `/v3/projects/f94ef2748965403aae3b8ca4d73d3a7b/users/d11de28d1344495c830c78181e264f95/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:19.461524 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431252f8-28e6-4bb0-9cb8-23372af7dcad admin admin] RBAC: Authorizing `identity:create_grant(project_id=f94ef2748965403aae3b8ca4d73d3a7b, user_id=d11de28d1344495c830c78181e264f95, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:19.466107 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431252f8-28e6-4bb0-9cb8-23372af7dcad admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:19.478474 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 817/1633] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:21:19 2022] PUT /identity/v3/projects/f94ef2748965403aae3b8ca4d73d3a7b/users/d11de28d1344495c830c78181e264f95/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:21:19.490117 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb4e8f-bb4c-45f5-b97b-b93088f0dfa5 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:19.490763 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb4e8f-bb4c-45f5-b97b-b93088f0dfa5 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:19.491272 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb4e8f-bb4c-45f5-b97b-b93088f0dfa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:19.546314 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-50eb4e8f-bb4c-45f5-b97b-b93088f0dfa5 None None] MFA Rules not processed for user `d11de28d1344495c830c78181e264f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:19.549354 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-50eb4e8f-bb4c-45f5-b97b-b93088f0dfa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:19.722429 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 817/1634] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:21:19 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:19.724353 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431252f8-28e6-4bb0-9cb8-23372af7dcad admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:19.824031 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431252f8-28e6-4bb0-9cb8-23372af7dcad admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:19.829382 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d38bd0-411d-419f-b344-6aa68719491d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:19.830277 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d38bd0-411d-419f-b344-6aa68719491d service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:19.830673 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d38bd0-411d-419f-b344-6aa68719491d service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:19.831228 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d38bd0-411d-419f-b344-6aa68719491d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:19.857803 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d38bd0-411d-419f-b344-6aa68719491d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:19.860263 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d38bd0-411d-419f-b344-6aa68719491d service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:19.880344 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 818/1635] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:21:19 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:21:19.922952 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942390c-e624-4a31-bdae-6e6675743a4f None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:19.922952 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942390c-e624-4a31-bdae-6e6675743a4f None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:19.922952 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942390c-e624-4a31-bdae-6e6675743a4f None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:19.925208 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 818/1636] 10.222.0.15 () {54 vars in 912 bytes} [Tue Jun 21 20:21:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:21:19.931275 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b7d70-7c78-49f0-a5c1-57205eee59c0 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:19.931689 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b7d70-7c78-49f0-a5c1-57205eee59c0 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:19.932050 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b7d70-7c78-49f0-a5c1-57205eee59c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:19.986329 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-8e8b7d70-7c78-49f0-a5c1-57205eee59c0 None None] MFA Rules not processed for user `3918fe05c8634bc39f3e295374701465`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:19.988059 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8e8b7d70-7c78-49f0-a5c1-57205eee59c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:20.106604 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a942390c-e624-4a31-bdae-6e6675743a4f None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:20.129975 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a942390c-e624-4a31-bdae-6e6675743a4f None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:20.139176 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec926152-301e-4be7-97ca-45f191e6ba94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:20.139867 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec926152-301e-4be7-97ca-45f191e6ba94 service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:20.140306 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec926152-301e-4be7-97ca-45f191e6ba94 service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:20.141457 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec926152-301e-4be7-97ca-45f191e6ba94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:20.157312 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:21:20.182293 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 819/1637] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jun 21 20:21:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:20.183327 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b7d70-7c78-49f0-a5c1-57205eee59c0 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:20.273153 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec926152-301e-4be7-97ca-45f191e6ba94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:20.274903 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec926152-301e-4be7-97ca-45f191e6ba94 service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:20.291307 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b7d70-7c78-49f0-a5c1-57205eee59c0 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:20.298454 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a977ca-e88f-46b1-b148-84768f3b1454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:20.299402 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a977ca-e88f-46b1-b148-84768f3b1454 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:20.299688 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a977ca-e88f-46b1-b148-84768f3b1454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:20.299983 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a977ca-e88f-46b1-b148-84768f3b1454 admin admin] PATH_INFO: `/v3/users/18e85b718c5f49f8a4ac6d06681d6b75` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:20.301123 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 819/1638] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:21:20 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 20:21:20.301317 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a977ca-e88f-46b1-b148-84768f3b1454 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18e85b718c5f49f8a4ac6d06681d6b75)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:20.301832 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec926152-301e-4be7-97ca-45f191e6ba94 service cinder] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:20.302729 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: WARNING py.warnings [None req-a1a977ca-e88f-46b1-b148-84768f3b1454 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 20:21:20.302729 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: warnings.warn(msg) Jun 21 20:21:20.302729 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: Jun 21 20:21:20.303993 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a977ca-e88f-46b1-b148-84768f3b1454 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:20.320459 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec926152-301e-4be7-97ca-45f191e6ba94 service cinder] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:20.330769 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f1f4a-6bce-4caa-b6b6-80f0c66c303d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:20.331514 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f1f4a-6bce-4caa-b6b6-80f0c66c303d service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:20.331806 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f1f4a-6bce-4caa-b6b6-80f0c66c303d service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:20.332120 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f1f4a-6bce-4caa-b6b6-80f0c66c303d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:20.359903 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f1f4a-6bce-4caa-b6b6-80f0c66c303d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:20.362512 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f1f4a-6bce-4caa-b6b6-80f0c66c303d service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:20.389876 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 820/1639] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:21:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:21:20.402127 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a1a977ca-e88f-46b1-b148-84768f3b1454 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18e85b718c5f49f8a4ac6d06681d6b75'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:20.402856 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a1a977ca-e88f-46b1-b148-84768f3b1454 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18e85b718c5f49f8a4ac6d06681d6b75'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:20.403642 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a1a977ca-e88f-46b1-b148-84768f3b1454 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18e85b718c5f49f8a4ac6d06681d6b75'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:20.449118 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a1a977ca-e88f-46b1-b148-84768f3b1454 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18e85b718c5f49f8a4ac6d06681d6b75'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:20.464615 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a1a977ca-e88f-46b1-b148-84768f3b1454 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18e85b718c5f49f8a4ac6d06681d6b75'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:20.513181 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 820/1640] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:21:20 2022] DELETE /identity/v3/users/18e85b718c5f49f8a4ac6d06681d6b75 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:21:20.517622 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e406e-e1c4-4e24-a082-2fd56675285c None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:20.518205 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e406e-e1c4-4e24-a082-2fd56675285c None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:20.518697 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e406e-e1c4-4e24-a082-2fd56675285c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:20.539613 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-f80e406e-e1c4-4e24-a082-2fd56675285c None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:20.541210 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-f80e406e-e1c4-4e24-a082-2fd56675285c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:20.558412 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:21:20.652860 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 821/1641] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:21:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:20.864331 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a977ca-e88f-46b1-b148-84768f3b1454 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:20.865878 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a1a977ca-e88f-46b1-b148-84768f3b1454 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:21.007685 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a977ca-e88f-46b1-b148-84768f3b1454 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:21.011435 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c323f91-05a9-4be7-8ecf-b72a8543818a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:21.012313 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c323f91-05a9-4be7-8ecf-b72a8543818a service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:21.013138 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c323f91-05a9-4be7-8ecf-b72a8543818a service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:21.021995 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c323f91-05a9-4be7-8ecf-b72a8543818a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:21.034502 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c323f91-05a9-4be7-8ecf-b72a8543818a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:21.036110 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c323f91-05a9-4be7-8ecf-b72a8543818a service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:21.050181 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 821/1642] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:21:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:21:22.038861 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd12b9-4f9c-44bf-ad02-ded13bb3f833 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:22.039448 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd12b9-4f9c-44bf-ad02-ded13bb3f833 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:22.039448 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd12b9-4f9c-44bf-ad02-ded13bb3f833 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:22.041431 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 822/1643] 10.222.0.15 () {54 vars in 961 bytes} [Tue Jun 21 20:21:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:21:22.050876 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3910521-18aa-4e91-9fd1-1bfa3890080c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:22.051428 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3910521-18aa-4e91-9fd1-1bfa3890080c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:22.051428 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3910521-18aa-4e91-9fd1-1bfa3890080c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:22.096385 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-b3910521-18aa-4e91-9fd1-1bfa3890080c None None] MFA Rules not processed for user `3918fe05c8634bc39f3e295374701465`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:22.100932 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b3910521-18aa-4e91-9fd1-1bfa3890080c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:22.127344 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:21:22.267958 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 822/1644] 10.222.0.15 () {58 vars in 1058 bytes} [Tue Jun 21 20:21:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:22.268953 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7fd6e-2b25-4b19-80ce-445ed9d76c9e None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:22.269247 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7fd6e-2b25-4b19-80ce-445ed9d76c9e None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:22.269551 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7fd6e-2b25-4b19-80ce-445ed9d76c9e None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:22.271076 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 823/1645] 10.222.0.15 () {54 vars in 912 bytes} [Tue Jun 21 20:21:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:21:22.279391 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe3a40-5130-4c65-b447-e7102fb2b38d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:22.280090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe3a40-5130-4c65-b447-e7102fb2b38d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:22.280664 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe3a40-5130-4c65-b447-e7102fb2b38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:22.312664 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-4fbe3a40-5130-4c65-b447-e7102fb2b38d None None] MFA Rules not processed for user `3918fe05c8634bc39f3e295374701465`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:22.314340 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4fbe3a40-5130-4c65-b447-e7102fb2b38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:22.336415 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 823/1646] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jun 21 20:21:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:22.353923 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b7fd6e-2b25-4b19-80ce-445ed9d76c9e None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:22.355339 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-d8b7fd6e-2b25-4b19-80ce-445ed9d76c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:22.475574 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b7fd6e-2b25-4b19-80ce-445ed9d76c9e None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:22.487339 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec22619-27f4-4c6d-9733-83db310c9288 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:22.488062 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec22619-27f4-4c6d-9733-83db310c9288 service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:22.488368 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec22619-27f4-4c6d-9733-83db310c9288 service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:22.488817 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec22619-27f4-4c6d-9733-83db310c9288 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:22.506742 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec22619-27f4-4c6d-9733-83db310c9288 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:22.508254 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec22619-27f4-4c6d-9733-83db310c9288 service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:22.527843 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 824/1647] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:21:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:21:23.422054 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe3a40-5130-4c65-b447-e7102fb2b38d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:23.424731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4fbe3a40-5130-4c65-b447-e7102fb2b38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:23.448366 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe3a40-5130-4c65-b447-e7102fb2b38d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:23.456311 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b39586-1fca-4507-a733-bbf87b9b8dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:23.457628 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b39586-1fca-4507-a733-bbf87b9b8dde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:23.458081 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b39586-1fca-4507-a733-bbf87b9b8dde admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:23.458523 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b39586-1fca-4507-a733-bbf87b9b8dde admin admin] PATH_INFO: `/v3/projects/6c6f0565e8ce4ef9b175008162b48cf1` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:23.460156 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b39586-1fca-4507-a733-bbf87b9b8dde admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c6f0565e8ce4ef9b175008162b48cf1)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:23.462642 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b39586-1fca-4507-a733-bbf87b9b8dde admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:23.610681 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-62b39586-1fca-4507-a733-bbf87b9b8dde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c6f0565e8ce4ef9b175008162b48cf1', 'request_id': 'req-62b39586-1fca-4507-a733-bbf87b9b8dde'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:23.653938 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-62b39586-1fca-4507-a733-bbf87b9b8dde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c6f0565e8ce4ef9b175008162b48cf1', 'request_id': 'req-62b39586-1fca-4507-a733-bbf87b9b8dde'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:23.700143 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-62b39586-1fca-4507-a733-bbf87b9b8dde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c6f0565e8ce4ef9b175008162b48cf1', 'request_id': 'req-62b39586-1fca-4507-a733-bbf87b9b8dde'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:23.748767 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-62b39586-1fca-4507-a733-bbf87b9b8dde admin admin] The token cache is being invalidate because project 6c6f0565e8ce4ef9b175008162b48cf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:21:23.753222 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-62b39586-1fca-4507-a733-bbf87b9b8dde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:23.754473 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-62b39586-1fca-4507-a733-bbf87b9b8dde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:23.760162 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 824/1648] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:21:23 2022] DELETE /identity/v3/projects/6c6f0565e8ce4ef9b175008162b48cf1 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:21:23.764185 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec22619-27f4-4c6d-9733-83db310c9288 service cinder] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:23.788467 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec22619-27f4-4c6d-9733-83db310c9288 service cinder] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:23.962310 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233dc631-de7c-4d72-a88c-76e690cfd7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:23.965065 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233dc631-de7c-4d72-a88c-76e690cfd7aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:23.965794 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233dc631-de7c-4d72-a88c-76e690cfd7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:23.967167 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233dc631-de7c-4d72-a88c-76e690cfd7aa admin admin] PATH_INFO: `/v3/users/77f7c2f751ac4b31abb6df7d661f454d` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:24.017661 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233dc631-de7c-4d72-a88c-76e690cfd7aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=77f7c2f751ac4b31abb6df7d661f454d)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:24.017661 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233dc631-de7c-4d72-a88c-76e690cfd7aa admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:24.167645 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-233dc631-de7c-4d72-a88c-76e690cfd7aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77f7c2f751ac4b31abb6df7d661f454d'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:24.168684 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-233dc631-de7c-4d72-a88c-76e690cfd7aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77f7c2f751ac4b31abb6df7d661f454d'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:24.243667 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-233dc631-de7c-4d72-a88c-76e690cfd7aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77f7c2f751ac4b31abb6df7d661f454d'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:24.276964 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:21:24.301526 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-233dc631-de7c-4d72-a88c-76e690cfd7aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77f7c2f751ac4b31abb6df7d661f454d'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:24.303115 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-233dc631-de7c-4d72-a88c-76e690cfd7aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77f7c2f751ac4b31abb6df7d661f454d'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:24.340681 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 825/1649] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:21:23 2022] DELETE /identity/v3/users/77f7c2f751ac4b31abb6df7d661f454d => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:21:26.077876 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b39586-1fca-4507-a733-bbf87b9b8dde admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:26.080487 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-62b39586-1fca-4507-a733-bbf87b9b8dde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:26.119550 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b39586-1fca-4507-a733-bbf87b9b8dde admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:26.260852 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df7559d-b728-4832-bba3-008ab31c1eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:26.261799 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7559d-b728-4832-bba3-008ab31c1eed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:26.262085 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7559d-b728-4832-bba3-008ab31c1eed admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:26.262401 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7559d-b728-4832-bba3-008ab31c1eed admin admin] PATH_INFO: `/v3/projects/fe4bc97b43674dfab9ec4bd53aeabeb0` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:26.264381 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df7559d-b728-4832-bba3-008ab31c1eed admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe4bc97b43674dfab9ec4bd53aeabeb0)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:26.270719 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df7559d-b728-4832-bba3-008ab31c1eed admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:26.325571 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:21:26.376920 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8df7559d-b728-4832-bba3-008ab31c1eed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe4bc97b43674dfab9ec4bd53aeabeb0', 'request_id': 'req-8df7559d-b728-4832-bba3-008ab31c1eed'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:26.391950 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8df7559d-b728-4832-bba3-008ab31c1eed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe4bc97b43674dfab9ec4bd53aeabeb0', 'request_id': 'req-8df7559d-b728-4832-bba3-008ab31c1eed'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:26.403369 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8df7559d-b728-4832-bba3-008ab31c1eed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe4bc97b43674dfab9ec4bd53aeabeb0', 'request_id': 'req-8df7559d-b728-4832-bba3-008ab31c1eed'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:26.433108 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8df7559d-b728-4832-bba3-008ab31c1eed admin admin] The token cache is being invalidate because project fe4bc97b43674dfab9ec4bd53aeabeb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:21:26.433400 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8df7559d-b728-4832-bba3-008ab31c1eed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:26.434076 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8df7559d-b728-4832-bba3-008ab31c1eed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:26.436012 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 825/1650] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:21:26 2022] DELETE /identity/v3/projects/fe4bc97b43674dfab9ec4bd53aeabeb0 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:21:26.441191 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d45a7f2-11d7-4589-94ec-ed52f5f88700 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:26.441748 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d45a7f2-11d7-4589-94ec-ed52f5f88700 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:26.441748 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d45a7f2-11d7-4589-94ec-ed52f5f88700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:26.483365 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-0d45a7f2-11d7-4589-94ec-ed52f5f88700 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:26.484933 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-0d45a7f2-11d7-4589-94ec-ed52f5f88700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:26.662318 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 826/1651] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:21:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:26.671750 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98dd9c-7073-43f6-930e-63cd53e27c70 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:26.674454 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98dd9c-7073-43f6-930e-63cd53e27c70 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:26.674884 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98dd9c-7073-43f6-930e-63cd53e27c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:26.710888 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-6c98dd9c-7073-43f6-930e-63cd53e27c70 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:26.712314 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6c98dd9c-7073-43f6-930e-63cd53e27c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:26.738347 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 826/1652] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:21:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:26.742589 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d45a7f2-11d7-4589-94ec-ed52f5f88700 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:26.764346 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d45a7f2-11d7-4589-94ec-ed52f5f88700 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:26.778156 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aef469-692a-4eae-b743-d174a2d8619b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:26.779028 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aef469-692a-4eae-b743-d174a2d8619b admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:26.782409 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aef469-692a-4eae-b743-d174a2d8619b admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:26.783125 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aef469-692a-4eae-b743-d174a2d8619b admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:26.783851 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aef469-692a-4eae-b743-d174a2d8619b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:21:26.784300 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aef469-692a-4eae-b743-d174a2d8619b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:26.787909 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aef469-692a-4eae-b743-d174a2d8619b admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:26.826688 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 827/1653] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:21:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:21:26.828021 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c98dd9c-7073-43f6-930e-63cd53e27c70 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:26.842358 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c98dd9c-7073-43f6-930e-63cd53e27c70 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:26.860907 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213920ef-66a0-4b8f-ac82-ee4f0946117a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:26.861610 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213920ef-66a0-4b8f-ac82-ee4f0946117a admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:26.861895 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213920ef-66a0-4b8f-ac82-ee4f0946117a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:26.862176 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213920ef-66a0-4b8f-ac82-ee4f0946117a admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:26.862883 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213920ef-66a0-4b8f-ac82-ee4f0946117a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:26.876066 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213920ef-66a0-4b8f-ac82-ee4f0946117a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:26.999963 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aef469-692a-4eae-b743-d174a2d8619b admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:27.005021 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 827/1654] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:21:26 2022] POST /identity/v3/projects => generated 355 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:21:27.013297 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aef469-692a-4eae-b743-d174a2d8619b admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:27.156145 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824cfa8-473b-4997-bb29-c6470c427092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:27.156847 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824cfa8-473b-4997-bb29-c6470c427092 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:27.157133 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824cfa8-473b-4997-bb29-c6470c427092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:27.157410 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824cfa8-473b-4997-bb29-c6470c427092 admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:27.158111 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3824cfa8-473b-4997-bb29-c6470c427092 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:27.160093 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3824cfa8-473b-4997-bb29-c6470c427092 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:27.207289 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213920ef-66a0-4b8f-ac82-ee4f0946117a admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:27.208388 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 828/1655] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:21:26 2022] POST /identity/v3/users => generated 278 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 20:21:27.231935 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213920ef-66a0-4b8f-ac82-ee4f0946117a admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:27.250802 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc0b99-fa1f-45f8-9876-8d9cdd6058ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:27.251754 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc0b99-fa1f-45f8-9876-8d9cdd6058ff admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:27.252270 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc0b99-fa1f-45f8-9876-8d9cdd6058ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:27.252534 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc0b99-fa1f-45f8-9876-8d9cdd6058ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:27.254244 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cc0b99-fa1f-45f8-9876-8d9cdd6058ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:27.257309 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cc0b99-fa1f-45f8-9876-8d9cdd6058ff admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:27.285633 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 828/1656] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:21:27.289303 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824cfa8-473b-4997-bb29-c6470c427092 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:27.306376 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824cfa8-473b-4997-bb29-c6470c427092 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:27.315778 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6510874d-94f5-4cbf-b3ca-5d1df6517dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:27.316535 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510874d-94f5-4cbf-b3ca-5d1df6517dfb admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:27.316820 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510874d-94f5-4cbf-b3ca-5d1df6517dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:27.317121 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510874d-94f5-4cbf-b3ca-5d1df6517dfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:27.317912 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6510874d-94f5-4cbf-b3ca-5d1df6517dfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:27.319466 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6510874d-94f5-4cbf-b3ca-5d1df6517dfb admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:27.350839 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc0b99-fa1f-45f8-9876-8d9cdd6058ff admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:27.356982 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 829/1657] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:21:27.362247 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc0b99-fa1f-45f8-9876-8d9cdd6058ff admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:27.370412 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cab40a-cc42-40e6-9c2a-80a28ef71c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:27.371554 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cab40a-cc42-40e6-9c2a-80a28ef71c44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:27.372071 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cab40a-cc42-40e6-9c2a-80a28ef71c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:27.372484 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cab40a-cc42-40e6-9c2a-80a28ef71c44 admin admin] PATH_INFO: `/v3/projects/9820f35649e2407699ca11ce07e92e77/users/bb2cec1d576043028e3be2e518440b12/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:27.397745 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cab40a-cc42-40e6-9c2a-80a28ef71c44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9820f35649e2407699ca11ce07e92e77, user_id=bb2cec1d576043028e3be2e518440b12, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:27.401605 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cab40a-cc42-40e6-9c2a-80a28ef71c44 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:27.464734 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6996e4-3805-4e07-be8d-79d1511a1e69 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:27.465569 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6996e4-3805-4e07-be8d-79d1511a1e69 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:27.465855 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6996e4-3805-4e07-be8d-79d1511a1e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:27.467537 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 829/1658] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:21:27 2022] PUT /identity/v3/projects/9820f35649e2407699ca11ce07e92e77/users/bb2cec1d576043028e3be2e518440b12/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:21:27.533445 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-ad6996e4-3805-4e07-be8d-79d1511a1e69 None None] MFA Rules not processed for user `bb2cec1d576043028e3be2e518440b12`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:27.534833 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-ad6996e4-3805-4e07-be8d-79d1511a1e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:27.642729 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:21:27.723839 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cab40a-cc42-40e6-9c2a-80a28ef71c44 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:27.726073 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 830/1659] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:21:27 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:27.906560 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cab40a-cc42-40e6-9c2a-80a28ef71c44 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:27.922185 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1482f41-73fe-4fc6-969d-7bcdd19ed3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:27.922696 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1482f41-73fe-4fc6-969d-7bcdd19ed3d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:27.923363 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1482f41-73fe-4fc6-969d-7bcdd19ed3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:27.923363 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1482f41-73fe-4fc6-969d-7bcdd19ed3d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:27.923966 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1482f41-73fe-4fc6-969d-7bcdd19ed3d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:27.925907 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1482f41-73fe-4fc6-969d-7bcdd19ed3d6 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:27.994483 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 830/1660] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:21:27 2022] POST /identity/v3/projects => generated 355 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:21:27.998482 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6996e4-3805-4e07-be8d-79d1511a1e69 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:28.016491 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6996e4-3805-4e07-be8d-79d1511a1e69 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:28.168791 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735578c6-c698-4012-bf42-35926e921781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:28.170170 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735578c6-c698-4012-bf42-35926e921781 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:28.170741 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735578c6-c698-4012-bf42-35926e921781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:28.171781 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735578c6-c698-4012-bf42-35926e921781 admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:28.172771 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735578c6-c698-4012-bf42-35926e921781 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:28.174994 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735578c6-c698-4012-bf42-35926e921781 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:28.223958 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 831/1661] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:21:27 2022] POST /identity/v3/users => generated 284 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:21:28.228016 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1482f41-73fe-4fc6-969d-7bcdd19ed3d6 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:28.246925 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1482f41-73fe-4fc6-969d-7bcdd19ed3d6 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:28.257993 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb922a-5130-4b9c-bca0-1ca477f67d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:28.259475 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb922a-5130-4b9c-bca0-1ca477f67d83 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:28.260810 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb922a-5130-4b9c-bca0-1ca477f67d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:28.261826 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb922a-5130-4b9c-bca0-1ca477f67d83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:28.264011 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cb922a-5130-4b9c-bca0-1ca477f67d83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:28.267438 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cb922a-5130-4b9c-bca0-1ca477f67d83 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:28.288081 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 831/1662] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:21:28.292353 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735578c6-c698-4012-bf42-35926e921781 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:28.316324 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735578c6-c698-4012-bf42-35926e921781 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:28.335249 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd88c3dd-f98e-4a18-ac6c-a0a7f77a995d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:28.337773 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88c3dd-f98e-4a18-ac6c-a0a7f77a995d admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:28.339676 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88c3dd-f98e-4a18-ac6c-a0a7f77a995d admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:28.343623 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88c3dd-f98e-4a18-ac6c-a0a7f77a995d admin admin] PATH_INFO: `/v3/projects/c13d826458b94de4801f661175191b1b/users/89dff951a2694878ab49b0ec6c1ed6dd/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:28.402571 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd88c3dd-f98e-4a18-ac6c-a0a7f77a995d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c13d826458b94de4801f661175191b1b, user_id=89dff951a2694878ab49b0ec6c1ed6dd, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:28.412038 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd88c3dd-f98e-4a18-ac6c-a0a7f77a995d admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:28.463827 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 832/1663] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:21:28 2022] PUT /identity/v3/projects/c13d826458b94de4801f661175191b1b/users/89dff951a2694878ab49b0ec6c1ed6dd/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:21:28.465518 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb922a-5130-4b9c-bca0-1ca477f67d83 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:28.479839 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb922a-5130-4b9c-bca0-1ca477f67d83 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:28.532365 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:21:28.613792 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d802b81c-093e-4e7a-b649-30c347ee1cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:28.614650 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802b81c-093e-4e7a-b649-30c347ee1cb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:28.615116 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802b81c-093e-4e7a-b649-30c347ee1cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:28.621110 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802b81c-093e-4e7a-b649-30c347ee1cb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:28.622354 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d802b81c-093e-4e7a-b649-30c347ee1cb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:28.627560 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d802b81c-093e-4e7a-b649-30c347ee1cb0 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:28.651258 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 832/1664] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:21:28.655176 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd88c3dd-f98e-4a18-ac6c-a0a7f77a995d admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:28.672801 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd88c3dd-f98e-4a18-ac6c-a0a7f77a995d admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:28.688814 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd504ac-61ae-4d1d-8eaf-99540c4945ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:28.690177 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd504ac-61ae-4d1d-8eaf-99540c4945ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:28.690932 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd504ac-61ae-4d1d-8eaf-99540c4945ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:28.691375 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd504ac-61ae-4d1d-8eaf-99540c4945ec admin admin] PATH_INFO: `/v3/projects/c13d826458b94de4801f661175191b1b/users/89dff951a2694878ab49b0ec6c1ed6dd/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:28.695262 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd504ac-61ae-4d1d-8eaf-99540c4945ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=c13d826458b94de4801f661175191b1b, user_id=89dff951a2694878ab49b0ec6c1ed6dd, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:28.699467 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd504ac-61ae-4d1d-8eaf-99540c4945ec admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:28.718610 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 833/1665] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:21:28 2022] PUT /identity/v3/projects/c13d826458b94de4801f661175191b1b/users/89dff951a2694878ab49b0ec6c1ed6dd/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:21:28.729814 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c6d8a-fe9d-4922-bb23-cdeee3a23676 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:28.730393 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c6d8a-fe9d-4922-bb23-cdeee3a23676 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:28.730846 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c6d8a-fe9d-4922-bb23-cdeee3a23676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:28.780215 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-1a5c6d8a-fe9d-4922-bb23-cdeee3a23676 None None] MFA Rules not processed for user `89dff951a2694878ab49b0ec6c1ed6dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:28.782143 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1a5c6d8a-fe9d-4922-bb23-cdeee3a23676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:29.008234 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 833/1666] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:21:28 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:29.009251 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd504ac-61ae-4d1d-8eaf-99540c4945ec admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:29.015654 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-6bd504ac-61ae-4d1d-8eaf-99540c4945ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:29.257693 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd504ac-61ae-4d1d-8eaf-99540c4945ec admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:29.272479 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cef133-c5fd-4c5a-9855-2deb7830c093 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:29.273432 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cef133-c5fd-4c5a-9855-2deb7830c093 service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:29.273925 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cef133-c5fd-4c5a-9855-2deb7830c093 service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:29.274470 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cef133-c5fd-4c5a-9855-2deb7830c093 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:29.314786 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cef133-c5fd-4c5a-9855-2deb7830c093 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:29.316529 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cef133-c5fd-4c5a-9855-2deb7830c093 service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:29.346505 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 834/1667] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:21:29 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:21:29.486742 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c6d8a-fe9d-4922-bb23-cdeee3a23676 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:29.502911 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c6d8a-fe9d-4922-bb23-cdeee3a23676 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:29.511420 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8284b3cd-8798-4037-b7fa-72e801b4e8a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:29.518136 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284b3cd-8798-4037-b7fa-72e801b4e8a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:29.518827 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284b3cd-8798-4037-b7fa-72e801b4e8a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:29.519708 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284b3cd-8798-4037-b7fa-72e801b4e8a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:29.622919 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8284b3cd-8798-4037-b7fa-72e801b4e8a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:29.627705 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8284b3cd-8798-4037-b7fa-72e801b4e8a0 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:29.652861 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 834/1668] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:21:29 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:21:30.472389 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286dd57-4bb1-4704-bdb9-400eb63e4295 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:30.473320 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286dd57-4bb1-4704-bdb9-400eb63e4295 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:30.473875 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286dd57-4bb1-4704-bdb9-400eb63e4295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:30.548089 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-b286dd57-4bb1-4704-bdb9-400eb63e4295 None None] MFA Rules not processed for user `4f3b5970d9534441a2d208633b2e9942`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:30.549316 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-b286dd57-4bb1-4704-bdb9-400eb63e4295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:30.583513 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:21:30.643070 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 835/1669] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:21:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:30.658921 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8284b3cd-8798-4037-b7fa-72e801b4e8a0 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:30.661628 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8284b3cd-8798-4037-b7fa-72e801b4e8a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:30.758896 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:21:30.801890 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8284b3cd-8798-4037-b7fa-72e801b4e8a0 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:30.808161 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb5c50-72a5-4a27-a2c7-58a881b4620c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3918fe05c8634bc39f3e295374701465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:30.808853 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb5c50-72a5-4a27-a2c7-58a881b4620c service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:30.809139 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb5c50-72a5-4a27-a2c7-58a881b4620c service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:30.809419 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb5c50-72a5-4a27-a2c7-58a881b4620c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:30.820023 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feb5c50-72a5-4a27-a2c7-58a881b4620c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:30.821933 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feb5c50-72a5-4a27-a2c7-58a881b4620c service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:30.847155 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 835/1670] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:21:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:21:32.002596 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882bbfa-2306-4ede-81a5-e19339abe480 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:32.003083 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882bbfa-2306-4ede-81a5-e19339abe480 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:32.003083 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882bbfa-2306-4ede-81a5-e19339abe480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:32.057169 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-7882bbfa-2306-4ede-81a5-e19339abe480 None None] MFA Rules not processed for user `4080825b9e154e808a9418fa8d6db987`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:32.058417 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-7882bbfa-2306-4ede-81a5-e19339abe480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:32.239649 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 836/1671] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:21:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:32.246162 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb5c50-72a5-4a27-a2c7-58a881b4620c service nova] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:32.263171 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb5c50-72a5-4a27-a2c7-58a881b4620c service nova] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:32.282213 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999a19e-6de4-4bd7-8546-cd68a7554ad4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3918fe05c8634bc39f3e295374701465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:32.283076 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999a19e-6de4-4bd7-8546-cd68a7554ad4 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:32.283511 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999a19e-6de4-4bd7-8546-cd68a7554ad4 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:32.283953 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999a19e-6de4-4bd7-8546-cd68a7554ad4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:32.295968 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7999a19e-6de4-4bd7-8546-cd68a7554ad4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:32.301091 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7999a19e-6de4-4bd7-8546-cd68a7554ad4 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:32.325284 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 836/1672] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:21:32 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:21:35.055416 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33962c-72e5-42a3-b71b-1601974713f9 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:35.056835 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33962c-72e5-42a3-b71b-1601974713f9 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:35.057270 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33962c-72e5-42a3-b71b-1601974713f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:35.130022 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-3b33962c-72e5-42a3-b71b-1601974713f9 None None] MFA Rules not processed for user `fc95af68a6d640699f788d5438cae607`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:35.132025 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-3b33962c-72e5-42a3-b71b-1601974713f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:35.250030 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 837/1673] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:21:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:35.264453 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999a19e-6de4-4bd7-8546-cd68a7554ad4 service nova] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:35.300414 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999a19e-6de4-4bd7-8546-cd68a7554ad4 service nova] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:35.307663 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81007ede-62ea-4a75-a2a4-737abac3be41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3918fe05c8634bc39f3e295374701465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:35.308688 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81007ede-62ea-4a75-a2a4-737abac3be41 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:35.308976 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81007ede-62ea-4a75-a2a4-737abac3be41 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:35.309414 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81007ede-62ea-4a75-a2a4-737abac3be41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:35.355137 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81007ede-62ea-4a75-a2a4-737abac3be41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:35.358974 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81007ede-62ea-4a75-a2a4-737abac3be41 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:35.387998 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 837/1674] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:21:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:21:35.862474 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce29ef-5907-4153-b63f-374c0994ba12 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:35.866090 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce29ef-5907-4153-b63f-374c0994ba12 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:35.866626 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce29ef-5907-4153-b63f-374c0994ba12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:35.927931 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-21ce29ef-5907-4153-b63f-374c0994ba12 None None] MFA Rules not processed for user `4f3b5970d9534441a2d208633b2e9942`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:35.931537 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-21ce29ef-5907-4153-b63f-374c0994ba12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:35.971424 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 838/1675] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:21:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:37.266924 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379eb6fb-5621-4d20-b320-23b3d185d2b1 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:37.268503 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379eb6fb-5621-4d20-b320-23b3d185d2b1 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:37.269110 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379eb6fb-5621-4d20-b320-23b3d185d2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:37.376540 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-379eb6fb-5621-4d20-b320-23b3d185d2b1 None None] MFA Rules not processed for user `e41fb552c794495fa27a1ff74768b9d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:37.378456 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-379eb6fb-5621-4d20-b320-23b3d185d2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:37.585401 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb6f24-f308-4811-ba6d-63f8259accb8 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:37.585973 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb6f24-f308-4811-ba6d-63f8259accb8 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:37.586196 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb6f24-f308-4811-ba6d-63f8259accb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:37.604931 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 838/1676] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:21:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:37.617673 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcf079-445e-4342-ae9a-9084c9cf4a5e None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:37.618353 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcf079-445e-4342-ae9a-9084c9cf4a5e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:37.619077 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcf079-445e-4342-ae9a-9084c9cf4a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:37.656035 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f3dcf079-445e-4342-ae9a-9084c9cf4a5e None None] MFA Rules not processed for user `e41fb552c794495fa27a1ff74768b9d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:37.659160 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f3dcf079-445e-4342-ae9a-9084c9cf4a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:37.678000 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 839/1677] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:21:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:37.686647 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-3cfb6f24-f308-4811-ba6d-63f8259accb8 None None] MFA Rules not processed for user `3fd51eea10924c9eb901382510d485a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:37.696822 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-3cfb6f24-f308-4811-ba6d-63f8259accb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:37.764949 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:21:37.789857 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dcf079-445e-4342-ae9a-9084c9cf4a5e None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:37.793288 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f3dcf079-445e-4342-ae9a-9084c9cf4a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:37.950963 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 839/1678] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:21:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:37.952790 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb6f24-f308-4811-ba6d-63f8259accb8 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:37.985008 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb6f24-f308-4811-ba6d-63f8259accb8 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:37.992998 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926d5a5-a1c6-4885-83fa-311a9bf0fcef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3918fe05c8634bc39f3e295374701465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:37.994261 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926d5a5-a1c6-4885-83fa-311a9bf0fcef service nova] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:37.994870 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926d5a5-a1c6-4885-83fa-311a9bf0fcef service nova] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:37.995324 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926d5a5-a1c6-4885-83fa-311a9bf0fcef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:38.009439 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7926d5a5-a1c6-4885-83fa-311a9bf0fcef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:38.011650 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7926d5a5-a1c6-4885-83fa-311a9bf0fcef service nova] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:38.028877 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 840/1679] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:21:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:21:38.031122 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78965eae-d352-4957-9e64-40ad2193d397 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:38.031663 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78965eae-d352-4957-9e64-40ad2193d397 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:38.032477 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78965eae-d352-4957-9e64-40ad2193d397 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:38.034215 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 841/1680] 10.222.0.15 () {54 vars in 912 bytes} [Tue Jun 21 20:21:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:21:38.035978 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6489553-7fdc-4959-a7dc-d4a3efdf8c72 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:38.036660 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6489553-7fdc-4959-a7dc-d4a3efdf8c72 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:38.037155 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6489553-7fdc-4959-a7dc-d4a3efdf8c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:38.068543 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-c6489553-7fdc-4959-a7dc-d4a3efdf8c72 None None] MFA Rules not processed for user `3fd51eea10924c9eb901382510d485a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:38.071598 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-c6489553-7fdc-4959-a7dc-d4a3efdf8c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:38.088128 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 842/1681] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:21:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:38.091526 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8aa85d-0c27-41b5-9755-316e802182e6 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:38.092958 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8aa85d-0c27-41b5-9755-316e802182e6 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:38.094366 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8aa85d-0c27-41b5-9755-316e802182e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:38.159220 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dcf079-445e-4342-ae9a-9084c9cf4a5e None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:38.197177 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-cc8aa85d-0c27-41b5-9755-316e802182e6 None None] MFA Rules not processed for user `1b01b53897d64bbaac6efb6f13d413a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:38.198380 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e9e9e-722a-4d60-9c6a-5f180e2af226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:38.198622 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-cc8aa85d-0c27-41b5-9755-316e802182e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:38.199701 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e9e9e-722a-4d60-9c6a-5f180e2af226 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:38.202611 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e9e9e-722a-4d60-9c6a-5f180e2af226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:38.204199 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e9e9e-722a-4d60-9c6a-5f180e2af226 admin admin] PATH_INFO: `/v3/users/482db0f325464de78d099376d5c7df00` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:38.213717 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269e9e9e-722a-4d60-9c6a-5f180e2af226 admin admin] RBAC: Authorizing `identity:delete_user(user_id=482db0f325464de78d099376d5c7df00)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:38.215952 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269e9e9e-722a-4d60-9c6a-5f180e2af226 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:38.308840 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:21:38.367043 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 843/1682] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jun 21 20:21:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:38.377946 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-269e9e9e-722a-4d60-9c6a-5f180e2af226 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '482db0f325464de78d099376d5c7df00'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:38.380682 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-269e9e9e-722a-4d60-9c6a-5f180e2af226 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '482db0f325464de78d099376d5c7df00'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:38.381534 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-269e9e9e-722a-4d60-9c6a-5f180e2af226 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '482db0f325464de78d099376d5c7df00'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:38.425928 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-269e9e9e-722a-4d60-9c6a-5f180e2af226 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '482db0f325464de78d099376d5c7df00'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:38.449478 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-269e9e9e-722a-4d60-9c6a-5f180e2af226 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '482db0f325464de78d099376d5c7df00'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:38.473352 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 840/1683] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:21:37 2022] DELETE /identity/v3/users/482db0f325464de78d099376d5c7df00 => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:21:38.478031 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f95bb-d9cf-4814-9e15-e172fba25af2 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:38.478655 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f95bb-d9cf-4814-9e15-e172fba25af2 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:38.479149 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f95bb-d9cf-4814-9e15-e172fba25af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:38.506519 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-810f95bb-d9cf-4814-9e15-e172fba25af2 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:38.508619 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-810f95bb-d9cf-4814-9e15-e172fba25af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:38.629457 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e9e9e-722a-4d60-9c6a-5f180e2af226 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:38.631487 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-269e9e9e-722a-4d60-9c6a-5f180e2af226 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:38.688124 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 844/1684] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:21:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:38.722344 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f95bb-d9cf-4814-9e15-e172fba25af2 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:38.726117 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-810f95bb-d9cf-4814-9e15-e172fba25af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:38.790489 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e9e9e-722a-4d60-9c6a-5f180e2af226 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:38.829818 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1bfa3-5bec-42ac-85e3-a2382ae3a32c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:38.832694 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1bfa3-5bec-42ac-85e3-a2382ae3a32c service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:38.833243 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1bfa3-5bec-42ac-85e3-a2382ae3a32c service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:38.834731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1bfa3-5bec-42ac-85e3-a2382ae3a32c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:38.841589 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f2d1bfa3-5bec-42ac-85e3-a2382ae3a32c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:38.878132 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:21:38.901115 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d1bfa3-5bec-42ac-85e3-a2382ae3a32c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:38.906598 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f95bb-d9cf-4814-9e15-e172fba25af2 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:38.911529 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d1bfa3-5bec-42ac-85e3-a2382ae3a32c service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:38.915167 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb57c3-99d0-4bcb-9d33-21243f30f052 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:38.916276 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb57c3-99d0-4bcb-9d33-21243f30f052 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:38.918024 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb57c3-99d0-4bcb-9d33-21243f30f052 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:38.918474 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb57c3-99d0-4bcb-9d33-21243f30f052 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:38.968948 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 841/1685] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:21:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:21:38.976920 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb57c3-99d0-4bcb-9d33-21243f30f052 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:38.978710 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb57c3-99d0-4bcb-9d33-21243f30f052 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:39.032007 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 845/1686] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:21:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:21:39.171565 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21fc7bf-74d6-485c-bdca-d23ccbf55006 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:39.171900 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21fc7bf-74d6-485c-bdca-d23ccbf55006 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:39.172355 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21fc7bf-74d6-485c-bdca-d23ccbf55006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:39.206735 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f21fc7bf-74d6-485c-bdca-d23ccbf55006 None None] MFA Rules not processed for user `4080825b9e154e808a9418fa8d6db987`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:39.207973 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f21fc7bf-74d6-485c-bdca-d23ccbf55006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:39.255706 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c60dc7-bc33-49be-bf80-166f63148f63 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:39.256015 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c60dc7-bc33-49be-bf80-166f63148f63 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:39.256307 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c60dc7-bc33-49be-bf80-166f63148f63 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:39.257990 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 846/1687] 10.222.0.15 () {54 vars in 912 bytes} [Tue Jun 21 20:21:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:21:39.269884 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c8282-c0ba-478d-8da8-994216d99ebd None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:39.270147 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c8282-c0ba-478d-8da8-994216d99ebd None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:39.270431 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c8282-c0ba-478d-8da8-994216d99ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:39.301091 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-557c8282-c0ba-478d-8da8-994216d99ebd None None] MFA Rules not processed for user `1b01b53897d64bbaac6efb6f13d413a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:39.302318 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-557c8282-c0ba-478d-8da8-994216d99ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:39.332631 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 847/1688] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jun 21 20:21:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 20:21:39.351604 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 842/1689] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:21:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:39.372415 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c8282-c0ba-478d-8da8-994216d99ebd None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:39.385763 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c8282-c0ba-478d-8da8-994216d99ebd None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:39.394869 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7c6c3-c3c4-4ccb-bbda-0d7c0f1f119b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:39.396171 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7c6c3-c3c4-4ccb-bbda-0d7c0f1f119b service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:39.396694 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7c6c3-c3c4-4ccb-bbda-0d7c0f1f119b service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:39.397185 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7c6c3-c3c4-4ccb-bbda-0d7c0f1f119b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:39.408238 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a7c6c3-c3c4-4ccb-bbda-0d7c0f1f119b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:39.410139 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a7c6c3-c3c4-4ccb-bbda-0d7c0f1f119b service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:39.427302 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 848/1690] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:21:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:21:39.781324 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21fc7bf-74d6-485c-bdca-d23ccbf55006 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:39.782826 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f21fc7bf-74d6-485c-bdca-d23ccbf55006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:39.863243 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea99573e-eb0e-47d3-b305-f6b9501fd09b None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:39.863734 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea99573e-eb0e-47d3-b305-f6b9501fd09b None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:39.864422 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea99573e-eb0e-47d3-b305-f6b9501fd09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:39.897136 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-ea99573e-eb0e-47d3-b305-f6b9501fd09b None None] MFA Rules not processed for user `fc95af68a6d640699f788d5438cae607`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:39.900808 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-ea99573e-eb0e-47d3-b305-f6b9501fd09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:39.919474 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:21:39.951243 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21fc7bf-74d6-485c-bdca-d23ccbf55006 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:39.959153 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48dbe11-c247-4290-868b-9a6fc133aef6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3918fe05c8634bc39f3e295374701465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:39.960284 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48dbe11-c247-4290-868b-9a6fc133aef6 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:39.960758 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48dbe11-c247-4290-868b-9a6fc133aef6 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:39.961542 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48dbe11-c247-4290-868b-9a6fc133aef6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:39.963731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f48dbe11-c247-4290-868b-9a6fc133aef6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:40.065494 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48dbe11-c247-4290-868b-9a6fc133aef6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:40.067855 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48dbe11-c247-4290-868b-9a6fc133aef6 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:40.080082 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 843/1691] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:21:39 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:21:40.081433 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f7dc1-d298-49fc-9247-6bfd806cd08e None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:40.081789 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f7dc1-d298-49fc-9247-6bfd806cd08e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:40.082074 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f7dc1-d298-49fc-9247-6bfd806cd08e None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:40.085521 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 849/1692] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:21:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:40.088421 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 844/1693] 10.222.0.15 () {54 vars in 960 bytes} [Tue Jun 21 20:21:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:21:40.089979 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df65b52-83fb-4153-bcc4-61cd540567c6 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:40.090276 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df65b52-83fb-4153-bcc4-61cd540567c6 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:40.090561 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df65b52-83fb-4153-bcc4-61cd540567c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:40.131027 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-3df65b52-83fb-4153-bcc4-61cd540567c6 None None] MFA Rules not processed for user `a59294bff27c4b3f8aaeeab48ed35a0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:40.134820 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-3df65b52-83fb-4153-bcc4-61cd540567c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:40.171101 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f7dc1-d298-49fc-9247-6bfd806cd08e None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:40.176502 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f57f7dc1-d298-49fc-9247-6bfd806cd08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:40.252345 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f7dc1-d298-49fc-9247-6bfd806cd08e None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:40.264784 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76491111-1494-40e6-b579-eb990ff63d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:40.270454 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76491111-1494-40e6-b579-eb990ff63d15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:40.272343 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76491111-1494-40e6-b579-eb990ff63d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:40.272651 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76491111-1494-40e6-b579-eb990ff63d15 admin admin] PATH_INFO: `/v3/projects/f64603ea8f8b4308b338915836e05ac3` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:40.275170 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76491111-1494-40e6-b579-eb990ff63d15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f64603ea8f8b4308b338915836e05ac3)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:40.289372 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76491111-1494-40e6-b579-eb990ff63d15 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:40.377260 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 850/1694] 10.222.0.15 () {58 vars in 1057 bytes} [Tue Jun 21 20:21:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:40.378279 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df65b52-83fb-4153-bcc4-61cd540567c6 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:40.380215 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-3df65b52-83fb-4153-bcc4-61cd540567c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:40.421625 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-76491111-1494-40e6-b579-eb990ff63d15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f64603ea8f8b4308b338915836e05ac3', 'request_id': 'req-76491111-1494-40e6-b579-eb990ff63d15'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:40.422213 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df65b52-83fb-4153-bcc4-61cd540567c6 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:40.443872 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-76491111-1494-40e6-b579-eb990ff63d15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f64603ea8f8b4308b338915836e05ac3', 'request_id': 'req-76491111-1494-40e6-b579-eb990ff63d15'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:40.457158 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-76491111-1494-40e6-b579-eb990ff63d15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f64603ea8f8b4308b338915836e05ac3', 'request_id': 'req-76491111-1494-40e6-b579-eb990ff63d15'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:40.476493 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-76491111-1494-40e6-b579-eb990ff63d15 admin admin] The token cache is being invalidate because project f64603ea8f8b4308b338915836e05ac3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:21:40.476789 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-76491111-1494-40e6-b579-eb990ff63d15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:40.477550 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-76491111-1494-40e6-b579-eb990ff63d15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:40.484284 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 845/1695] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:21:40 2022] DELETE /identity/v3/projects/f64603ea8f8b4308b338915836e05ac3 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:21:40.485348 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76491111-1494-40e6-b579-eb990ff63d15 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:40.486865 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-76491111-1494-40e6-b579-eb990ff63d15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:40.583302 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9068bf-0e53-46f2-a9c0-ef9246de755e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59294bff27c4b3f8aaeeab48ed35a0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:40.584080 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9068bf-0e53-46f2-a9c0-ef9246de755e service placement] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:40.584381 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9068bf-0e53-46f2-a9c0-ef9246de755e service placement] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:40.584665 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9068bf-0e53-46f2-a9c0-ef9246de755e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:40.587476 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-ec9068bf-0e53-46f2-a9c0-ef9246de755e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:40.604493 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:21:40.607544 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9068bf-0e53-46f2-a9c0-ef9246de755e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:40.611222 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9068bf-0e53-46f2-a9c0-ef9246de755e service placement] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:40.643880 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 851/1696] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:21:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:21:40.659396 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f79be6-54be-4b4c-afdf-8ccbc7314be6 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:40.662243 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f79be6-54be-4b4c-afdf-8ccbc7314be6 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:40.662672 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f79be6-54be-4b4c-afdf-8ccbc7314be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:40.699881 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76491111-1494-40e6-b579-eb990ff63d15 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:40.707753 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970e54b-db09-497c-9b75-fe255dc1112d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59294bff27c4b3f8aaeeab48ed35a0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:40.708744 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970e54b-db09-497c-9b75-fe255dc1112d service placement] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:40.710156 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970e54b-db09-497c-9b75-fe255dc1112d service placement] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:40.710885 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970e54b-db09-497c-9b75-fe255dc1112d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:40.713395 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-54f79be6-54be-4b4c-afdf-8ccbc7314be6 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:40.714967 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-54f79be6-54be-4b4c-afdf-8ccbc7314be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:40.730566 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3970e54b-db09-497c-9b75-fe255dc1112d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:40.733250 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3970e54b-db09-497c-9b75-fe255dc1112d service placement] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:40.743126 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:21:40.754738 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 846/1697] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:21:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:21:40.804726 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 852/1698] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:21:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:40.816303 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a03913-dd6d-46e7-a7a1-d04d8caacd0f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:40.816606 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a03913-dd6d-46e7-a7a1-d04d8caacd0f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:40.816895 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a03913-dd6d-46e7-a7a1-d04d8caacd0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:40.865533 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-16a03913-dd6d-46e7-a7a1-d04d8caacd0f None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:40.866890 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-16a03913-dd6d-46e7-a7a1-d04d8caacd0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:40.905085 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 847/1699] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:21:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:40.908336 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f79be6-54be-4b4c-afdf-8ccbc7314be6 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:40.923946 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f79be6-54be-4b4c-afdf-8ccbc7314be6 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:40.930701 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0528257e-d4f5-4ce1-b2a2-c8dce462ea24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:40.932016 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528257e-d4f5-4ce1-b2a2-c8dce462ea24 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:40.932016 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528257e-d4f5-4ce1-b2a2-c8dce462ea24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:40.932016 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528257e-d4f5-4ce1-b2a2-c8dce462ea24 admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:40.932810 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0528257e-d4f5-4ce1-b2a2-c8dce462ea24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:21:40.933139 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0528257e-d4f5-4ce1-b2a2-c8dce462ea24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:40.934773 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0528257e-d4f5-4ce1-b2a2-c8dce462ea24 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:40.957523 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 853/1700] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:21:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:21:40.958994 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a03913-dd6d-46e7-a7a1-d04d8caacd0f None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:41.000164 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a03913-dd6d-46e7-a7a1-d04d8caacd0f None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:41.011152 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6b13c9-d6db-44e7-bac7-c246868504ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:41.011634 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b13c9-d6db-44e7-bac7-c246868504ca admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:41.012161 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b13c9-d6db-44e7-bac7-c246868504ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:41.012870 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b13c9-d6db-44e7-bac7-c246868504ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:41.014760 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6b13c9-d6db-44e7-bac7-c246868504ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:41.020441 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6b13c9-d6db-44e7-bac7-c246868504ca admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:41.080714 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 848/1701] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:21:40 2022] POST /identity/v3/projects => generated 373 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:21:41.084805 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0528257e-d4f5-4ce1-b2a2-c8dce462ea24 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:41.104647 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0528257e-d4f5-4ce1-b2a2-c8dce462ea24 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:41.219451 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb634d1b-733f-465e-ba11-c0dcad6450a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:41.220963 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb634d1b-733f-465e-ba11-c0dcad6450a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:41.221816 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb634d1b-733f-465e-ba11-c0dcad6450a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:41.224346 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb634d1b-733f-465e-ba11-c0dcad6450a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:41.225317 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb634d1b-733f-465e-ba11-c0dcad6450a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:41.227996 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb634d1b-733f-465e-ba11-c0dcad6450a3 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:41.284522 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 854/1702] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:21:41 2022] POST /identity/v3/users => generated 287 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:21:41.288551 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6b13c9-d6db-44e7-bac7-c246868504ca admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:41.304720 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6b13c9-d6db-44e7-bac7-c246868504ca admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:41.313339 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4ed4a-efd1-4516-b928-bbe753a5b6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:41.314512 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4ed4a-efd1-4516-b928-bbe753a5b6de admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:41.314959 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4ed4a-efd1-4516-b928-bbe753a5b6de admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:41.315351 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4ed4a-efd1-4516-b928-bbe753a5b6de admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:41.317290 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e4ed4a-efd1-4516-b928-bbe753a5b6de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:41.319403 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e4ed4a-efd1-4516-b928-bbe753a5b6de admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:41.333999 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 849/1703] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:21:41.338050 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb634d1b-733f-465e-ba11-c0dcad6450a3 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:41.366579 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb634d1b-733f-465e-ba11-c0dcad6450a3 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:41.379957 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cf0271-87e1-410e-8d8d-869d9a1e918f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:41.380779 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf0271-87e1-410e-8d8d-869d9a1e918f admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:41.381082 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf0271-87e1-410e-8d8d-869d9a1e918f admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:41.382091 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf0271-87e1-410e-8d8d-869d9a1e918f admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:41.383318 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cf0271-87e1-410e-8d8d-869d9a1e918f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:41.388130 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cf0271-87e1-410e-8d8d-869d9a1e918f admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:41.426775 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 855/1704] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 20:21:41.430979 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4ed4a-efd1-4516-b928-bbe753a5b6de admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:41.486046 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4ed4a-efd1-4516-b928-bbe753a5b6de admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:41.527221 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c8ce1-70db-4acf-b0f3-92cac762437f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:41.528706 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c8ce1-70db-4acf-b0f3-92cac762437f admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:41.529002 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c8ce1-70db-4acf-b0f3-92cac762437f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:41.529291 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c8ce1-70db-4acf-b0f3-92cac762437f admin admin] PATH_INFO: `/v3/projects/1c4c524ab0d94fc88e58566b2a770bc9/users/f8a14dd376524ba686118ac88b8a15f1/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:41.630682 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c8ce1-70db-4acf-b0f3-92cac762437f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c4c524ab0d94fc88e58566b2a770bc9, user_id=f8a14dd376524ba686118ac88b8a15f1, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:41.633425 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c8ce1-70db-4acf-b0f3-92cac762437f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:41.667704 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 850/1705] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:21:41 2022] PUT /identity/v3/projects/1c4c524ab0d94fc88e58566b2a770bc9/users/f8a14dd376524ba686118ac88b8a15f1/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:21:41.677535 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb873e5-ddcd-48fc-ae0c-86e002c7592b None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:41.677729 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb873e5-ddcd-48fc-ae0c-86e002c7592b None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:41.678006 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb873e5-ddcd-48fc-ae0c-86e002c7592b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:42.032009 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c8ce1-70db-4acf-b0f3-92cac762437f admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:42.036708 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a51c8ce1-70db-4acf-b0f3-92cac762437f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:42.369360 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c8ce1-70db-4acf-b0f3-92cac762437f admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:42.374815 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-ddb873e5-ddcd-48fc-ae0c-86e002c7592b None None] MFA Rules not processed for user `f8a14dd376524ba686118ac88b8a15f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:42.376090 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-ddb873e5-ddcd-48fc-ae0c-86e002c7592b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:42.395873 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e061585b-308d-46dc-b5de-b0b076e48476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:42.396879 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061585b-308d-46dc-b5de-b0b076e48476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:42.397166 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061585b-308d-46dc-b5de-b0b076e48476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:42.398619 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061585b-308d-46dc-b5de-b0b076e48476 admin admin] PATH_INFO: `/v3/users/7f08655a955d45e4809a3f4d52a7e01e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:42.400793 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e061585b-308d-46dc-b5de-b0b076e48476 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f08655a955d45e4809a3f4d52a7e01e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:42.413973 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e061585b-308d-46dc-b5de-b0b076e48476 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:42.596433 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:21:42.597275 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e061585b-308d-46dc-b5de-b0b076e48476 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f08655a955d45e4809a3f4d52a7e01e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:42.600375 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e061585b-308d-46dc-b5de-b0b076e48476 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f08655a955d45e4809a3f4d52a7e01e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:42.602201 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e061585b-308d-46dc-b5de-b0b076e48476 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f08655a955d45e4809a3f4d52a7e01e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:42.661724 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e061585b-308d-46dc-b5de-b0b076e48476 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f08655a955d45e4809a3f4d52a7e01e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:42.673722 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 856/1706] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:21:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 997 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:42.683475 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e061585b-308d-46dc-b5de-b0b076e48476 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f08655a955d45e4809a3f4d52a7e01e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:42.723962 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 851/1707] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:21:42 2022] DELETE /identity/v3/users/7f08655a955d45e4809a3f4d52a7e01e => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:21:42.729058 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87abc7b-455a-4b57-845a-95ac69fa2fe5 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:42.729167 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87abc7b-455a-4b57-845a-95ac69fa2fe5 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:42.729390 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87abc7b-455a-4b57-845a-95ac69fa2fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:42.768697 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-a87abc7b-455a-4b57-845a-95ac69fa2fe5 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:42.771398 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-a87abc7b-455a-4b57-845a-95ac69fa2fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:43.013063 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e061585b-308d-46dc-b5de-b0b076e48476 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:43.014345 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 857/1708] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:21:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:43.014906 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e061585b-308d-46dc-b5de-b0b076e48476 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:43.072532 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:21:43.169145 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b34db-ef9e-4f2c-8fa0-7ed7eb5af2c8 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:43.169685 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b34db-ef9e-4f2c-8fa0-7ed7eb5af2c8 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:43.170111 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b34db-ef9e-4f2c-8fa0-7ed7eb5af2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:43.199525 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e061585b-308d-46dc-b5de-b0b076e48476 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:43.215070 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77f668-1071-4a4d-9de8-acdb1604984e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:43.216223 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77f668-1071-4a4d-9de8-acdb1604984e service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:43.216674 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77f668-1071-4a4d-9de8-acdb1604984e service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:43.218116 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77f668-1071-4a4d-9de8-acdb1604984e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:43.220633 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-615b34db-ef9e-4f2c-8fa0-7ed7eb5af2c8 None None] MFA Rules not processed for user `e41fb552c794495fa27a1ff74768b9d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:43.226790 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-615b34db-ef9e-4f2c-8fa0-7ed7eb5af2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:43.243168 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77f668-1071-4a4d-9de8-acdb1604984e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:43.249145 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77f668-1071-4a4d-9de8-acdb1604984e service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:43.323725 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 852/1709] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:21:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 20:21:43.447454 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 858/1710] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:21:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:43.749918 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77f668-1071-4a4d-9de8-acdb1604984e service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:43.752236 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9a77f668-1071-4a4d-9de8-acdb1604984e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:43.925791 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77f668-1071-4a4d-9de8-acdb1604984e service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:43.937133 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b34db-ef9e-4f2c-8fa0-7ed7eb5af2c8 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:43.937416 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c15de-3e2d-4cc3-932d-cd6671e9b510 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3918fe05c8634bc39f3e295374701465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:43.938477 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c15de-3e2d-4cc3-932d-cd6671e9b510 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:43.938953 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c15de-3e2d-4cc3-932d-cd6671e9b510 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:43.939253 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-615b34db-ef9e-4f2c-8fa0-7ed7eb5af2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:43.939734 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c15de-3e2d-4cc3-932d-cd6671e9b510 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:43.963498 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b34db-ef9e-4f2c-8fa0-7ed7eb5af2c8 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:43.972119 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf6e0dc-da37-4836-9b3e-4d5eb7b8775c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:43.973352 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6e0dc-da37-4836-9b3e-4d5eb7b8775c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:43.973885 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6e0dc-da37-4836-9b3e-4d5eb7b8775c admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:43.974374 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6e0dc-da37-4836-9b3e-4d5eb7b8775c admin admin] PATH_INFO: `/v3/projects/ea01142cea2d4988b33d67637538673a` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:43.976323 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf6e0dc-da37-4836-9b3e-4d5eb7b8775c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea01142cea2d4988b33d67637538673a)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:43.977896 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: WARNING py.warnings [None req-dcf6e0dc-da37-4836-9b3e-4d5eb7b8775c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 20:21:43.977896 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: warnings.warn(msg) Jun 21 20:21:43.977896 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: Jun 21 20:21:43.979765 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf6e0dc-da37-4836-9b3e-4d5eb7b8775c admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:44.022675 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396c15de-3e2d-4cc3-932d-cd6671e9b510 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:44.024618 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396c15de-3e2d-4cc3-932d-cd6671e9b510 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:44.037111 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 853/1711] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:21:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:21:44.059239 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-dcf6e0dc-da37-4836-9b3e-4d5eb7b8775c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea01142cea2d4988b33d67637538673a', 'request_id': 'req-dcf6e0dc-da37-4836-9b3e-4d5eb7b8775c'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:44.068074 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-dcf6e0dc-da37-4836-9b3e-4d5eb7b8775c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea01142cea2d4988b33d67637538673a', 'request_id': 'req-dcf6e0dc-da37-4836-9b3e-4d5eb7b8775c'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:44.088373 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-dcf6e0dc-da37-4836-9b3e-4d5eb7b8775c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea01142cea2d4988b33d67637538673a', 'request_id': 'req-dcf6e0dc-da37-4836-9b3e-4d5eb7b8775c'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:44.143439 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-dcf6e0dc-da37-4836-9b3e-4d5eb7b8775c admin admin] The token cache is being invalidate because project ea01142cea2d4988b33d67637538673a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:21:44.144172 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-dcf6e0dc-da37-4836-9b3e-4d5eb7b8775c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:44.145174 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-dcf6e0dc-da37-4836-9b3e-4d5eb7b8775c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:44.147706 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 859/1712] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:21:43 2022] DELETE /identity/v3/projects/ea01142cea2d4988b33d67637538673a => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:21:44.151390 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c15de-3e2d-4cc3-932d-cd6671e9b510 service nova] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:44.165769 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c15de-3e2d-4cc3-932d-cd6671e9b510 service nova] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:44.306520 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:21:44.319488 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2876b0e-718c-42ac-af95-5e4ef055a3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:44.320896 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2876b0e-718c-42ac-af95-5e4ef055a3af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:44.322339 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2876b0e-718c-42ac-af95-5e4ef055a3af admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:44.323390 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2876b0e-718c-42ac-af95-5e4ef055a3af admin admin] PATH_INFO: `/v3/users/d11de28d1344495c830c78181e264f95` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:44.326600 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2876b0e-718c-42ac-af95-5e4ef055a3af admin admin] RBAC: Authorizing `identity:delete_user(user_id=d11de28d1344495c830c78181e264f95)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:44.330808 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2876b0e-718c-42ac-af95-5e4ef055a3af admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:44.454264 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b2876b0e-718c-42ac-af95-5e4ef055a3af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd11de28d1344495c830c78181e264f95'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:44.456519 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b2876b0e-718c-42ac-af95-5e4ef055a3af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd11de28d1344495c830c78181e264f95'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:44.457334 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b2876b0e-718c-42ac-af95-5e4ef055a3af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd11de28d1344495c830c78181e264f95'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:44.494911 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b2876b0e-718c-42ac-af95-5e4ef055a3af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd11de28d1344495c830c78181e264f95'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:44.517479 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b2876b0e-718c-42ac-af95-5e4ef055a3af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd11de28d1344495c830c78181e264f95'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:44.563257 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 854/1713] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:21:44 2022] DELETE /identity/v3/users/d11de28d1344495c830c78181e264f95 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:21:45.433012 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cada0a2-2399-40c4-a3f7-b0f278bd8794 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:45.433476 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cada0a2-2399-40c4-a3f7-b0f278bd8794 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:45.433835 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cada0a2-2399-40c4-a3f7-b0f278bd8794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:45.470674 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-8cada0a2-2399-40c4-a3f7-b0f278bd8794 None None] MFA Rules not processed for user `5cf067b8833f4596a1b91073a66768f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:45.474043 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-8cada0a2-2399-40c4-a3f7-b0f278bd8794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:45.511431 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:21:45.657878 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 860/1714] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jun 21 20:21:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:45.821083 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2876b0e-718c-42ac-af95-5e4ef055a3af admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:45.822670 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b2876b0e-718c-42ac-af95-5e4ef055a3af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:46.017707 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2876b0e-718c-42ac-af95-5e4ef055a3af admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:46.024670 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90edd9e5-0de6-4ec0-8877-f505e7d4e912 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '038537bd12174154ba259e097b97b8bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:46.026269 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90edd9e5-0de6-4ec0-8877-f505e7d4e912 service swift] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:46.027269 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90edd9e5-0de6-4ec0-8877-f505e7d4e912 service swift] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:46.027760 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90edd9e5-0de6-4ec0-8877-f505e7d4e912 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:46.046569 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90edd9e5-0de6-4ec0-8877-f505e7d4e912 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:46.048446 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90edd9e5-0de6-4ec0-8877-f505e7d4e912 service swift] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:46.079758 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 855/1715] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jun 21 20:21:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 20:21:47.302730 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1daae0-ee67-4edf-af8a-a16a5487ca0f None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:47.303325 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1daae0-ee67-4edf-af8a-a16a5487ca0f None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:47.303405 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1daae0-ee67-4edf-af8a-a16a5487ca0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:47.366051 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-8b1daae0-ee67-4edf-af8a-a16a5487ca0f None None] MFA Rules not processed for user `1b01b53897d64bbaac6efb6f13d413a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:47.369999 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-8b1daae0-ee67-4edf-af8a-a16a5487ca0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:47.650248 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 861/1716] 10.222.0.43 () {58 vars in 1015 bytes} [Tue Jun 21 20:21:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:47.676613 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90edd9e5-0de6-4ec0-8877-f505e7d4e912 service swift] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:47.678473 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-90edd9e5-0de6-4ec0-8877-f505e7d4e912 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:47.708652 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90edd9e5-0de6-4ec0-8877-f505e7d4e912 service swift] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:47.722528 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32cde31-e364-4915-8431-e6d587d227b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:47.724889 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32cde31-e364-4915-8431-e6d587d227b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:47.725197 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32cde31-e364-4915-8431-e6d587d227b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:47.725490 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32cde31-e364-4915-8431-e6d587d227b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:47.760103 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32cde31-e364-4915-8431-e6d587d227b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:47.765003 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32cde31-e364-4915-8431-e6d587d227b1 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:47.792184 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 856/1717] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:21:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:21:48.746712 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1daae0-ee67-4edf-af8a-a16a5487ca0f None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:48.749233 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-8b1daae0-ee67-4edf-af8a-a16a5487ca0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:48.844467 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1daae0-ee67-4edf-af8a-a16a5487ca0f None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:48.849909 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabf4b17-c3fc-4396-bd89-b09667ff3f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:48.851060 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf4b17-c3fc-4396-bd89-b09667ff3f5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:48.851551 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf4b17-c3fc-4396-bd89-b09667ff3f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:48.863840 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf4b17-c3fc-4396-bd89-b09667ff3f5b admin admin] PATH_INFO: `/v3/projects/f94ef2748965403aae3b8ca4d73d3a7b` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:48.869697 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabf4b17-c3fc-4396-bd89-b09667ff3f5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f94ef2748965403aae3b8ca4d73d3a7b)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:48.877942 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabf4b17-c3fc-4396-bd89-b09667ff3f5b admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:49.023756 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-aabf4b17-c3fc-4396-bd89-b09667ff3f5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f94ef2748965403aae3b8ca4d73d3a7b', 'request_id': 'req-aabf4b17-c3fc-4396-bd89-b09667ff3f5b'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:49.038961 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-aabf4b17-c3fc-4396-bd89-b09667ff3f5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f94ef2748965403aae3b8ca4d73d3a7b', 'request_id': 'req-aabf4b17-c3fc-4396-bd89-b09667ff3f5b'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:49.072196 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-aabf4b17-c3fc-4396-bd89-b09667ff3f5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f94ef2748965403aae3b8ca4d73d3a7b', 'request_id': 'req-aabf4b17-c3fc-4396-bd89-b09667ff3f5b'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:49.106890 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-aabf4b17-c3fc-4396-bd89-b09667ff3f5b admin admin] The token cache is being invalidate because project f94ef2748965403aae3b8ca4d73d3a7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:21:49.115134 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-aabf4b17-c3fc-4396-bd89-b09667ff3f5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:49.117383 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-aabf4b17-c3fc-4396-bd89-b09667ff3f5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:49.126149 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 862/1718] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:21:48 2022] DELETE /identity/v3/projects/f94ef2748965403aae3b8ca4d73d3a7b => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:21:49.129428 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0f3f8-771c-4db6-a236-ec6f66cb8ba6 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:49.130589 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0f3f8-771c-4db6-a236-ec6f66cb8ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:49.131248 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0f3f8-771c-4db6-a236-ec6f66cb8ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:49.194836 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-a4f0f3f8-771c-4db6-a236-ec6f66cb8ba6 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:49.199710 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a4f0f3f8-771c-4db6-a236-ec6f66cb8ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:49.285628 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:21:49.332877 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b41239-927a-4c1a-8982-74c38c22630b None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:49.333520 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b41239-927a-4c1a-8982-74c38c22630b None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:49.334031 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b41239-927a-4c1a-8982-74c38c22630b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:49.347874 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 857/1719] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:21:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:49.368205 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:21:49.421528 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-50b41239-927a-4c1a-8982-74c38c22630b None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:49.428537 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-50b41239-927a-4c1a-8982-74c38c22630b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:49.449175 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 863/1720] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:21:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 20:21:49.453378 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0f3f8-771c-4db6-a236-ec6f66cb8ba6 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:49.496553 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0f3f8-771c-4db6-a236-ec6f66cb8ba6 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:49.534104 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5649eb14-9da4-4a73-adbb-ec47794f8085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:49.535029 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649eb14-9da4-4a73-adbb-ec47794f8085 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:49.537310 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649eb14-9da4-4a73-adbb-ec47794f8085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:49.537852 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649eb14-9da4-4a73-adbb-ec47794f8085 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:49.546098 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5649eb14-9da4-4a73-adbb-ec47794f8085 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:21:49.559684 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5649eb14-9da4-4a73-adbb-ec47794f8085 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:49.577655 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5649eb14-9da4-4a73-adbb-ec47794f8085 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:49.659386 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 858/1721] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:21:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:21:49.664625 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b41239-927a-4c1a-8982-74c38c22630b None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:49.680814 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b41239-927a-4c1a-8982-74c38c22630b None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:49.695261 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f0f2d-fb31-4377-b218-4c3e8351e2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:49.697948 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f0f2d-fb31-4377-b218-4c3e8351e2a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:49.698371 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f0f2d-fb31-4377-b218-4c3e8351e2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:49.698761 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f0f2d-fb31-4377-b218-4c3e8351e2a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:49.701387 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0f0f2d-fb31-4377-b218-4c3e8351e2a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:49.710166 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0f0f2d-fb31-4377-b218-4c3e8351e2a4 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:49.777607 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 864/1722] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:21:49 2022] POST /identity/v3/projects => generated 387 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:21:49.783126 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5649eb14-9da4-4a73-adbb-ec47794f8085 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:49.820536 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5649eb14-9da4-4a73-adbb-ec47794f8085 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:50.019217 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc606a83-9b34-452a-816e-d9c8af8f5bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:50.019940 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc606a83-9b34-452a-816e-d9c8af8f5bb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:50.020234 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc606a83-9b34-452a-816e-d9c8af8f5bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:50.020519 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc606a83-9b34-452a-816e-d9c8af8f5bb4 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:50.021237 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc606a83-9b34-452a-816e-d9c8af8f5bb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:50.023191 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc606a83-9b34-452a-816e-d9c8af8f5bb4 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:50.104593 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 859/1723] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:21:49 2022] POST /identity/v3/users => generated 294 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:21:50.109355 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f0f2d-fb31-4377-b218-4c3e8351e2a4 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:50.145511 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f0f2d-fb31-4377-b218-4c3e8351e2a4 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:50.184944 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832adf47-c465-4cbf-9216-485a4055940e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:50.189523 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832adf47-c465-4cbf-9216-485a4055940e admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:50.189831 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832adf47-c465-4cbf-9216-485a4055940e admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:50.194166 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832adf47-c465-4cbf-9216-485a4055940e admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:50.198419 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832adf47-c465-4cbf-9216-485a4055940e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:50.232854 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832adf47-c465-4cbf-9216-485a4055940e admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:50.315308 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc606a83-9b34-452a-816e-d9c8af8f5bb4 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:50.317844 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 865/1724] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:21:50.340519 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc606a83-9b34-452a-816e-d9c8af8f5bb4 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:50.346964 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4148b-6414-4d4a-b381-0c5df6c94e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:50.348357 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4148b-6414-4d4a-b381-0c5df6c94e36 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:50.349058 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4148b-6414-4d4a-b381-0c5df6c94e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:50.349713 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4148b-6414-4d4a-b381-0c5df6c94e36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:50.350985 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d4148b-6414-4d4a-b381-0c5df6c94e36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:50.353641 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d4148b-6414-4d4a-b381-0c5df6c94e36 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:50.397521 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 860/1725] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:21:50.399749 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832adf47-c465-4cbf-9216-485a4055940e admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:50.419999 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832adf47-c465-4cbf-9216-485a4055940e admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:50.454871 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0388b70-c684-4de2-a8a1-9401e5164d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:50.458391 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0388b70-c684-4de2-a8a1-9401e5164d4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:50.462606 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0388b70-c684-4de2-a8a1-9401e5164d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:50.462898 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0388b70-c684-4de2-a8a1-9401e5164d4a admin admin] PATH_INFO: `/v3/projects/04a571253bf64170a0edefb6b3687fdc/users/08373a8943cb4a3ba1015b5292611f15/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:50.543909 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0388b70-c684-4de2-a8a1-9401e5164d4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=04a571253bf64170a0edefb6b3687fdc, user_id=08373a8943cb4a3ba1015b5292611f15, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:50.561434 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0388b70-c684-4de2-a8a1-9401e5164d4a admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:50.609288 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 866/1726] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:21:50 2022] PUT /identity/v3/projects/04a571253bf64170a0edefb6b3687fdc/users/08373a8943cb4a3ba1015b5292611f15/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:21:50.611142 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9e894-1c3b-4a70-b925-ba00a679fc94 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:50.611747 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9e894-1c3b-4a70-b925-ba00a679fc94 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:50.612222 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9e894-1c3b-4a70-b925-ba00a679fc94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:50.708619 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-36f9e894-1c3b-4a70-b925-ba00a679fc94 None None] MFA Rules not processed for user `08373a8943cb4a3ba1015b5292611f15`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:50.713411 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-36f9e894-1c3b-4a70-b925-ba00a679fc94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:50.972461 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 861/1727] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:21:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:50.977467 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0388b70-c684-4de2-a8a1-9401e5164d4a admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:51.229421 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0388b70-c684-4de2-a8a1-9401e5164d4a admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:51.238039 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e41122-0bd8-4886-ae77-4d99e52236bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:51.239211 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e41122-0bd8-4886-ae77-4d99e52236bb admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:51.239733 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e41122-0bd8-4886-ae77-4d99e52236bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:51.240287 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e41122-0bd8-4886-ae77-4d99e52236bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:51.241386 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e41122-0bd8-4886-ae77-4d99e52236bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:51.247749 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e41122-0bd8-4886-ae77-4d99e52236bb admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:51.290169 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 867/1728] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:21:50 2022] POST /identity/v3/projects => generated 387 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:21:51.295736 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f9e894-1c3b-4a70-b925-ba00a679fc94 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:51.330638 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f9e894-1c3b-4a70-b925-ba00a679fc94 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:51.439195 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:21:51.510139 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef90a7-96dd-4af2-a948-346e805348e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:51.511453 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef90a7-96dd-4af2-a948-346e805348e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:51.512535 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef90a7-96dd-4af2-a948-346e805348e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:51.516631 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef90a7-96dd-4af2-a948-346e805348e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:51.518136 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef90a7-96dd-4af2-a948-346e805348e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:51.527493 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef90a7-96dd-4af2-a948-346e805348e7 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:51.567491 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 862/1729] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:21:51 2022] POST /identity/v3/users => generated 300 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:21:51.571816 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e41122-0bd8-4886-ae77-4d99e52236bb admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:51.596028 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e41122-0bd8-4886-ae77-4d99e52236bb admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:51.612105 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef90a7-96dd-4af2-a948-346e805348e7 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:51.615294 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-55ef90a7-96dd-4af2-a948-346e805348e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:51.642189 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b316c593-5f86-4011-bce4-530e7ad59b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:51.643248 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316c593-5f86-4011-bce4-530e7ad59b7b admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:51.644280 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316c593-5f86-4011-bce4-530e7ad59b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:51.646789 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316c593-5f86-4011-bce4-530e7ad59b7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:51.649312 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b316c593-5f86-4011-bce4-530e7ad59b7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:51.660344 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b316c593-5f86-4011-bce4-530e7ad59b7b admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:51.691497 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef90a7-96dd-4af2-a948-346e805348e7 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:51.712182 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 868/1730] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:21:51.715295 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e30fa3-750f-4cc8-80ac-eefa7c8ab4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:51.716542 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b316c593-5f86-4011-bce4-530e7ad59b7b admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:51.718101 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e30fa3-750f-4cc8-80ac-eefa7c8ab4ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:51.718400 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e30fa3-750f-4cc8-80ac-eefa7c8ab4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:51.718685 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e30fa3-750f-4cc8-80ac-eefa7c8ab4ba admin admin] PATH_INFO: `/v3/users/f8a14dd376524ba686118ac88b8a15f1` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:51.729225 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e30fa3-750f-4cc8-80ac-eefa7c8ab4ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8a14dd376524ba686118ac88b8a15f1)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:51.733499 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e30fa3-750f-4cc8-80ac-eefa7c8ab4ba admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:51.736069 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b316c593-5f86-4011-bce4-530e7ad59b7b admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:51.770244 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35507997-2ea7-4dcb-b655-603f0b4195c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:51.771546 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35507997-2ea7-4dcb-b655-603f0b4195c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:51.772127 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35507997-2ea7-4dcb-b655-603f0b4195c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:51.775240 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35507997-2ea7-4dcb-b655-603f0b4195c6 admin admin] PATH_INFO: `/v3/projects/e83bd72edb364c54bac34e7f7c154505/users/fc6ec82036d54b129ba715b46810fa26/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:51.839848 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35507997-2ea7-4dcb-b655-603f0b4195c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e83bd72edb364c54bac34e7f7c154505, user_id=fc6ec82036d54b129ba715b46810fa26, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:51.854349 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35507997-2ea7-4dcb-b655-603f0b4195c6 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:51.925110 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 869/1731] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:21:51 2022] PUT /identity/v3/projects/e83bd72edb364c54bac34e7f7c154505/users/fc6ec82036d54b129ba715b46810fa26/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:21:51.929550 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35507997-2ea7-4dcb-b655-603f0b4195c6 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:51.933749 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b4e30fa3-750f-4cc8-80ac-eefa7c8ab4ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8a14dd376524ba686118ac88b8a15f1'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:51.938016 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b4e30fa3-750f-4cc8-80ac-eefa7c8ab4ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8a14dd376524ba686118ac88b8a15f1'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:51.939400 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b4e30fa3-750f-4cc8-80ac-eefa7c8ab4ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8a14dd376524ba686118ac88b8a15f1'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:52.005585 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b4e30fa3-750f-4cc8-80ac-eefa7c8ab4ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8a14dd376524ba686118ac88b8a15f1'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:52.046071 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b4e30fa3-750f-4cc8-80ac-eefa7c8ab4ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8a14dd376524ba686118ac88b8a15f1'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:52.130484 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 863/1732] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:21:51 2022] DELETE /identity/v3/users/f8a14dd376524ba686118ac88b8a15f1 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:21:52.132603 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280fc349-e22d-4f9b-bc3d-5297f3df33e5 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:52.137997 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280fc349-e22d-4f9b-bc3d-5297f3df33e5 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:52.138408 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280fc349-e22d-4f9b-bc3d-5297f3df33e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:52.210140 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:21:52.255282 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-280fc349-e22d-4f9b-bc3d-5297f3df33e5 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:52.277117 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-280fc349-e22d-4f9b-bc3d-5297f3df33e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:52.292469 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35507997-2ea7-4dcb-b655-603f0b4195c6 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:52.547488 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0061d5d5-1d06-4191-a021-a3877ae00df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:52.549288 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 864/1733] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:21:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:52.550913 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0061d5d5-1d06-4191-a021-a3877ae00df5 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:52.553005 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0061d5d5-1d06-4191-a021-a3877ae00df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:52.553918 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0061d5d5-1d06-4191-a021-a3877ae00df5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:52.555591 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22df84-5e84-4920-b885-96a3100c7574 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:52.557190 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0061d5d5-1d06-4191-a021-a3877ae00df5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:52.560392 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0061d5d5-1d06-4191-a021-a3877ae00df5 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:52.561053 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22df84-5e84-4920-b885-96a3100c7574 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:52.561321 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22df84-5e84-4920-b885-96a3100c7574 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:52.564032 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 865/1734] 10.222.0.15 () {54 vars in 921 bytes} [Tue Jun 21 20:21:52 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:21:52.587786 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 870/1735] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 659 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:21:52.601129 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c22df84-5e84-4920-b885-96a3100c7574 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:52.610749 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7c22df84-5e84-4920-b885-96a3100c7574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:52.633629 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da6c82-fab2-4856-8671-bb756a1698f3 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:52.634316 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da6c82-fab2-4856-8671-bb756a1698f3 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:52.635000 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da6c82-fab2-4856-8671-bb756a1698f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:52.717782 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-e6da6c82-fab2-4856-8671-bb756a1698f3 None None] MFA Rules not processed for user `3918fe05c8634bc39f3e295374701465`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:52.718806 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c22df84-5e84-4920-b885-96a3100c7574 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:52.720723 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-e6da6c82-fab2-4856-8671-bb756a1698f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:52.731302 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4498712e-2362-43ce-80d6-ac88870a5641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:52.732395 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498712e-2362-43ce-80d6-ac88870a5641 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:52.733220 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498712e-2362-43ce-80d6-ac88870a5641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:52.733498 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498712e-2362-43ce-80d6-ac88870a5641 admin admin] PATH_INFO: `/v3/projects/e83bd72edb364c54bac34e7f7c154505/users/fc6ec82036d54b129ba715b46810fa26/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:52.740921 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4498712e-2362-43ce-80d6-ac88870a5641 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e83bd72edb364c54bac34e7f7c154505, user_id=fc6ec82036d54b129ba715b46810fa26, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:52.743634 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4498712e-2362-43ce-80d6-ac88870a5641 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:52.809353 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 866/1736] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:21:52 2022] PUT /identity/v3/projects/e83bd72edb364c54bac34e7f7c154505/users/fc6ec82036d54b129ba715b46810fa26/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:21:52.813176 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4498712e-2362-43ce-80d6-ac88870a5641 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:52.817786 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4498712e-2362-43ce-80d6-ac88870a5641 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:52.941127 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 871/1737] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Jun 21 20:21:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 20:21:52.950733 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:21:52.952102 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b5dd2-4710-4bd1-8415-8091f7bb3ef3 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:52.952102 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b5dd2-4710-4bd1-8415-8091f7bb3ef3 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:52.952102 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b5dd2-4710-4bd1-8415-8091f7bb3ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:52.991411 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4498712e-2362-43ce-80d6-ac88870a5641 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:53.000697 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1dbf03-b499-4fe5-958a-5b13bae7237a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:53.001616 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1dbf03-b499-4fe5-958a-5b13bae7237a service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:53.003285 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1dbf03-b499-4fe5-958a-5b13bae7237a service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:53.004843 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1dbf03-b499-4fe5-958a-5b13bae7237a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:53.039426 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-0a5b5dd2-4710-4bd1-8415-8091f7bb3ef3 None None] MFA Rules not processed for user `fc6ec82036d54b129ba715b46810fa26`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:53.040968 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-0a5b5dd2-4710-4bd1-8415-8091f7bb3ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:53.166129 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1dbf03-b499-4fe5-958a-5b13bae7237a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:53.171650 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1dbf03-b499-4fe5-958a-5b13bae7237a service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:53.196726 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 867/1738] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:21:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:21:53.199765 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1dbf03-b499-4fe5-958a-5b13bae7237a service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:53.205060 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5c1dbf03-b499-4fe5-958a-5b13bae7237a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:53.235554 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1dbf03-b499-4fe5-958a-5b13bae7237a service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:53.247601 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 872/1739] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:21:52 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:53.249231 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b5dd2-4710-4bd1-8415-8091f7bb3ef3 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:53.254641 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19abf6a-3b6c-4ebf-b3d4-af477d2ce24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:53.255699 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19abf6a-3b6c-4ebf-b3d4-af477d2ce24d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:53.256317 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-0a5b5dd2-4710-4bd1-8415-8091f7bb3ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:53.256807 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19abf6a-3b6c-4ebf-b3d4-af477d2ce24d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:53.258235 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19abf6a-3b6c-4ebf-b3d4-af477d2ce24d admin admin] PATH_INFO: `/v3/users/bb2cec1d576043028e3be2e518440b12` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:53.264613 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19abf6a-3b6c-4ebf-b3d4-af477d2ce24d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb2cec1d576043028e3be2e518440b12)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:53.268219 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19abf6a-3b6c-4ebf-b3d4-af477d2ce24d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:53.293218 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:21:53.422509 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b19abf6a-3b6c-4ebf-b3d4-af477d2ce24d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb2cec1d576043028e3be2e518440b12'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:53.423263 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b19abf6a-3b6c-4ebf-b3d4-af477d2ce24d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb2cec1d576043028e3be2e518440b12'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:53.426408 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b19abf6a-3b6c-4ebf-b3d4-af477d2ce24d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb2cec1d576043028e3be2e518440b12'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:53.449146 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b5dd2-4710-4bd1-8415-8091f7bb3ef3 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:53.466591 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9546c8-ee4c-40f9-9af7-6c25eaaf8507 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:53.480225 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9546c8-ee4c-40f9-9af7-6c25eaaf8507 service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:53.480646 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9546c8-ee4c-40f9-9af7-6c25eaaf8507 service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:53.481179 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9546c8-ee4c-40f9-9af7-6c25eaaf8507 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:53.483136 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b19abf6a-3b6c-4ebf-b3d4-af477d2ce24d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb2cec1d576043028e3be2e518440b12'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:53.487472 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-ba9546c8-ee4c-40f9-9af7-6c25eaaf8507 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:53.511235 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b19abf6a-3b6c-4ebf-b3d4-af477d2ce24d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb2cec1d576043028e3be2e518440b12'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:53.532366 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 868/1740] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:21:53 2022] DELETE /identity/v3/users/bb2cec1d576043028e3be2e518440b12 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:21:53.537137 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecd7b1-66f0-49ba-89a1-454ca3013492 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:53.537437 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecd7b1-66f0-49ba-89a1-454ca3013492 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:53.537785 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecd7b1-66f0-49ba-89a1-454ca3013492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:53.554595 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9546c8-ee4c-40f9-9af7-6c25eaaf8507 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:53.561210 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9546c8-ee4c-40f9-9af7-6c25eaaf8507 service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:53.586075 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-05ecd7b1-66f0-49ba-89a1-454ca3013492 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:53.589892 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-05ecd7b1-66f0-49ba-89a1-454ca3013492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:53.630575 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 873/1741] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:21:53 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 20:21:53.679531 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9546c8-ee4c-40f9-9af7-6c25eaaf8507 service cinder] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:53.681768 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-ba9546c8-ee4c-40f9-9af7-6c25eaaf8507 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:53.709011 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9546c8-ee4c-40f9-9af7-6c25eaaf8507 service cinder] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:53.725964 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:21:53.748570 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 869/1742] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:21:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:53.867864 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ecd7b1-66f0-49ba-89a1-454ca3013492 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:53.867864 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-05ecd7b1-66f0-49ba-89a1-454ca3013492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:53.907750 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f92eb-366c-4a37-baad-9f98ec0fbedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:53.909166 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f92eb-366c-4a37-baad-9f98ec0fbedd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:53.909613 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f92eb-366c-4a37-baad-9f98ec0fbedd admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:53.910032 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f92eb-366c-4a37-baad-9f98ec0fbedd admin admin] PATH_INFO: `/v3/users/08373a8943cb4a3ba1015b5292611f15` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:53.913463 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34f92eb-366c-4a37-baad-9f98ec0fbedd admin admin] RBAC: Authorizing `identity:delete_user(user_id=08373a8943cb4a3ba1015b5292611f15)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:53.917451 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34f92eb-366c-4a37-baad-9f98ec0fbedd admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:54.025587 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-a34f92eb-366c-4a37-baad-9f98ec0fbedd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08373a8943cb4a3ba1015b5292611f15'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:54.027365 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-a34f92eb-366c-4a37-baad-9f98ec0fbedd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08373a8943cb4a3ba1015b5292611f15'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:54.055240 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-a34f92eb-366c-4a37-baad-9f98ec0fbedd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08373a8943cb4a3ba1015b5292611f15'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:54.112795 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-a34f92eb-366c-4a37-baad-9f98ec0fbedd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08373a8943cb4a3ba1015b5292611f15'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:54.115247 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-a34f92eb-366c-4a37-baad-9f98ec0fbedd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08373a8943cb4a3ba1015b5292611f15'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:54.119085 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ecd7b1-66f0-49ba-89a1-454ca3013492 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:54.131675 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48123424-b1e4-4ac9-a3b1-4e1d799d2b14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:54.132434 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48123424-b1e4-4ac9-a3b1-4e1d799d2b14 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:54.135285 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48123424-b1e4-4ac9-a3b1-4e1d799d2b14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:54.136461 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48123424-b1e4-4ac9-a3b1-4e1d799d2b14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:54.144778 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-48123424-b1e4-4ac9-a3b1-4e1d799d2b14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:54.154947 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 874/1743] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:21:53 2022] DELETE /identity/v3/users/08373a8943cb4a3ba1015b5292611f15 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:21:54.161565 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee95828-3163-4227-86f6-0bc526393829 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:54.162053 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee95828-3163-4227-86f6-0bc526393829 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:54.162475 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee95828-3163-4227-86f6-0bc526393829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:54.162674 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48123424-b1e4-4ac9-a3b1-4e1d799d2b14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:54.164953 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48123424-b1e4-4ac9-a3b1-4e1d799d2b14 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:54.193897 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 870/1744] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:21:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:21:54.203034 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-fee95828-3163-4227-86f6-0bc526393829 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:54.205540 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-fee95828-3163-4227-86f6-0bc526393829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:54.293129 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:21:54.364995 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 875/1745] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:21:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:54.453768 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48123424-b1e4-4ac9-a3b1-4e1d799d2b14 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:54.455876 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-48123424-b1e4-4ac9-a3b1-4e1d799d2b14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:54.505533 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48123424-b1e4-4ac9-a3b1-4e1d799d2b14 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:54.697594 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4cae22-e5fc-46ef-b026-e736ccbf5cd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:54.698722 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4cae22-e5fc-46ef-b026-e736ccbf5cd3 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:54.698807 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4cae22-e5fc-46ef-b026-e736ccbf5cd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:54.699298 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4cae22-e5fc-46ef-b026-e736ccbf5cd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:54.722310 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4cae22-e5fc-46ef-b026-e736ccbf5cd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:54.724920 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4cae22-e5fc-46ef-b026-e736ccbf5cd3 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:54.739364 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 871/1746] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:21:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:21:54.855456 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee95828-3163-4227-86f6-0bc526393829 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:54.857404 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-fee95828-3163-4227-86f6-0bc526393829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:55.147863 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee95828-3163-4227-86f6-0bc526393829 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:55.172828 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd793e-0627-48fe-9cc9-1d5818131624 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3918fe05c8634bc39f3e295374701465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:55.173630 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd793e-0627-48fe-9cc9-1d5818131624 service nova] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:55.176428 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd793e-0627-48fe-9cc9-1d5818131624 service nova] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:55.177224 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd793e-0627-48fe-9cc9-1d5818131624 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:55.185964 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-ffbd793e-0627-48fe-9cc9-1d5818131624 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:55.235398 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbd793e-0627-48fe-9cc9-1d5818131624 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:55.245793 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbd793e-0627-48fe-9cc9-1d5818131624 service nova] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:55.298674 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 876/1747] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:21:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:21:57.541452 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4cae22-e5fc-46ef-b026-e736ccbf5cd3 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:57.544018 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ec4cae22-e5fc-46ef-b026-e736ccbf5cd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:57.562731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4cae22-e5fc-46ef-b026-e736ccbf5cd3 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:57.569756 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72e41d-9602-4ec7-a8a0-c800f9bcf93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:57.581490 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72e41d-9602-4ec7-a8a0-c800f9bcf93c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:57.582006 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72e41d-9602-4ec7-a8a0-c800f9bcf93c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:57.583697 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72e41d-9602-4ec7-a8a0-c800f9bcf93c admin admin] PATH_INFO: `/v3/projects/9820f35649e2407699ca11ce07e92e77` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:57.585973 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a72e41d-9602-4ec7-a8a0-c800f9bcf93c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9820f35649e2407699ca11ce07e92e77)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:57.589846 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a72e41d-9602-4ec7-a8a0-c800f9bcf93c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:57.689631 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6a72e41d-9602-4ec7-a8a0-c800f9bcf93c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9820f35649e2407699ca11ce07e92e77', 'request_id': 'req-6a72e41d-9602-4ec7-a8a0-c800f9bcf93c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:57.709420 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6a72e41d-9602-4ec7-a8a0-c800f9bcf93c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9820f35649e2407699ca11ce07e92e77', 'request_id': 'req-6a72e41d-9602-4ec7-a8a0-c800f9bcf93c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:57.739514 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6a72e41d-9602-4ec7-a8a0-c800f9bcf93c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9820f35649e2407699ca11ce07e92e77', 'request_id': 'req-6a72e41d-9602-4ec7-a8a0-c800f9bcf93c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:57.780174 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6a72e41d-9602-4ec7-a8a0-c800f9bcf93c admin admin] The token cache is being invalidate because project 9820f35649e2407699ca11ce07e92e77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:21:57.780468 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6a72e41d-9602-4ec7-a8a0-c800f9bcf93c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:57.782309 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6a72e41d-9602-4ec7-a8a0-c800f9bcf93c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:57.789115 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 872/1748] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:21:57 2022] DELETE /identity/v3/projects/9820f35649e2407699ca11ce07e92e77 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:21:57.790263 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd793e-0627-48fe-9cc9-1d5818131624 service nova] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:57.814890 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd793e-0627-48fe-9cc9-1d5818131624 service nova] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:58.058030 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931bcf0a-8ec1-4d41-a79c-f927f22e1585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:58.062447 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931bcf0a-8ec1-4d41-a79c-f927f22e1585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:58.062811 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931bcf0a-8ec1-4d41-a79c-f927f22e1585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:58.063101 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931bcf0a-8ec1-4d41-a79c-f927f22e1585 admin admin] PATH_INFO: `/v3/users/89dff951a2694878ab49b0ec6c1ed6dd` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:58.067828 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931bcf0a-8ec1-4d41-a79c-f927f22e1585 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89dff951a2694878ab49b0ec6c1ed6dd)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:58.069988 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931bcf0a-8ec1-4d41-a79c-f927f22e1585 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:58.236878 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-931bcf0a-8ec1-4d41-a79c-f927f22e1585 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89dff951a2694878ab49b0ec6c1ed6dd'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:58.237673 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-931bcf0a-8ec1-4d41-a79c-f927f22e1585 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89dff951a2694878ab49b0ec6c1ed6dd'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:58.259633 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-931bcf0a-8ec1-4d41-a79c-f927f22e1585 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89dff951a2694878ab49b0ec6c1ed6dd'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:58.274247 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:21:58.296972 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-931bcf0a-8ec1-4d41-a79c-f927f22e1585 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89dff951a2694878ab49b0ec6c1ed6dd'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:58.298406 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-931bcf0a-8ec1-4d41-a79c-f927f22e1585 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89dff951a2694878ab49b0ec6c1ed6dd'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:58.320064 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 877/1749] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:21:57 2022] DELETE /identity/v3/users/89dff951a2694878ab49b0ec6c1ed6dd => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:21:58.485057 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72e41d-9602-4ec7-a8a0-c800f9bcf93c admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:58.487400 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6a72e41d-9602-4ec7-a8a0-c800f9bcf93c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:58.511390 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72e41d-9602-4ec7-a8a0-c800f9bcf93c admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:58.582116 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:21:58.645988 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7d7f4b-9c83-4fe6-b551-da5b7396ddd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:58.646879 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d7f4b-9c83-4fe6-b551-da5b7396ddd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:58.647167 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d7f4b-9c83-4fe6-b551-da5b7396ddd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:58.647443 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d7f4b-9c83-4fe6-b551-da5b7396ddd3 admin admin] PATH_INFO: `/v3/projects/1c4c524ab0d94fc88e58566b2a770bc9` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:58.648694 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7d7f4b-9c83-4fe6-b551-da5b7396ddd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c4c524ab0d94fc88e58566b2a770bc9)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:58.651443 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7d7f4b-9c83-4fe6-b551-da5b7396ddd3 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:58.766998 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7d7d7f4b-9c83-4fe6-b551-da5b7396ddd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c4c524ab0d94fc88e58566b2a770bc9', 'request_id': 'req-7d7d7f4b-9c83-4fe6-b551-da5b7396ddd3'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:58.784835 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7d7d7f4b-9c83-4fe6-b551-da5b7396ddd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c4c524ab0d94fc88e58566b2a770bc9', 'request_id': 'req-7d7d7f4b-9c83-4fe6-b551-da5b7396ddd3'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:58.792939 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7d7d7f4b-9c83-4fe6-b551-da5b7396ddd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c4c524ab0d94fc88e58566b2a770bc9', 'request_id': 'req-7d7d7f4b-9c83-4fe6-b551-da5b7396ddd3'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:58.807777 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7d7d7f4b-9c83-4fe6-b551-da5b7396ddd3 admin admin] The token cache is being invalidate because project 1c4c524ab0d94fc88e58566b2a770bc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:21:58.808159 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7d7d7f4b-9c83-4fe6-b551-da5b7396ddd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:58.809820 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7d7d7f4b-9c83-4fe6-b551-da5b7396ddd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:58.816175 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 873/1750] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:21:58 2022] DELETE /identity/v3/projects/1c4c524ab0d94fc88e58566b2a770bc9 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:21:58.817721 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc00ffa-fb4c-4bd8-aa0c-6e7b6ada250d None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:58.818217 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc00ffa-fb4c-4bd8-aa0c-6e7b6ada250d None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:58.818217 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc00ffa-fb4c-4bd8-aa0c-6e7b6ada250d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:58.849645 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-bcc00ffa-fb4c-4bd8-aa0c-6e7b6ada250d None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:58.851818 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-bcc00ffa-fb4c-4bd8-aa0c-6e7b6ada250d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:58.944915 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 878/1751] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:21:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:58.951523 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d27751-ba3f-4096-be35-2cc6f3f2afeb None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:58.951807 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d27751-ba3f-4096-be35-2cc6f3f2afeb None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:58.952114 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d27751-ba3f-4096-be35-2cc6f3f2afeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:58.994724 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-38d27751-ba3f-4096-be35-2cc6f3f2afeb None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:58.995977 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-38d27751-ba3f-4096-be35-2cc6f3f2afeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:59.007899 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 874/1752] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:21:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:59.008887 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc00ffa-fb4c-4bd8-aa0c-6e7b6ada250d None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:59.020114 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc00ffa-fb4c-4bd8-aa0c-6e7b6ada250d None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:59.025688 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5864d2c5-b332-4fc3-9a41-0ec86c2e9a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:59.026563 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864d2c5-b332-4fc3-9a41-0ec86c2e9a2a admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:59.027000 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864d2c5-b332-4fc3-9a41-0ec86c2e9a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:59.027439 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864d2c5-b332-4fc3-9a41-0ec86c2e9a2a admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:59.028658 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5864d2c5-b332-4fc3-9a41-0ec86c2e9a2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:21:59.029927 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5864d2c5-b332-4fc3-9a41-0ec86c2e9a2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:59.031704 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5864d2c5-b332-4fc3-9a41-0ec86c2e9a2a admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:59.049923 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d27751-ba3f-4096-be35-2cc6f3f2afeb None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:59.057259 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 879/1753] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:21:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:21:59.061960 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d27751-ba3f-4096-be35-2cc6f3f2afeb None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:59.068481 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f1cafa-f657-4801-84d2-9affcd696f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:59.069513 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1cafa-f657-4801-84d2-9affcd696f8c admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:59.069955 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1cafa-f657-4801-84d2-9affcd696f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:59.070908 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1cafa-f657-4801-84d2-9affcd696f8c admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:59.071785 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f1cafa-f657-4801-84d2-9affcd696f8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:59.074203 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f1cafa-f657-4801-84d2-9affcd696f8c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:59.123114 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5864d2c5-b332-4fc3-9a41-0ec86c2e9a2a admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:59.134280 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 875/1754] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:21:59 2022] POST /identity/v3/projects => generated 371 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:21:59.137304 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5864d2c5-b332-4fc3-9a41-0ec86c2e9a2a admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:59.226543 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c4972-c31d-4320-b720-af1c069ecf8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:59.227431 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c4972-c31d-4320-b720-af1c069ecf8d admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:59.228938 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c4972-c31d-4320-b720-af1c069ecf8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:59.229222 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c4972-c31d-4320-b720-af1c069ecf8d admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:59.229938 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50c4972-c31d-4320-b720-af1c069ecf8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:59.232002 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50c4972-c31d-4320-b720-af1c069ecf8d admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:59.261058 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 880/1755] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:21:59 2022] POST /identity/v3/users => generated 286 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:21:59.262303 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f1cafa-f657-4801-84d2-9affcd696f8c admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:59.273712 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f1cafa-f657-4801-84d2-9affcd696f8c admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:59.279008 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53995102-c325-42c1-9216-9f41ac9636e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:59.279851 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53995102-c325-42c1-9216-9f41ac9636e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:59.280477 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53995102-c325-42c1-9216-9f41ac9636e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:59.281159 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53995102-c325-42c1-9216-9f41ac9636e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:59.282056 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53995102-c325-42c1-9216-9f41ac9636e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:59.283813 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53995102-c325-42c1-9216-9f41ac9636e6 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:59.299891 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 876/1756] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:21:59.303788 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53995102-c325-42c1-9216-9f41ac9636e6 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:59.304730 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bffc8a-a50f-49af-8b64-dd37a932c7c6 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:59.305420 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bffc8a-a50f-49af-8b64-dd37a932c7c6 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:59.306550 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bffc8a-a50f-49af-8b64-dd37a932c7c6 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:59.309804 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 881/1757] 10.222.0.15 () {54 vars in 921 bytes} [Tue Jun 21 20:21:59 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 20:21:59.326749 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53995102-c325-42c1-9216-9f41ac9636e6 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:59.335689 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e13d713-afef-4fc7-a85d-464f940ce58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:59.336899 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13d713-afef-4fc7-a85d-464f940ce58c admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:59.337617 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13d713-afef-4fc7-a85d-464f940ce58c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:59.338975 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13d713-afef-4fc7-a85d-464f940ce58c admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:59.340427 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e13d713-afef-4fc7-a85d-464f940ce58c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:59.354694 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e13d713-afef-4fc7-a85d-464f940ce58c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:59.363460 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896c26b-9434-4a6e-9170-118c73d5aac0 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:59.363894 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896c26b-9434-4a6e-9170-118c73d5aac0 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:59.364270 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896c26b-9434-4a6e-9170-118c73d5aac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:59.402617 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 877/1758] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 20:21:59.406695 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e13d713-afef-4fc7-a85d-464f940ce58c admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:59.418218 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-9896c26b-9434-4a6e-9170-118c73d5aac0 None None] MFA Rules not processed for user `3918fe05c8634bc39f3e295374701465`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:59.419953 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-9896c26b-9434-4a6e-9170-118c73d5aac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:59.421635 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e13d713-afef-4fc7-a85d-464f940ce58c admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:59.427076 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8edbc-fe0b-4cd6-9396-5bf17b3b2600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:59.428173 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8edbc-fe0b-4cd6-9396-5bf17b3b2600 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:59.428477 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8edbc-fe0b-4cd6-9396-5bf17b3b2600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:59.428826 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8edbc-fe0b-4cd6-9396-5bf17b3b2600 admin admin] PATH_INFO: `/v3/projects/2d3af53430694b48bc98719d699fe03b/users/6d65fd9190124853941677eb704c5957/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:59.454148 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe8edbc-fe0b-4cd6-9396-5bf17b3b2600 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d3af53430694b48bc98719d699fe03b, user_id=6d65fd9190124853941677eb704c5957, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:59.457190 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe8edbc-fe0b-4cd6-9396-5bf17b3b2600 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:59.506400 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 878/1759] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:21:59 2022] PUT /identity/v3/projects/2d3af53430694b48bc98719d699fe03b/users/6d65fd9190124853941677eb704c5957/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:21:59.520991 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33a747-c7f8-4955-aaba-74a62c161e2a None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:59.524460 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33a747-c7f8-4955-aaba-74a62c161e2a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:59.524832 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33a747-c7f8-4955-aaba-74a62c161e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:59.528860 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:21:59.562395 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 882/1760] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Jun 21 20:21:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:21:59.566457 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-cd33a747-c7f8-4955-aaba-74a62c161e2a None None] MFA Rules not processed for user `6d65fd9190124853941677eb704c5957`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:21:59.568167 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-cd33a747-c7f8-4955-aaba-74a62c161e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:59.580439 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896c26b-9434-4a6e-9170-118c73d5aac0 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:59.582540 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-9896c26b-9434-4a6e-9170-118c73d5aac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:21:59.605388 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:21:59.648509 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896c26b-9434-4a6e-9170-118c73d5aac0 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:59.663441 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 879/1761] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:21:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 20:21:59.664640 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd33a747-c7f8-4955-aaba-74a62c161e2a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:59.761324 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd33a747-c7f8-4955-aaba-74a62c161e2a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:59.774915 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f8d50-e37d-4db6-bb73-2f3b519e3aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:59.776032 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f8d50-e37d-4db6-bb73-2f3b519e3aa4 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:59.776426 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f8d50-e37d-4db6-bb73-2f3b519e3aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:59.776605 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f8d50-e37d-4db6-bb73-2f3b519e3aa4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:59.780104 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963f8d50-e37d-4db6-bb73-2f3b519e3aa4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:59.786143 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963f8d50-e37d-4db6-bb73-2f3b519e3aa4 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:59.792729 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7755fdf-86e4-4ed6-9898-e7819c3cd497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:21:59.794231 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7755fdf-86e4-4ed6-9898-e7819c3cd497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:21:59.795374 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7755fdf-86e4-4ed6-9898-e7819c3cd497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:21:59.796002 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7755fdf-86e4-4ed6-9898-e7819c3cd497 admin admin] PATH_INFO: `/v3/projects/c13d826458b94de4801f661175191b1b` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:21:59.799166 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7755fdf-86e4-4ed6-9898-e7819c3cd497 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c13d826458b94de4801f661175191b1b)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:21:59.809502 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7755fdf-86e4-4ed6-9898-e7819c3cd497 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:21:59.843539 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 880/1762] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:21:59 2022] POST /identity/v3/projects => generated 371 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 20:21:59.847675 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f8d50-e37d-4db6-bb73-2f3b519e3aa4 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:21:59.933746 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f8d50-e37d-4db6-bb73-2f3b519e3aa4 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:21:59.941337 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-a7755fdf-86e4-4ed6-9898-e7819c3cd497 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c13d826458b94de4801f661175191b1b', 'request_id': 'req-a7755fdf-86e4-4ed6-9898-e7819c3cd497'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:59.956737 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-a7755fdf-86e4-4ed6-9898-e7819c3cd497 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c13d826458b94de4801f661175191b1b', 'request_id': 'req-a7755fdf-86e4-4ed6-9898-e7819c3cd497'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:21:59.972412 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-a7755fdf-86e4-4ed6-9898-e7819c3cd497 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c13d826458b94de4801f661175191b1b', 'request_id': 'req-a7755fdf-86e4-4ed6-9898-e7819c3cd497'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:00.021936 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-a7755fdf-86e4-4ed6-9898-e7819c3cd497 admin admin] The token cache is being invalidate because project c13d826458b94de4801f661175191b1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:22:00.024934 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-a7755fdf-86e4-4ed6-9898-e7819c3cd497 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:00.025887 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-a7755fdf-86e4-4ed6-9898-e7819c3cd497 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:00.029476 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 883/1763] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:21:59 2022] DELETE /identity/v3/projects/c13d826458b94de4801f661175191b1b => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:22:00.039610 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3e771-7a01-4c77-83c5-6909b83462d7 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:00.041100 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3e771-7a01-4c77-83c5-6909b83462d7 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:00.041489 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3e771-7a01-4c77-83c5-6909b83462d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:00.100117 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd986c1-470e-42a3-95ba-b75e4990f2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:00.100915 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd986c1-470e-42a3-95ba-b75e4990f2cb admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:00.101271 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd986c1-470e-42a3-95ba-b75e4990f2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:00.101618 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd986c1-470e-42a3-95ba-b75e4990f2cb admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:00.102407 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd986c1-470e-42a3-95ba-b75e4990f2cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:00.104878 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd986c1-470e-42a3-95ba-b75e4990f2cb admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:00.105086 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-b6a3e771-7a01-4c77-83c5-6909b83462d7 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:22:00.110762 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-b6a3e771-7a01-4c77-83c5-6909b83462d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:00.123742 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:00.136383 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 884/1764] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:22:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:22:00.137563 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a3e771-7a01-4c77-83c5-6909b83462d7 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:00.139645 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-b6a3e771-7a01-4c77-83c5-6909b83462d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:00.150902 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 881/1765] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:21:59 2022] POST /identity/v3/users => generated 292 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:22:00.152435 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a43ec1-f5db-4d31-a76f-527e69bbad39 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:00.153464 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a43ec1-f5db-4d31-a76f-527e69bbad39 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:00.153761 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a43ec1-f5db-4d31-a76f-527e69bbad39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:00.186264 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f3a43ec1-f5db-4d31-a76f-527e69bbad39 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:22:00.186264 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f3a43ec1-f5db-4d31-a76f-527e69bbad39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:00.195907 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a3e771-7a01-4c77-83c5-6909b83462d7 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:00.211964 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 882/1766] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:22:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:22:00.211964 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a43ec1-f5db-4d31-a76f-527e69bbad39 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:00.214961 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f3a43ec1-f5db-4d31-a76f-527e69bbad39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:00.219168 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117160e-1c6f-43a0-b6ae-aba054c4fb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:00.222324 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117160e-1c6f-43a0-b6ae-aba054c4fb6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:00.223154 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117160e-1c6f-43a0-b6ae-aba054c4fb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:00.223515 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117160e-1c6f-43a0-b6ae-aba054c4fb6a admin admin] PATH_INFO: `/v3/projects/04a571253bf64170a0edefb6b3687fdc` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:00.230610 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9117160e-1c6f-43a0-b6ae-aba054c4fb6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=04a571253bf64170a0edefb6b3687fdc)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:00.235816 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9117160e-1c6f-43a0-b6ae-aba054c4fb6a admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:00.242316 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a43ec1-f5db-4d31-a76f-527e69bbad39 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:00.258647 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da568626-a7d8-4a6f-bc78-3ebae97ebc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:00.259599 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da568626-a7d8-4a6f-bc78-3ebae97ebc63 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:00.261636 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da568626-a7d8-4a6f-bc78-3ebae97ebc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:00.262626 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da568626-a7d8-4a6f-bc78-3ebae97ebc63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:00.263503 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da568626-a7d8-4a6f-bc78-3ebae97ebc63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:00.266555 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da568626-a7d8-4a6f-bc78-3ebae97ebc63 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:00.288736 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 883/1767] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:22:00.289934 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da568626-a7d8-4a6f-bc78-3ebae97ebc63 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:00.296004 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-da568626-a7d8-4a6f-bc78-3ebae97ebc63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:00.332196 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-9117160e-1c6f-43a0-b6ae-aba054c4fb6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04a571253bf64170a0edefb6b3687fdc', 'request_id': 'req-9117160e-1c6f-43a0-b6ae-aba054c4fb6a'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:00.339800 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-9117160e-1c6f-43a0-b6ae-aba054c4fb6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04a571253bf64170a0edefb6b3687fdc', 'request_id': 'req-9117160e-1c6f-43a0-b6ae-aba054c4fb6a'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:00.370109 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-9117160e-1c6f-43a0-b6ae-aba054c4fb6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04a571253bf64170a0edefb6b3687fdc', 'request_id': 'req-9117160e-1c6f-43a0-b6ae-aba054c4fb6a'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:00.373888 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:00.397084 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-9117160e-1c6f-43a0-b6ae-aba054c4fb6a admin admin] The token cache is being invalidate because project 04a571253bf64170a0edefb6b3687fdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:22:00.397670 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-9117160e-1c6f-43a0-b6ae-aba054c4fb6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:00.398541 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-9117160e-1c6f-43a0-b6ae-aba054c4fb6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:00.403388 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 885/1768] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:22:00 2022] DELETE /identity/v3/projects/04a571253bf64170a0edefb6b3687fdc => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:22:00.405229 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117160e-1c6f-43a0-b6ae-aba054c4fb6a admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:00.407064 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-9117160e-1c6f-43a0-b6ae-aba054c4fb6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:00.449464 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da568626-a7d8-4a6f-bc78-3ebae97ebc63 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:00.527797 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117160e-1c6f-43a0-b6ae-aba054c4fb6a admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:00.534691 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ae5c6d-3277-4bd8-94ff-b789a11dee7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:00.535378 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae5c6d-3277-4bd8-94ff-b789a11dee7e admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:00.535669 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae5c6d-3277-4bd8-94ff-b789a11dee7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:00.535982 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae5c6d-3277-4bd8-94ff-b789a11dee7e admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:00.536737 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ae5c6d-3277-4bd8-94ff-b789a11dee7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:22:00.537050 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ae5c6d-3277-4bd8-94ff-b789a11dee7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:00.538871 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ae5c6d-3277-4bd8-94ff-b789a11dee7e admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:00.554213 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 886/1769] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:22:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:22:00.555205 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ae5c6d-3277-4bd8-94ff-b789a11dee7e admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:00.557198 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-22ae5c6d-3277-4bd8-94ff-b789a11dee7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:00.578936 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ae5c6d-3277-4bd8-94ff-b789a11dee7e admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:00.590145 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906f3176-f691-4381-8582-bcf98f9a2f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:00.592236 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f3176-f691-4381-8582-bcf98f9a2f89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:00.592538 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f3176-f691-4381-8582-bcf98f9a2f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:00.592826 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f3176-f691-4381-8582-bcf98f9a2f89 admin admin] PATH_INFO: `/v3/projects/5db14d56fe6e42788d97b0a9c13db8dd/users/9a745988f70e492fa14fc63d49c86924/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:00.604350 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8418b444-a70f-46de-80db-9414c1f078a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3918fe05c8634bc39f3e295374701465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:00.605132 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418b444-a70f-46de-80db-9414c1f078a0 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:00.608863 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418b444-a70f-46de-80db-9414c1f078a0 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:00.609512 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418b444-a70f-46de-80db-9414c1f078a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:00.612004 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8418b444-a70f-46de-80db-9414c1f078a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:00.619373 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906f3176-f691-4381-8582-bcf98f9a2f89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5db14d56fe6e42788d97b0a9c13db8dd, user_id=9a745988f70e492fa14fc63d49c86924, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:00.623555 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906f3176-f691-4381-8582-bcf98f9a2f89 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:00.628365 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8418b444-a70f-46de-80db-9414c1f078a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:00.645367 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8418b444-a70f-46de-80db-9414c1f078a0 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:00.653043 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 887/1770] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:22:00 2022] PUT /identity/v3/projects/5db14d56fe6e42788d97b0a9c13db8dd/users/9a745988f70e492fa14fc63d49c86924/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:22:00.655806 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906f3176-f691-4381-8582-bcf98f9a2f89 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:00.658100 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-906f3176-f691-4381-8582-bcf98f9a2f89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:00.663428 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 884/1771] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:22:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:22:00.664456 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8418b444-a70f-46de-80db-9414c1f078a0 service nova] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:00.678849 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8418b444-a70f-46de-80db-9414c1f078a0 service nova] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:00.744364 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906f3176-f691-4381-8582-bcf98f9a2f89 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:00.750215 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b16817-f9de-4b35-a0a5-47d5f8c03cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:00.751304 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b16817-f9de-4b35-a0a5-47d5f8c03cd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:00.751593 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b16817-f9de-4b35-a0a5-47d5f8c03cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:00.751877 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b16817-f9de-4b35-a0a5-47d5f8c03cd9 admin admin] PATH_INFO: `/v3/users/fc6ec82036d54b129ba715b46810fa26` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:00.753160 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b16817-f9de-4b35-a0a5-47d5f8c03cd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc6ec82036d54b129ba715b46810fa26)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:00.754792 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d63fcdd-79db-474b-ac53-6f6898739d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:00.755213 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b16817-f9de-4b35-a0a5-47d5f8c03cd9 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:00.755731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63fcdd-79db-474b-ac53-6f6898739d04 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:00.756143 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63fcdd-79db-474b-ac53-6f6898739d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:00.756516 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63fcdd-79db-474b-ac53-6f6898739d04 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:00.757477 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d63fcdd-79db-474b-ac53-6f6898739d04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:00.760118 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d63fcdd-79db-474b-ac53-6f6898739d04 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:00.765139 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:00.808487 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 885/1772] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:22:00 2022] POST /identity/v3/projects => generated 365 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:22:00.809612 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d63fcdd-79db-474b-ac53-6f6898739d04 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:00.823991 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-12b16817-f9de-4b35-a0a5-47d5f8c03cd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc6ec82036d54b129ba715b46810fa26'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:00.824709 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-12b16817-f9de-4b35-a0a5-47d5f8c03cd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc6ec82036d54b129ba715b46810fa26'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:00.834836 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-12b16817-f9de-4b35-a0a5-47d5f8c03cd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc6ec82036d54b129ba715b46810fa26'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:00.845863 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:00.852583 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-12b16817-f9de-4b35-a0a5-47d5f8c03cd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc6ec82036d54b129ba715b46810fa26'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:00.860513 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-12b16817-f9de-4b35-a0a5-47d5f8c03cd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc6ec82036d54b129ba715b46810fa26'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:00.878638 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 888/1773] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:22:00 2022] DELETE /identity/v3/users/fc6ec82036d54b129ba715b46810fa26 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:22:00.879611 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b16817-f9de-4b35-a0a5-47d5f8c03cd9 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:00.881810 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-12b16817-f9de-4b35-a0a5-47d5f8c03cd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:00.896869 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d63fcdd-79db-474b-ac53-6f6898739d04 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:00.965191 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1805caa7-4b36-466c-b8ff-a4aba2e94662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:00.965807 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b16817-f9de-4b35-a0a5-47d5f8c03cd9 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:00.966502 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805caa7-4b36-466c-b8ff-a4aba2e94662 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:00.966877 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805caa7-4b36-466c-b8ff-a4aba2e94662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:00.967253 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805caa7-4b36-466c-b8ff-a4aba2e94662 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:00.968144 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1805caa7-4b36-466c-b8ff-a4aba2e94662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:00.969923 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1805caa7-4b36-466c-b8ff-a4aba2e94662 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:00.972093 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1ab1df-7767-45e6-b10a-1aa93944509f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:00.973213 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ab1df-7767-45e6-b10a-1aa93944509f admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:00.973644 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ab1df-7767-45e6-b10a-1aa93944509f admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:00.974076 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ab1df-7767-45e6-b10a-1aa93944509f admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:00.975343 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1ab1df-7767-45e6-b10a-1aa93944509f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:00.977543 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1ab1df-7767-45e6-b10a-1aa93944509f admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:00.982583 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 886/1774] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:22:00.987111 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1805caa7-4b36-466c-b8ff-a4aba2e94662 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:00.989666 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1805caa7-4b36-466c-b8ff-a4aba2e94662 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:01.007224 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 889/1775] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:22:00 2022] POST /identity/v3/users => generated 283 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:22:01.007676 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1805caa7-4b36-466c-b8ff-a4aba2e94662 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:01.008803 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1ab1df-7767-45e6-b10a-1aa93944509f admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:01.015024 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c54583a-9244-45ee-b4cf-640fe99fdb9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:01.016255 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54583a-9244-45ee-b4cf-640fe99fdb9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:01.016630 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54583a-9244-45ee-b4cf-640fe99fdb9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:01.017157 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54583a-9244-45ee-b4cf-640fe99fdb9b admin admin] PATH_INFO: `/v3/projects/5db14d56fe6e42788d97b0a9c13db8dd/users/9a745988f70e492fa14fc63d49c86924/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:01.020787 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c54583a-9244-45ee-b4cf-640fe99fdb9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5db14d56fe6e42788d97b0a9c13db8dd, user_id=9a745988f70e492fa14fc63d49c86924, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:01.023314 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1ab1df-7767-45e6-b10a-1aa93944509f admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:01.023938 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c54583a-9244-45ee-b4cf-640fe99fdb9b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:01.030062 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4137036-4fc1-4d3a-a637-5b84529e2582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:01.031676 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4137036-4fc1-4d3a-a637-5b84529e2582 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:01.033499 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4137036-4fc1-4d3a-a637-5b84529e2582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:01.033898 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4137036-4fc1-4d3a-a637-5b84529e2582 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:01.034733 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4137036-4fc1-4d3a-a637-5b84529e2582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:01.036848 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4137036-4fc1-4d3a-a637-5b84529e2582 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:01.041312 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 887/1776] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:22:00 2022] PUT /identity/v3/projects/5db14d56fe6e42788d97b0a9c13db8dd/users/9a745988f70e492fa14fc63d49c86924/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:22:01.052506 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39bea0-6569-462f-9759-6b221bde19e2 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:01.053093 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39bea0-6569-462f-9759-6b221bde19e2 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:01.053234 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 890/1777] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:22:01 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:22:01.053896 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39bea0-6569-462f-9759-6b221bde19e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:01.054135 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4137036-4fc1-4d3a-a637-5b84529e2582 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:01.069716 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4137036-4fc1-4d3a-a637-5b84529e2582 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:01.086137 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-5e39bea0-6569-462f-9759-6b221bde19e2 None None] MFA Rules not processed for user `9a745988f70e492fa14fc63d49c86924`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:22:01.087606 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5e39bea0-6569-462f-9759-6b221bde19e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:01.181608 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e898309-f151-4ddc-882b-449695645a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:01.182468 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e898309-f151-4ddc-882b-449695645a08 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:01.182921 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e898309-f151-4ddc-882b-449695645a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:01.183214 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e898309-f151-4ddc-882b-449695645a08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:01.183982 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e898309-f151-4ddc-882b-449695645a08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:01.186910 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e898309-f151-4ddc-882b-449695645a08 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:01.199947 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 891/1778] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:22:01 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:22:01.201231 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:01.204886 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e898309-f151-4ddc-882b-449695645a08 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:01.212762 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 888/1779] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:22:01 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 20:22:01.221195 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e39bea0-6569-462f-9759-6b221bde19e2 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:01.222873 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5e39bea0-6569-462f-9759-6b221bde19e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:01.227977 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e898309-f151-4ddc-882b-449695645a08 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:01.233476 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb87c95-5141-46b1-8fc1-db2d92017cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:01.234452 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb87c95-5141-46b1-8fc1-db2d92017cc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:01.234806 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb87c95-5141-46b1-8fc1-db2d92017cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:01.235153 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb87c95-5141-46b1-8fc1-db2d92017cc4 admin admin] PATH_INFO: `/v3/projects/ce770a3dc524477a8e59df25e6946676/users/c87b032ae14f4a369153900e535cbbae/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:01.261546 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb87c95-5141-46b1-8fc1-db2d92017cc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce770a3dc524477a8e59df25e6946676, user_id=c87b032ae14f4a369153900e535cbbae, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:01.264968 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb87c95-5141-46b1-8fc1-db2d92017cc4 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:01.295527 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 892/1780] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:22:01 2022] PUT /identity/v3/projects/ce770a3dc524477a8e59df25e6946676/users/c87b032ae14f4a369153900e535cbbae/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:22:01.297159 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb87c95-5141-46b1-8fc1-db2d92017cc4 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:01.301608 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-9cb87c95-5141-46b1-8fc1-db2d92017cc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:01.331490 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e39bea0-6569-462f-9759-6b221bde19e2 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:01.370260 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:01.390625 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2a8ec-681c-43b0-9b10-dd48d2cf19e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:01.391568 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2a8ec-681c-43b0-9b10-dd48d2cf19e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:01.391856 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2a8ec-681c-43b0-9b10-dd48d2cf19e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:01.392197 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2a8ec-681c-43b0-9b10-dd48d2cf19e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:01.407667 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb87c95-5141-46b1-8fc1-db2d92017cc4 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:01.414637 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de909d-67cd-4567-9217-9bb7e82f28e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:01.416166 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de909d-67cd-4567-9217-9bb7e82f28e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:01.416457 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de909d-67cd-4567-9217-9bb7e82f28e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:01.416935 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de909d-67cd-4567-9217-9bb7e82f28e8 admin admin] PATH_INFO: `/v3/projects/e83bd72edb364c54bac34e7f7c154505` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:01.418350 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de909d-67cd-4567-9217-9bb7e82f28e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e83bd72edb364c54bac34e7f7c154505)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:01.421112 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de909d-67cd-4567-9217-9bb7e82f28e8 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:01.484574 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca2a8ec-681c-43b0-9b10-dd48d2cf19e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:01.486180 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca2a8ec-681c-43b0-9b10-dd48d2cf19e1 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:01.498536 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-b9de909d-67cd-4567-9217-9bb7e82f28e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e83bd72edb364c54bac34e7f7c154505', 'request_id': 'req-b9de909d-67cd-4567-9217-9bb7e82f28e8'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:01.504978 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-b9de909d-67cd-4567-9217-9bb7e82f28e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e83bd72edb364c54bac34e7f7c154505', 'request_id': 'req-b9de909d-67cd-4567-9217-9bb7e82f28e8'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:01.509605 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 889/1781] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:22:01 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 20:22:01.512175 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe47ba-35be-46e1-b79d-273fd61d5888 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:01.512498 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe47ba-35be-46e1-b79d-273fd61d5888 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:01.512796 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe47ba-35be-46e1-b79d-273fd61d5888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:01.514849 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-b9de909d-67cd-4567-9217-9bb7e82f28e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e83bd72edb364c54bac34e7f7c154505', 'request_id': 'req-b9de909d-67cd-4567-9217-9bb7e82f28e8'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:01.530871 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-b9de909d-67cd-4567-9217-9bb7e82f28e8 admin admin] The token cache is being invalidate because project e83bd72edb364c54bac34e7f7c154505 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:22:01.531431 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-b9de909d-67cd-4567-9217-9bb7e82f28e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:01.532317 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-b9de909d-67cd-4567-9217-9bb7e82f28e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:01.534440 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 893/1782] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:22:01 2022] DELETE /identity/v3/projects/e83bd72edb364c54bac34e7f7c154505 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:22:01.539021 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b0402-ad7e-499b-8ab0-f0461ba6e164 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:01.539317 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b0402-ad7e-499b-8ab0-f0461ba6e164 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:01.539610 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b0402-ad7e-499b-8ab0-f0461ba6e164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:01.564159 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-b3fe47ba-35be-46e1-b79d-273fd61d5888 None None] MFA Rules not processed for user `c87b032ae14f4a369153900e535cbbae`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:22:01.565342 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-493b0402-ad7e-499b-8ab0-f0461ba6e164 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:22:01.566053 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b3fe47ba-35be-46e1-b79d-273fd61d5888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:01.567147 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-493b0402-ad7e-499b-8ab0-f0461ba6e164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:01.638244 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 894/1783] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:22:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 20:22:01.639117 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b0402-ad7e-499b-8ab0-f0461ba6e164 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:01.640972 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-493b0402-ad7e-499b-8ab0-f0461ba6e164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:01.644788 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:01.650864 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 890/1784] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:22:01 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:22:01.653573 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83914ef0-4523-4066-adef-75df481b3850 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:01.654680 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83914ef0-4523-4066-adef-75df481b3850 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:01.655034 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83914ef0-4523-4066-adef-75df481b3850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:01.673452 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-83914ef0-4523-4066-adef-75df481b3850 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:22:01.674795 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-83914ef0-4523-4066-adef-75df481b3850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:01.684919 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 891/1785] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:22:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:22:01.685831 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83914ef0-4523-4066-adef-75df481b3850 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:01.687152 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-83914ef0-4523-4066-adef-75df481b3850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:01.701559 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83914ef0-4523-4066-adef-75df481b3850 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:01.706275 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84bae39-2cad-4b46-a0fc-16bbed280c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:01.706669 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b0402-ad7e-499b-8ab0-f0461ba6e164 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:01.706876 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84bae39-2cad-4b46-a0fc-16bbed280c37 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:01.707163 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84bae39-2cad-4b46-a0fc-16bbed280c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:01.707446 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84bae39-2cad-4b46-a0fc-16bbed280c37 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:01.708167 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84bae39-2cad-4b46-a0fc-16bbed280c37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:01.710067 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84bae39-2cad-4b46-a0fc-16bbed280c37 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:01.710314 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ec6e7-185a-4785-ab07-ff8778546ba6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:01.710972 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ec6e7-185a-4785-ab07-ff8778546ba6 service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:01.711258 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ec6e7-185a-4785-ab07-ff8778546ba6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:01.711540 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ec6e7-185a-4785-ab07-ff8778546ba6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:01.713636 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-b27ec6e7-185a-4785-ab07-ff8778546ba6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:01.732968 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:01.737574 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 892/1786] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:22:01 2022] POST /identity/v3/projects => generated 365 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:22:01.738394 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84bae39-2cad-4b46-a0fc-16bbed280c37 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:01.777292 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27ec6e7-185a-4785-ab07-ff8778546ba6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:01.778732 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27ec6e7-185a-4785-ab07-ff8778546ba6 service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:01.788334 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 895/1787] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:22:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:22:01.789181 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ec6e7-185a-4785-ab07-ff8778546ba6 service cinder] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:01.800118 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84bae39-2cad-4b46-a0fc-16bbed280c37 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:01.800813 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ec6e7-185a-4785-ab07-ff8778546ba6 service cinder] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:01.807002 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6420a6ae-28c4-4a7c-ae32-f2cd3601c783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:01.807527 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98800d2b-d6a6-4af5-92f9-7d65355ee06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:01.807671 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420a6ae-28c4-4a7c-ae32-f2cd3601c783 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:01.808101 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420a6ae-28c4-4a7c-ae32-f2cd3601c783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:01.808300 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98800d2b-d6a6-4af5-92f9-7d65355ee06f admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:01.808701 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98800d2b-d6a6-4af5-92f9-7d65355ee06f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:01.808990 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420a6ae-28c4-4a7c-ae32-f2cd3601c783 admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:01.809103 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98800d2b-d6a6-4af5-92f9-7d65355ee06f admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:01.809708 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6420a6ae-28c4-4a7c-ae32-f2cd3601c783 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:01.809875 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98800d2b-d6a6-4af5-92f9-7d65355ee06f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:22:01.810283 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98800d2b-d6a6-4af5-92f9-7d65355ee06f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:01.811999 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6420a6ae-28c4-4a7c-ae32-f2cd3601c783 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:01.812338 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98800d2b-d6a6-4af5-92f9-7d65355ee06f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:01.826184 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 893/1788] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:22:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:22:01.831436 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98800d2b-d6a6-4af5-92f9-7d65355ee06f admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:01.839963 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 896/1789] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:22:01 2022] POST /identity/v3/users => generated 289 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:22:01.843008 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6420a6ae-28c4-4a7c-ae32-f2cd3601c783 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:01.848398 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98800d2b-d6a6-4af5-92f9-7d65355ee06f admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:01.853383 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962da5d4-e8f0-49bf-bbb9-9ad36039b93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:01.854051 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962da5d4-e8f0-49bf-bbb9-9ad36039b93e admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:01.854341 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962da5d4-e8f0-49bf-bbb9-9ad36039b93e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:01.854675 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962da5d4-e8f0-49bf-bbb9-9ad36039b93e admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:01.855472 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962da5d4-e8f0-49bf-bbb9-9ad36039b93e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:01.857496 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962da5d4-e8f0-49bf-bbb9-9ad36039b93e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:01.864419 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6420a6ae-28c4-4a7c-ae32-f2cd3601c783 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:01.870456 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99340008-bd96-4359-b7ae-c5e2c57d166c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:01.871389 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99340008-bd96-4359-b7ae-c5e2c57d166c admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:01.871815 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99340008-bd96-4359-b7ae-c5e2c57d166c admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:01.872170 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99340008-bd96-4359-b7ae-c5e2c57d166c admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:01.873209 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99340008-bd96-4359-b7ae-c5e2c57d166c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:01.874693 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99340008-bd96-4359-b7ae-c5e2c57d166c admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:01.890222 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 897/1790] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:22:01 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 20:22:01.890397 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 894/1791] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:22:01 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 20:22:01.891804 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99340008-bd96-4359-b7ae-c5e2c57d166c admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:01.892921 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962da5d4-e8f0-49bf-bbb9-9ad36039b93e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:01.902187 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99340008-bd96-4359-b7ae-c5e2c57d166c admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:01.965718 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e66b57-b4a4-454a-b7d0-ce3ab005f9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:01.968440 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e66b57-b4a4-454a-b7d0-ce3ab005f9cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:01.969565 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e66b57-b4a4-454a-b7d0-ce3ab005f9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:01.970037 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e66b57-b4a4-454a-b7d0-ce3ab005f9cb admin admin] PATH_INFO: `/v3/projects/3e1c55b24b1a44f8be9b497ef70e50ac/users/cbffd2b52baf48419224bd7a1f62841f/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:01.973848 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962da5d4-e8f0-49bf-bbb9-9ad36039b93e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:01.979187 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b107671-5ef1-4a2e-bc33-0a04a0811f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:01.979873 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b107671-5ef1-4a2e-bc33-0a04a0811f8f admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:01.980186 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b107671-5ef1-4a2e-bc33-0a04a0811f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:01.980470 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b107671-5ef1-4a2e-bc33-0a04a0811f8f admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:01.981194 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b107671-5ef1-4a2e-bc33-0a04a0811f8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:01.984256 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b107671-5ef1-4a2e-bc33-0a04a0811f8f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:01.988770 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e66b57-b4a4-454a-b7d0-ce3ab005f9cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e1c55b24b1a44f8be9b497ef70e50ac, user_id=cbffd2b52baf48419224bd7a1f62841f, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:01.991506 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e66b57-b4a4-454a-b7d0-ce3ab005f9cb admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:02.007305 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 898/1792] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:22:01 2022] PUT /identity/v3/projects/3e1c55b24b1a44f8be9b497ef70e50ac/users/cbffd2b52baf48419224bd7a1f62841f/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:22:02.007485 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 895/1793] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:22:01 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:22:02.011233 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e66b57-b4a4-454a-b7d0-ce3ab005f9cb admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:02.011362 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b107671-5ef1-4a2e-bc33-0a04a0811f8f admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:02.021328 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b107671-5ef1-4a2e-bc33-0a04a0811f8f admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:02.046952 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:02.073954 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e66b57-b4a4-454a-b7d0-ce3ab005f9cb admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:02.077878 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbffcdd-e42e-44bb-b881-b92eeddd8fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:02.078556 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbffcdd-e42e-44bb-b881-b92eeddd8fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:02.078665 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc64e1a-b700-4e55-b9fc-d1a0be84aef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:02.078866 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbffcdd-e42e-44bb-b881-b92eeddd8fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:02.079146 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbffcdd-e42e-44bb-b881-b92eeddd8fe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:02.079236 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc64e1a-b700-4e55-b9fc-d1a0be84aef2 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:02.079530 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc64e1a-b700-4e55-b9fc-d1a0be84aef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:02.079809 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc64e1a-b700-4e55-b9fc-d1a0be84aef2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:02.079906 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbffcdd-e42e-44bb-b881-b92eeddd8fe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:02.080579 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc64e1a-b700-4e55-b9fc-d1a0be84aef2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:02.081497 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbffcdd-e42e-44bb-b881-b92eeddd8fe9 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:02.082373 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc64e1a-b700-4e55-b9fc-d1a0be84aef2 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:02.091801 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 896/1794] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:22:02.093197 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 899/1795] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:22:02.095711 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbffcdd-e42e-44bb-b881-b92eeddd8fe9 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:02.096959 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc64e1a-b700-4e55-b9fc-d1a0be84aef2 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:02.105673 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbffcdd-e42e-44bb-b881-b92eeddd8fe9 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:02.106447 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc64e1a-b700-4e55-b9fc-d1a0be84aef2 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:02.110917 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71321da7-8dec-4dfe-bafa-0fe0655d3aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:02.111532 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c110a2-94db-439d-9e72-130d09d53c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:02.111653 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71321da7-8dec-4dfe-bafa-0fe0655d3aa3 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:02.111966 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71321da7-8dec-4dfe-bafa-0fe0655d3aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:02.112248 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71321da7-8dec-4dfe-bafa-0fe0655d3aa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:02.112430 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c110a2-94db-439d-9e72-130d09d53c25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:02.112723 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c110a2-94db-439d-9e72-130d09d53c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:02.113005 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c110a2-94db-439d-9e72-130d09d53c25 admin admin] PATH_INFO: `/v3/projects/3e1c55b24b1a44f8be9b497ef70e50ac/users/cbffd2b52baf48419224bd7a1f62841f/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:02.113099 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71321da7-8dec-4dfe-bafa-0fe0655d3aa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:02.114570 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71321da7-8dec-4dfe-bafa-0fe0655d3aa3 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:02.114964 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c110a2-94db-439d-9e72-130d09d53c25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e1c55b24b1a44f8be9b497ef70e50ac, user_id=cbffd2b52baf48419224bd7a1f62841f, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:02.117640 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c110a2-94db-439d-9e72-130d09d53c25 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:02.120884 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:02.125375 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 897/1796] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 20:22:02.129593 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71321da7-8dec-4dfe-bafa-0fe0655d3aa3 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:02.132636 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 900/1797] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:22:02 2022] PUT /identity/v3/projects/3e1c55b24b1a44f8be9b497ef70e50ac/users/cbffd2b52baf48419224bd7a1f62841f/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:22:02.139711 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71321da7-8dec-4dfe-bafa-0fe0655d3aa3 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:02.142468 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b320a8e-3ff2-41df-af23-66a58c01edfd None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:02.142761 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b320a8e-3ff2-41df-af23-66a58c01edfd None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:02.143044 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b320a8e-3ff2-41df-af23-66a58c01edfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:02.177804 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-0b320a8e-3ff2-41df-af23-66a58c01edfd None None] MFA Rules not processed for user `cbffd2b52baf48419224bd7a1f62841f`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:22:02.179093 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-0b320a8e-3ff2-41df-af23-66a58c01edfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:02.205469 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b9be53-9e8b-47d1-855e-29986f8ccc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:02.206658 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9be53-9e8b-47d1-855e-29986f8ccc0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:02.207117 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9be53-9e8b-47d1-855e-29986f8ccc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:02.207546 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9be53-9e8b-47d1-855e-29986f8ccc0a admin admin] PATH_INFO: `/v3/projects/1ad0e2d074134ca596446a1ed9958b37/users/c4b4e0645b65409c8c5ba2b7b70c3ac8/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:02.227201 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b9be53-9e8b-47d1-855e-29986f8ccc0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ad0e2d074134ca596446a1ed9958b37, user_id=c4b4e0645b65409c8c5ba2b7b70c3ac8, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:02.229815 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b9be53-9e8b-47d1-855e-29986f8ccc0a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:02.245078 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 898/1798] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:22:02 2022] PUT /identity/v3/projects/1ad0e2d074134ca596446a1ed9958b37/users/c4b4e0645b65409c8c5ba2b7b70c3ac8/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:22:02.254924 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ebbd3f-f138-4fb3-8a2f-08109e362ee6 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:02.255313 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ebbd3f-f138-4fb3-8a2f-08109e362ee6 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:02.255599 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ebbd3f-f138-4fb3-8a2f-08109e362ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:02.269277 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 901/1799] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:22:02 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 20:22:02.284194 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-b1ebbd3f-f138-4fb3-8a2f-08109e362ee6 None None] MFA Rules not processed for user `c4b4e0645b65409c8c5ba2b7b70c3ac8`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:22:02.285659 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b1ebbd3f-f138-4fb3-8a2f-08109e362ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:02.286141 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b320a8e-3ff2-41df-af23-66a58c01edfd None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:02.353964 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b320a8e-3ff2-41df-af23-66a58c01edfd None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:02.376629 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 899/1800] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:22:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:22:02.388549 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ebbd3f-f138-4fb3-8a2f-08109e362ee6 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:02.393857 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b1ebbd3f-f138-4fb3-8a2f-08109e362ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:02.409590 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a812f80-3a72-4c20-87e7-f5c3427eb95b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:02.410769 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a812f80-3a72-4c20-87e7-f5c3427eb95b service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:02.411059 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a812f80-3a72-4c20-87e7-f5c3427eb95b service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:02.411337 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a812f80-3a72-4c20-87e7-f5c3427eb95b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:02.429684 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:02.466047 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ebbd3f-f138-4fb3-8a2f-08109e362ee6 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:02.469558 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:02.475977 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6503f-6f1d-4f64-96f1-7bf09a31e37c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:02.476708 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6503f-6f1d-4f64-96f1-7bf09a31e37c service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:02.477034 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6503f-6f1d-4f64-96f1-7bf09a31e37c service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:02.477363 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6503f-6f1d-4f64-96f1-7bf09a31e37c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:02.485669 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a812f80-3a72-4c20-87e7-f5c3427eb95b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:02.487227 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a812f80-3a72-4c20-87e7-f5c3427eb95b service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:02.490034 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a6503f-6f1d-4f64-96f1-7bf09a31e37c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:02.491477 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a6503f-6f1d-4f64-96f1-7bf09a31e37c service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:02.497476 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 902/1801] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:22:02 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 20:22:02.500998 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 900/1802] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:22:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 20:22:02.524739 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a812f80-3a72-4c20-87e7-f5c3427eb95b service cinder] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:02.594833 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6503f-6f1d-4f64-96f1-7bf09a31e37c service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:02.603634 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6503f-6f1d-4f64-96f1-7bf09a31e37c service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:02.608349 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043323a-50e6-4d5f-acaf-ff537782c673 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:02.609153 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043323a-50e6-4d5f-acaf-ff537782c673 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:02.609392 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a812f80-3a72-4c20-87e7-f5c3427eb95b service cinder] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:02.609498 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043323a-50e6-4d5f-acaf-ff537782c673 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:02.609716 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043323a-50e6-4d5f-acaf-ff537782c673 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:02.614175 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2fe2ea-f89e-4ae5-8eb7-c6b4e52545e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:02.615140 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2fe2ea-f89e-4ae5-8eb7-c6b4e52545e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:02.615497 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2fe2ea-f89e-4ae5-8eb7-c6b4e52545e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:02.615852 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2fe2ea-f89e-4ae5-8eb7-c6b4e52545e0 admin admin] PATH_INFO: `/v3/users/c4b4e0645b65409c8c5ba2b7b70c3ac8` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:02.617249 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2fe2ea-f89e-4ae5-8eb7-c6b4e52545e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4b4e0645b65409c8c5ba2b7b70c3ac8)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:02.619162 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2fe2ea-f89e-4ae5-8eb7-c6b4e52545e0 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:02.682662 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-de2fe2ea-f89e-4ae5-8eb7-c6b4e52545e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4b4e0645b65409c8c5ba2b7b70c3ac8'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:02.683625 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-de2fe2ea-f89e-4ae5-8eb7-c6b4e52545e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4b4e0645b65409c8c5ba2b7b70c3ac8'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:02.685754 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0043323a-50e6-4d5f-acaf-ff537782c673 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:02.689242 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0043323a-50e6-4d5f-acaf-ff537782c673 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:02.702660 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 901/1803] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:22:02 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 20:22:02.715356 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-de2fe2ea-f89e-4ae5-8eb7-c6b4e52545e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4b4e0645b65409c8c5ba2b7b70c3ac8'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:02.732671 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-de2fe2ea-f89e-4ae5-8eb7-c6b4e52545e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4b4e0645b65409c8c5ba2b7b70c3ac8'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:02.733443 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-de2fe2ea-f89e-4ae5-8eb7-c6b4e52545e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4b4e0645b65409c8c5ba2b7b70c3ac8'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:02.748081 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 903/1804] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:22:02 2022] DELETE /identity/v3/users/c4b4e0645b65409c8c5ba2b7b70c3ac8 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:22:02.752626 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab6fae-3ae5-4dd7-8222-2afe7e4c1b43 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:02.752941 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab6fae-3ae5-4dd7-8222-2afe7e4c1b43 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:02.753202 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab6fae-3ae5-4dd7-8222-2afe7e4c1b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:02.771484 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-abab6fae-3ae5-4dd7-8222-2afe7e4c1b43 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:22:02.773163 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-abab6fae-3ae5-4dd7-8222-2afe7e4c1b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:02.862480 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 902/1805] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:22:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:22:02.872693 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2fe2ea-f89e-4ae5-8eb7-c6b4e52545e0 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:02.874176 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-de2fe2ea-f89e-4ae5-8eb7-c6b4e52545e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:02.933586 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2fe2ea-f89e-4ae5-8eb7-c6b4e52545e0 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:02.937658 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1405fd-5a97-4408-954e-9561b4277e0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:02.938306 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1405fd-5a97-4408-954e-9561b4277e0f service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:02.938589 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1405fd-5a97-4408-954e-9561b4277e0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:02.938868 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1405fd-5a97-4408-954e-9561b4277e0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:02.947620 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1405fd-5a97-4408-954e-9561b4277e0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:02.949095 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1405fd-5a97-4408-954e-9561b4277e0f service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:02.959032 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 904/1806] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:22:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:22:03.235398 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab6fae-3ae5-4dd7-8222-2afe7e4c1b43 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:03.236896 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-abab6fae-3ae5-4dd7-8222-2afe7e4c1b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:03.250140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab6fae-3ae5-4dd7-8222-2afe7e4c1b43 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:03.255155 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ab98b-a560-480c-8fa6-1aa140ad7a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:03.256174 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ab98b-a560-480c-8fa6-1aa140ad7a96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:03.256464 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ab98b-a560-480c-8fa6-1aa140ad7a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:03.256744 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ab98b-a560-480c-8fa6-1aa140ad7a96 admin admin] PATH_INFO: `/v3/projects/1ad0e2d074134ca596446a1ed9958b37` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:03.258057 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677ab98b-a560-480c-8fa6-1aa140ad7a96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ad0e2d074134ca596446a1ed9958b37)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:03.259997 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677ab98b-a560-480c-8fa6-1aa140ad7a96 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:03.322170 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-677ab98b-a560-480c-8fa6-1aa140ad7a96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ad0e2d074134ca596446a1ed9958b37', 'request_id': 'req-677ab98b-a560-480c-8fa6-1aa140ad7a96'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:03.334744 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-677ab98b-a560-480c-8fa6-1aa140ad7a96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ad0e2d074134ca596446a1ed9958b37', 'request_id': 'req-677ab98b-a560-480c-8fa6-1aa140ad7a96'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:03.345090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:03.346429 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-677ab98b-a560-480c-8fa6-1aa140ad7a96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ad0e2d074134ca596446a1ed9958b37', 'request_id': 'req-677ab98b-a560-480c-8fa6-1aa140ad7a96'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:03.365677 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-677ab98b-a560-480c-8fa6-1aa140ad7a96 admin admin] The token cache is being invalidate because project 1ad0e2d074134ca596446a1ed9958b37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:22:03.367094 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-677ab98b-a560-480c-8fa6-1aa140ad7a96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:03.368143 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-677ab98b-a560-480c-8fa6-1aa140ad7a96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:03.370809 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 903/1807] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:22:03 2022] DELETE /identity/v3/projects/1ad0e2d074134ca596446a1ed9958b37 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:22:03.376320 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a5b3f-e999-4bef-8375-103f0c0210f2 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:03.376822 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a5b3f-e999-4bef-8375-103f0c0210f2 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:03.377105 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a5b3f-e999-4bef-8375-103f0c0210f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:03.433151 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-862a5b3f-e999-4bef-8375-103f0c0210f2 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:22:03.434464 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-862a5b3f-e999-4bef-8375-103f0c0210f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:03.447853 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:03.566398 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 905/1808] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:22:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:22:03.574811 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc35d6f-990b-4612-9685-e517e04b8552 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:03.575102 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc35d6f-990b-4612-9685-e517e04b8552 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:03.575393 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc35d6f-990b-4612-9685-e517e04b8552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:03.595998 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-8cc35d6f-990b-4612-9685-e517e04b8552 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:22:03.597691 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8cc35d6f-990b-4612-9685-e517e04b8552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:03.612156 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a5b3f-e999-4bef-8375-103f0c0210f2 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:03.613060 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 904/1809] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:22:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:22:03.629924 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a5b3f-e999-4bef-8375-103f0c0210f2 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:03.636284 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a34210-4969-46fa-afba-04bc224dd979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:03.636977 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a34210-4969-46fa-afba-04bc224dd979 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:03.637271 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a34210-4969-46fa-afba-04bc224dd979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:03.637558 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a34210-4969-46fa-afba-04bc224dd979 admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:03.638350 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a34210-4969-46fa-afba-04bc224dd979 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:22:03.639008 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a34210-4969-46fa-afba-04bc224dd979 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:03.641192 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a34210-4969-46fa-afba-04bc224dd979 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:03.661834 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 906/1810] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:22:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:22:03.666692 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc35d6f-990b-4612-9685-e517e04b8552 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:03.679967 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc35d6f-990b-4612-9685-e517e04b8552 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:03.688520 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f7a9ae-09ff-4a21-903c-6c84ba1ef07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:03.689691 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7a9ae-09ff-4a21-903c-6c84ba1ef07b admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:03.690424 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7a9ae-09ff-4a21-903c-6c84ba1ef07b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:03.690843 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7a9ae-09ff-4a21-903c-6c84ba1ef07b admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:03.693318 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f7a9ae-09ff-4a21-903c-6c84ba1ef07b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:03.696662 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f7a9ae-09ff-4a21-903c-6c84ba1ef07b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:03.737927 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 905/1811] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:22:03 2022] POST /identity/v3/projects => generated 375 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:22:03.739008 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a34210-4969-46fa-afba-04bc224dd979 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:03.762566 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a34210-4969-46fa-afba-04bc224dd979 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:03.885837 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b67c204-34e7-4ae4-ac38-258cf174c221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:03.886565 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67c204-34e7-4ae4-ac38-258cf174c221 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:03.888046 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67c204-34e7-4ae4-ac38-258cf174c221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:03.888268 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67c204-34e7-4ae4-ac38-258cf174c221 admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:03.888987 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b67c204-34e7-4ae4-ac38-258cf174c221 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:03.890962 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b67c204-34e7-4ae4-ac38-258cf174c221 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:03.931535 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 907/1812] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:22:03 2022] POST /identity/v3/users => generated 288 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:22:03.935649 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f7a9ae-09ff-4a21-903c-6c84ba1ef07b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:03.958103 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f7a9ae-09ff-4a21-903c-6c84ba1ef07b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:03.964293 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e6734-f980-44c7-bd82-b199cdc7bfbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:03.965056 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e6734-f980-44c7-bd82-b199cdc7bfbe admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:03.965416 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e6734-f980-44c7-bd82-b199cdc7bfbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:03.965769 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e6734-f980-44c7-bd82-b199cdc7bfbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:03.967271 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9e6734-f980-44c7-bd82-b199cdc7bfbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:03.969674 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9e6734-f980-44c7-bd82-b199cdc7bfbe admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:03.985425 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 906/1813] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:22:03 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:22:03.989219 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b67c204-34e7-4ae4-ac38-258cf174c221 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:04.001508 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b67c204-34e7-4ae4-ac38-258cf174c221 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:04.009873 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b0623d-5754-48ab-96c6-e19f242ec067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:04.010891 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0623d-5754-48ab-96c6-e19f242ec067 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:04.011216 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0623d-5754-48ab-96c6-e19f242ec067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:04.011668 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0623d-5754-48ab-96c6-e19f242ec067 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:04.012563 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b0623d-5754-48ab-96c6-e19f242ec067 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:04.014309 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b0623d-5754-48ab-96c6-e19f242ec067 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:04.031851 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 908/1814] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:22:03 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 20:22:04.033191 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e6734-f980-44c7-bd82-b199cdc7bfbe admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:04.050491 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e6734-f980-44c7-bd82-b199cdc7bfbe admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:04.055417 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d09c8-7ce2-4e0c-ab99-e0aafc8fd910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:04.056485 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d09c8-7ce2-4e0c-ab99-e0aafc8fd910 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:04.056839 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d09c8-7ce2-4e0c-ab99-e0aafc8fd910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:04.057192 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d09c8-7ce2-4e0c-ab99-e0aafc8fd910 admin admin] PATH_INFO: `/v3/projects/fe042238c02e4455a6ae4a30665f4dcf/users/8f3f051405274d19a70daced07f46587/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:04.093454 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d09c8-7ce2-4e0c-ab99-e0aafc8fd910 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe042238c02e4455a6ae4a30665f4dcf, user_id=8f3f051405274d19a70daced07f46587, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:04.096906 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d09c8-7ce2-4e0c-ab99-e0aafc8fd910 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:04.136040 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 907/1815] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:22:04 2022] PUT /identity/v3/projects/fe042238c02e4455a6ae4a30665f4dcf/users/8f3f051405274d19a70daced07f46587/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:22:04.142106 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a73d0-c73e-48ff-bfce-c929c5a772a4 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:04.142734 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a73d0-c73e-48ff-bfce-c929c5a772a4 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:04.143125 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a73d0-c73e-48ff-bfce-c929c5a772a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:04.182862 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-ab6a73d0-c73e-48ff-bfce-c929c5a772a4 None None] MFA Rules not processed for user `8f3f051405274d19a70daced07f46587`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:22:04.184212 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-ab6a73d0-c73e-48ff-bfce-c929c5a772a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:04.273016 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 909/1816] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:22:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:22:04.274388 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d09c8-7ce2-4e0c-ab99-e0aafc8fd910 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:04.339767 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d09c8-7ce2-4e0c-ab99-e0aafc8fd910 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:04.345261 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3e562-6723-4bd2-be8f-16377a74eb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:04.345929 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3e562-6723-4bd2-be8f-16377a74eb41 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:04.346213 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3e562-6723-4bd2-be8f-16377a74eb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:04.346491 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3e562-6723-4bd2-be8f-16377a74eb41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:04.347203 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a3e562-6723-4bd2-be8f-16377a74eb41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:04.349120 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a3e562-6723-4bd2-be8f-16377a74eb41 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:04.388020 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 908/1817] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:22:04 2022] POST /identity/v3/projects => generated 375 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:22:04.392565 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a73d0-c73e-48ff-bfce-c929c5a772a4 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:04.399835 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:04.405191 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a73d0-c73e-48ff-bfce-c929c5a772a4 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:04.492801 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c901c335-ce6f-4b39-bc6f-dd0a9620d63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:04.493484 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c901c335-ce6f-4b39-bc6f-dd0a9620d63f admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:04.493992 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c901c335-ce6f-4b39-bc6f-dd0a9620d63f admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:04.494280 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c901c335-ce6f-4b39-bc6f-dd0a9620d63f admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:04.495143 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c901c335-ce6f-4b39-bc6f-dd0a9620d63f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:04.497270 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c901c335-ce6f-4b39-bc6f-dd0a9620d63f admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:04.524753 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 910/1818] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:22:04 2022] POST /identity/v3/users => generated 294 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 20:22:04.529264 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3e562-6723-4bd2-be8f-16377a74eb41 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:04.547385 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3e562-6723-4bd2-be8f-16377a74eb41 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:04.552294 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcde642-d919-4ed9-a560-a01cd9453b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:04.552980 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcde642-d919-4ed9-a560-a01cd9453b0a admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:04.553281 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcde642-d919-4ed9-a560-a01cd9453b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:04.553600 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcde642-d919-4ed9-a560-a01cd9453b0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:04.554338 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcde642-d919-4ed9-a560-a01cd9453b0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:04.556072 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcde642-d919-4ed9-a560-a01cd9453b0a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:04.569063 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 909/1819] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:22:04.573311 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c901c335-ce6f-4b39-bc6f-dd0a9620d63f admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:04.584161 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c901c335-ce6f-4b39-bc6f-dd0a9620d63f admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:04.589574 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c27ea-7ed2-4239-863a-f3662b931d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:04.590618 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c27ea-7ed2-4239-863a-f3662b931d15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:04.590910 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c27ea-7ed2-4239-863a-f3662b931d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:04.591698 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c27ea-7ed2-4239-863a-f3662b931d15 admin admin] PATH_INFO: `/v3/projects/21331f304148478d938a79b0a4badc6b/users/a4a86d9cadb84f98a232ed35a1730432/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:04.607563 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1c27ea-7ed2-4239-863a-f3662b931d15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21331f304148478d938a79b0a4badc6b, user_id=a4a86d9cadb84f98a232ed35a1730432, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:04.610303 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1c27ea-7ed2-4239-863a-f3662b931d15 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:04.625036 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 911/1820] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:22:04 2022] PUT /identity/v3/projects/21331f304148478d938a79b0a4badc6b/users/a4a86d9cadb84f98a232ed35a1730432/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:22:04.629089 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcde642-d919-4ed9-a560-a01cd9453b0a admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:04.640450 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcde642-d919-4ed9-a560-a01cd9453b0a admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:04.703346 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ddb451-5d7c-4761-8136-3fe32bdcece9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:04.704078 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ddb451-5d7c-4761-8136-3fe32bdcece9 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:04.704353 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ddb451-5d7c-4761-8136-3fe32bdcece9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:04.704646 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ddb451-5d7c-4761-8136-3fe32bdcece9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:04.705376 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ddb451-5d7c-4761-8136-3fe32bdcece9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:04.706978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ddb451-5d7c-4761-8136-3fe32bdcece9 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:04.709349 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:04.722934 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 910/1821] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:22:04.724096 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c27ea-7ed2-4239-863a-f3662b931d15 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:04.735349 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c27ea-7ed2-4239-863a-f3662b931d15 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:04.740040 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de34508-5169-458d-8b97-b1ff02450fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:04.740924 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de34508-5169-458d-8b97-b1ff02450fdb admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:04.741210 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de34508-5169-458d-8b97-b1ff02450fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:04.741486 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de34508-5169-458d-8b97-b1ff02450fdb admin admin] PATH_INFO: `/v3/projects/21331f304148478d938a79b0a4badc6b/users/a4a86d9cadb84f98a232ed35a1730432/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:04.743427 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de34508-5169-458d-8b97-b1ff02450fdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=21331f304148478d938a79b0a4badc6b, user_id=a4a86d9cadb84f98a232ed35a1730432, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:04.746489 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de34508-5169-458d-8b97-b1ff02450fdb admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:04.757729 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 912/1822] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:22:04 2022] PUT /identity/v3/projects/21331f304148478d938a79b0a4badc6b/users/a4a86d9cadb84f98a232ed35a1730432/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:22:04.769582 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d27a3-75ba-4379-8bb6-b8a8ec6b155c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:04.769991 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d27a3-75ba-4379-8bb6-b8a8ec6b155c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:04.770355 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d27a3-75ba-4379-8bb6-b8a8ec6b155c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:04.798859 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e08d27a3-75ba-4379-8bb6-b8a8ec6b155c None None] MFA Rules not processed for user `a4a86d9cadb84f98a232ed35a1730432`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:22:04.800132 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e08d27a3-75ba-4379-8bb6-b8a8ec6b155c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:04.885430 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 911/1823] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:22:04 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:22:04.896969 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de34508-5169-458d-8b97-b1ff02450fdb admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:04.898869 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-8de34508-5169-458d-8b97-b1ff02450fdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:04.959681 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de34508-5169-458d-8b97-b1ff02450fdb admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:04.963705 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeef2be-60c6-4605-bdc4-5505e9540df6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:04.964399 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeef2be-60c6-4605-bdc4-5505e9540df6 service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:04.964688 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeef2be-60c6-4605-bdc4-5505e9540df6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:04.964967 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeef2be-60c6-4605-bdc4-5505e9540df6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:05.023478 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeef2be-60c6-4605-bdc4-5505e9540df6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:05.024940 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeef2be-60c6-4605-bdc4-5505e9540df6 service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:05.034562 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 913/1824] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:22:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 20:22:05.593745 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d27a3-75ba-4379-8bb6-b8a8ec6b155c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:05.595160 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e08d27a3-75ba-4379-8bb6-b8a8ec6b155c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:05.659316 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d27a3-75ba-4379-8bb6-b8a8ec6b155c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:05.663710 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb90d5f5-ac86-4586-9457-95bdc01da153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:05.664625 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90d5f5-ac86-4586-9457-95bdc01da153 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:05.664909 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90d5f5-ac86-4586-9457-95bdc01da153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:05.665185 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90d5f5-ac86-4586-9457-95bdc01da153 admin admin] PATH_INFO: `/v3/users/c87b032ae14f4a369153900e535cbbae` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:05.666357 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb90d5f5-ac86-4586-9457-95bdc01da153 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c87b032ae14f4a369153900e535cbbae)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:05.668333 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb90d5f5-ac86-4586-9457-95bdc01da153 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:05.715472 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-cb90d5f5-ac86-4586-9457-95bdc01da153 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c87b032ae14f4a369153900e535cbbae'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:05.716294 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-cb90d5f5-ac86-4586-9457-95bdc01da153 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c87b032ae14f4a369153900e535cbbae'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:05.717432 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-cb90d5f5-ac86-4586-9457-95bdc01da153 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c87b032ae14f4a369153900e535cbbae'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:05.729262 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-cb90d5f5-ac86-4586-9457-95bdc01da153 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c87b032ae14f4a369153900e535cbbae'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:05.736219 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-cb90d5f5-ac86-4586-9457-95bdc01da153 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c87b032ae14f4a369153900e535cbbae'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:05.748541 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 912/1825] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:22:05 2022] DELETE /identity/v3/users/c87b032ae14f4a369153900e535cbbae => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:22:05.753120 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9778bfa-7ee9-44c9-a146-4a6b20cae46a None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:05.753563 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9778bfa-7ee9-44c9-a146-4a6b20cae46a None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:05.753708 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9778bfa-7ee9-44c9-a146-4a6b20cae46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:05.771494 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-e9778bfa-7ee9-44c9-a146-4a6b20cae46a None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:22:05.772710 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-e9778bfa-7ee9-44c9-a146-4a6b20cae46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:05.777593 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:05.832553 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 914/1826] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:22:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:22:05.842839 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb90d5f5-ac86-4586-9457-95bdc01da153 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:05.844388 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-cb90d5f5-ac86-4586-9457-95bdc01da153 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:05.849814 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:05.905524 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb90d5f5-ac86-4586-9457-95bdc01da153 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:05.909210 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa83b6-b972-4c24-a077-5d040a620a1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:05.909859 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa83b6-b972-4c24-a077-5d040a620a1f service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:05.910144 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa83b6-b972-4c24-a077-5d040a620a1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:05.910420 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa83b6-b972-4c24-a077-5d040a620a1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:05.919593 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa83b6-b972-4c24-a077-5d040a620a1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:05.921090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa83b6-b972-4c24-a077-5d040a620a1f service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:05.930639 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 913/1827] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:22:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 20:22:06.204044 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9778bfa-7ee9-44c9-a146-4a6b20cae46a None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:06.205556 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-e9778bfa-7ee9-44c9-a146-4a6b20cae46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:06.218688 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9778bfa-7ee9-44c9-a146-4a6b20cae46a None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:06.223538 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0781ca8-5ae2-4708-88d7-4122f46006d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:06.224464 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0781ca8-5ae2-4708-88d7-4122f46006d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:06.224750 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0781ca8-5ae2-4708-88d7-4122f46006d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:06.225195 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0781ca8-5ae2-4708-88d7-4122f46006d9 admin admin] PATH_INFO: `/v3/projects/ce770a3dc524477a8e59df25e6946676` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:06.226859 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0781ca8-5ae2-4708-88d7-4122f46006d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce770a3dc524477a8e59df25e6946676)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:06.228979 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0781ca8-5ae2-4708-88d7-4122f46006d9 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:06.284226 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-f0781ca8-5ae2-4708-88d7-4122f46006d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce770a3dc524477a8e59df25e6946676', 'request_id': 'req-f0781ca8-5ae2-4708-88d7-4122f46006d9'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:06.290487 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-f0781ca8-5ae2-4708-88d7-4122f46006d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce770a3dc524477a8e59df25e6946676', 'request_id': 'req-f0781ca8-5ae2-4708-88d7-4122f46006d9'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:06.297535 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-f0781ca8-5ae2-4708-88d7-4122f46006d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce770a3dc524477a8e59df25e6946676', 'request_id': 'req-f0781ca8-5ae2-4708-88d7-4122f46006d9'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:06.308579 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-f0781ca8-5ae2-4708-88d7-4122f46006d9 admin admin] The token cache is being invalidate because project ce770a3dc524477a8e59df25e6946676 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:22:06.308851 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-f0781ca8-5ae2-4708-88d7-4122f46006d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:06.309488 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-f0781ca8-5ae2-4708-88d7-4122f46006d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:06.311674 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 915/1828] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:22:06 2022] DELETE /identity/v3/projects/ce770a3dc524477a8e59df25e6946676 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:22:06.315697 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa83b6-b972-4c24-a077-5d040a620a1f service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:06.325270 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa83b6-b972-4c24-a077-5d040a620a1f service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:06.383586 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa665e7-33c6-4f2f-81d2-58d3071fdf69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:06.384389 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa665e7-33c6-4f2f-81d2-58d3071fdf69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:06.384670 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa665e7-33c6-4f2f-81d2-58d3071fdf69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:06.384948 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa665e7-33c6-4f2f-81d2-58d3071fdf69 admin admin] PATH_INFO: `/v3/users/cbffd2b52baf48419224bd7a1f62841f` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:06.386210 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa665e7-33c6-4f2f-81d2-58d3071fdf69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbffd2b52baf48419224bd7a1f62841f)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:06.388368 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa665e7-33c6-4f2f-81d2-58d3071fdf69 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:06.454023 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8aa665e7-33c6-4f2f-81d2-58d3071fdf69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbffd2b52baf48419224bd7a1f62841f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:06.454775 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8aa665e7-33c6-4f2f-81d2-58d3071fdf69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbffd2b52baf48419224bd7a1f62841f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:06.455402 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8aa665e7-33c6-4f2f-81d2-58d3071fdf69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbffd2b52baf48419224bd7a1f62841f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:06.468323 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8aa665e7-33c6-4f2f-81d2-58d3071fdf69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbffd2b52baf48419224bd7a1f62841f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:06.477263 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8aa665e7-33c6-4f2f-81d2-58d3071fdf69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbffd2b52baf48419224bd7a1f62841f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:06.493346 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 914/1829] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:22:06 2022] DELETE /identity/v3/users/cbffd2b52baf48419224bd7a1f62841f => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:22:06.799357 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0781ca8-5ae2-4708-88d7-4122f46006d9 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:06.800839 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-f0781ca8-5ae2-4708-88d7-4122f46006d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:06.813706 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0781ca8-5ae2-4708-88d7-4122f46006d9 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:06.871947 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d6003-f26a-4c53-9dab-22538e7c5b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:06.872862 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d6003-f26a-4c53-9dab-22538e7c5b77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:06.873145 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d6003-f26a-4c53-9dab-22538e7c5b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:06.873422 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d6003-f26a-4c53-9dab-22538e7c5b77 admin admin] PATH_INFO: `/v3/projects/3e1c55b24b1a44f8be9b497ef70e50ac` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:06.874607 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468d6003-f26a-4c53-9dab-22538e7c5b77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e1c55b24b1a44f8be9b497ef70e50ac)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:06.876564 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468d6003-f26a-4c53-9dab-22538e7c5b77 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:06.913965 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:06.925217 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-468d6003-f26a-4c53-9dab-22538e7c5b77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e1c55b24b1a44f8be9b497ef70e50ac', 'request_id': 'req-468d6003-f26a-4c53-9dab-22538e7c5b77'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:06.931102 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-468d6003-f26a-4c53-9dab-22538e7c5b77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e1c55b24b1a44f8be9b497ef70e50ac', 'request_id': 'req-468d6003-f26a-4c53-9dab-22538e7c5b77'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:06.938906 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-468d6003-f26a-4c53-9dab-22538e7c5b77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e1c55b24b1a44f8be9b497ef70e50ac', 'request_id': 'req-468d6003-f26a-4c53-9dab-22538e7c5b77'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:06.950593 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-468d6003-f26a-4c53-9dab-22538e7c5b77 admin admin] The token cache is being invalidate because project 3e1c55b24b1a44f8be9b497ef70e50ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:22:06.950884 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-468d6003-f26a-4c53-9dab-22538e7c5b77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:06.951541 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-468d6003-f26a-4c53-9dab-22538e7c5b77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:06.953143 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 916/1830] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:22:06 2022] DELETE /identity/v3/projects/3e1c55b24b1a44f8be9b497ef70e50ac => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:22:06.959086 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4116d-65fc-44ea-b262-3f8f24e149af None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:06.959572 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4116d-65fc-44ea-b262-3f8f24e149af None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:06.959679 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4116d-65fc-44ea-b262-3f8f24e149af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:06.977371 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f6c4116d-65fc-44ea-b262-3f8f24e149af None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:22:06.978586 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f6c4116d-65fc-44ea-b262-3f8f24e149af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:06.997678 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:07.037593 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 915/1831] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:22:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:22:07.046007 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e49ccd-b6ef-4e3d-a2cb-b525d85ae39d None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:07.046304 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e49ccd-b6ef-4e3d-a2cb-b525d85ae39d None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:07.046583 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e49ccd-b6ef-4e3d-a2cb-b525d85ae39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:07.064533 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-f0e49ccd-b6ef-4e3d-a2cb-b525d85ae39d None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:22:07.065725 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-f0e49ccd-b6ef-4e3d-a2cb-b525d85ae39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:07.073563 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 917/1832] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:22:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:22:07.078053 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4116d-65fc-44ea-b262-3f8f24e149af None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:07.087562 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4116d-65fc-44ea-b262-3f8f24e149af None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:07.092992 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5119b5b2-e46e-4dea-8af3-9ac6a938b6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:07.093637 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119b5b2-e46e-4dea-8af3-9ac6a938b6b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:07.093921 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119b5b2-e46e-4dea-8af3-9ac6a938b6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:07.094200 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119b5b2-e46e-4dea-8af3-9ac6a938b6b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:07.094919 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5119b5b2-e46e-4dea-8af3-9ac6a938b6b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:22:07.095227 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5119b5b2-e46e-4dea-8af3-9ac6a938b6b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:07.096834 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5119b5b2-e46e-4dea-8af3-9ac6a938b6b5 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:07.108218 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 916/1833] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:22:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:22:07.112391 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e49ccd-b6ef-4e3d-a2cb-b525d85ae39d None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:07.121470 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e49ccd-b6ef-4e3d-a2cb-b525d85ae39d None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:07.126086 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa733a84-d66f-4b55-a474-71b6bcdb191a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:07.126731 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa733a84-d66f-4b55-a474-71b6bcdb191a admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:07.127019 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa733a84-d66f-4b55-a474-71b6bcdb191a admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:07.127303 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa733a84-d66f-4b55-a474-71b6bcdb191a admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:07.128021 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa733a84-d66f-4b55-a474-71b6bcdb191a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:07.129911 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa733a84-d66f-4b55-a474-71b6bcdb191a admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:07.156567 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 918/1834] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:22:07 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:22:07.159894 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5119b5b2-e46e-4dea-8af3-9ac6a938b6b5 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:07.169744 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5119b5b2-e46e-4dea-8af3-9ac6a938b6b5 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:07.225235 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93556596-cc5a-49b2-860a-41b28ea4a695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:07.225913 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93556596-cc5a-49b2-860a-41b28ea4a695 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:07.226202 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93556596-cc5a-49b2-860a-41b28ea4a695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:07.226484 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93556596-cc5a-49b2-860a-41b28ea4a695 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:07.227189 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93556596-cc5a-49b2-860a-41b28ea4a695 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:07.229127 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93556596-cc5a-49b2-860a-41b28ea4a695 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:07.249783 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 917/1835] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:22:07 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 20:22:07.254265 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa733a84-d66f-4b55-a474-71b6bcdb191a admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:07.265763 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa733a84-d66f-4b55-a474-71b6bcdb191a admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:07.270850 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146744c7-8ddb-4364-88c9-47191a597965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:07.271629 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146744c7-8ddb-4364-88c9-47191a597965 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:07.273504 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146744c7-8ddb-4364-88c9-47191a597965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:07.273504 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146744c7-8ddb-4364-88c9-47191a597965 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:07.273504 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146744c7-8ddb-4364-88c9-47191a597965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:07.274699 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146744c7-8ddb-4364-88c9-47191a597965 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:07.286467 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 919/1836] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 20:22:07.290612 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93556596-cc5a-49b2-860a-41b28ea4a695 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:07.301507 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93556596-cc5a-49b2-860a-41b28ea4a695 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:07.306366 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91476874-e041-4cb2-ae96-b518856078fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:07.307042 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91476874-e041-4cb2-ae96-b518856078fd admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:07.307328 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91476874-e041-4cb2-ae96-b518856078fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:07.307608 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91476874-e041-4cb2-ae96-b518856078fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:07.308380 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91476874-e041-4cb2-ae96-b518856078fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:07.310009 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91476874-e041-4cb2-ae96-b518856078fd admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:07.320979 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 918/1837] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:22:07.325154 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146744c7-8ddb-4364-88c9-47191a597965 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:07.335816 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146744c7-8ddb-4364-88c9-47191a597965 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:07.340977 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be8f2f6-9d7e-4280-a64b-4186e3f7f741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:07.342410 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8f2f6-9d7e-4280-a64b-4186e3f7f741 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:07.342711 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8f2f6-9d7e-4280-a64b-4186e3f7f741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:07.342988 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8f2f6-9d7e-4280-a64b-4186e3f7f741 admin admin] PATH_INFO: `/v3/projects/96677babcd92480d869b80361a13a506/users/0b5dd280637a43b792180a82b7d35b63/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:07.357984 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be8f2f6-9d7e-4280-a64b-4186e3f7f741 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96677babcd92480d869b80361a13a506, user_id=0b5dd280637a43b792180a82b7d35b63, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:07.361301 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be8f2f6-9d7e-4280-a64b-4186e3f7f741 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:07.375846 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 920/1838] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:22:07 2022] PUT /identity/v3/projects/96677babcd92480d869b80361a13a506/users/0b5dd280637a43b792180a82b7d35b63/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:22:07.387212 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31e1c6-4844-4537-b818-b83587536212 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:07.387509 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31e1c6-4844-4537-b818-b83587536212 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:07.387787 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31e1c6-4844-4537-b818-b83587536212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:07.415853 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-3e31e1c6-4844-4537-b818-b83587536212 None None] MFA Rules not processed for user `0b5dd280637a43b792180a82b7d35b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:22:07.417089 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3e31e1c6-4844-4537-b818-b83587536212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:07.523224 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 919/1839] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:22:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:22:07.527580 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be8f2f6-9d7e-4280-a64b-4186e3f7f741 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:07.589316 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be8f2f6-9d7e-4280-a64b-4186e3f7f741 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:07.594012 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e9d863-075a-4da7-ae38-b9bcee0ba05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:07.594675 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9d863-075a-4da7-ae38-b9bcee0ba05e admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:07.594961 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9d863-075a-4da7-ae38-b9bcee0ba05e admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:07.595235 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9d863-075a-4da7-ae38-b9bcee0ba05e admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:07.595992 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e9d863-075a-4da7-ae38-b9bcee0ba05e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:07.597983 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e9d863-075a-4da7-ae38-b9bcee0ba05e admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:07.628856 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 921/1840] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:22:07 2022] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:22:07.632478 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e31e1c6-4844-4537-b818-b83587536212 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:07.646706 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e31e1c6-4844-4537-b818-b83587536212 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:07.663735 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:07.707350 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9521573b-d3c7-4e67-a69f-b586f72608be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:07.708067 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521573b-d3c7-4e67-a69f-b586f72608be admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:07.708358 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521573b-d3c7-4e67-a69f-b586f72608be admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:07.708636 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521573b-d3c7-4e67-a69f-b586f72608be admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:07.709501 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9521573b-d3c7-4e67-a69f-b586f72608be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:07.711426 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9521573b-d3c7-4e67-a69f-b586f72608be admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:07.735737 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 920/1841] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:22:07 2022] POST /identity/v3/users => generated 297 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:22:07.737119 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e9d863-075a-4da7-ae38-b9bcee0ba05e admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:07.748674 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e9d863-075a-4da7-ae38-b9bcee0ba05e admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:07.765969 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173848b2-580c-42b4-b61a-b3e0732ecae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:07.766938 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173848b2-580c-42b4-b61a-b3e0732ecae1 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:07.767229 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173848b2-580c-42b4-b61a-b3e0732ecae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:07.767509 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173848b2-580c-42b4-b61a-b3e0732ecae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:07.768999 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173848b2-580c-42b4-b61a-b3e0732ecae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:07.771376 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173848b2-580c-42b4-b61a-b3e0732ecae1 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:07.785048 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 922/1842] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:22:07.789092 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9521573b-d3c7-4e67-a69f-b586f72608be admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:07.801999 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9521573b-d3c7-4e67-a69f-b586f72608be admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:07.806784 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e9d3d5-7ca7-4901-b8db-bb5ed113b63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:07.807673 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9d3d5-7ca7-4901-b8db-bb5ed113b63c admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:07.807990 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9d3d5-7ca7-4901-b8db-bb5ed113b63c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:07.808271 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9d3d5-7ca7-4901-b8db-bb5ed113b63c admin admin] PATH_INFO: `/v3/projects/81737ce4645e469eac93e6bf96c1af15/users/eff52af41e24449bb2d03a452ea7666e/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:07.826416 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e9d3d5-7ca7-4901-b8db-bb5ed113b63c admin admin] RBAC: Authorizing `identity:create_grant(project_id=81737ce4645e469eac93e6bf96c1af15, user_id=eff52af41e24449bb2d03a452ea7666e, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:07.829110 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e9d3d5-7ca7-4901-b8db-bb5ed113b63c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:07.844467 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 921/1843] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:22:07 2022] PUT /identity/v3/projects/81737ce4645e469eac93e6bf96c1af15/users/eff52af41e24449bb2d03a452ea7666e/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:22:07.848377 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173848b2-580c-42b4-b61a-b3e0732ecae1 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:07.859899 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173848b2-580c-42b4-b61a-b3e0732ecae1 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:07.893615 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:07.920350 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d7472-f0da-4731-8807-78807c73b1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:07.921024 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d7472-f0da-4731-8807-78807c73b1fd admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:07.921309 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d7472-f0da-4731-8807-78807c73b1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:07.921585 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d7472-f0da-4731-8807-78807c73b1fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:07.922315 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3d7472-f0da-4731-8807-78807c73b1fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:07.923895 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3d7472-f0da-4731-8807-78807c73b1fd admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:07.933905 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 923/1844] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:22:07.938483 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e9d3d5-7ca7-4901-b8db-bb5ed113b63c admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:07.948669 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e9d3d5-7ca7-4901-b8db-bb5ed113b63c admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:07.953366 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a03175-4b33-4071-83e6-587a9de58441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:07.954251 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a03175-4b33-4071-83e6-587a9de58441 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:07.954541 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a03175-4b33-4071-83e6-587a9de58441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:07.954824 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a03175-4b33-4071-83e6-587a9de58441 admin admin] PATH_INFO: `/v3/projects/81737ce4645e469eac93e6bf96c1af15/users/eff52af41e24449bb2d03a452ea7666e/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:07.956854 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a03175-4b33-4071-83e6-587a9de58441 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81737ce4645e469eac93e6bf96c1af15, user_id=eff52af41e24449bb2d03a452ea7666e, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:07.959650 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a03175-4b33-4071-83e6-587a9de58441 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:07.970129 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 922/1845] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:22:07 2022] PUT /identity/v3/projects/81737ce4645e469eac93e6bf96c1af15/users/eff52af41e24449bb2d03a452ea7666e/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:22:07.980010 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd86612-d295-4eae-b256-80cb32fb99c0 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:07.980303 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd86612-d295-4eae-b256-80cb32fb99c0 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:07.980582 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd86612-d295-4eae-b256-80cb32fb99c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:08.007439 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-8bd86612-d295-4eae-b256-80cb32fb99c0 None None] MFA Rules not processed for user `eff52af41e24449bb2d03a452ea7666e`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:22:08.008667 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-8bd86612-d295-4eae-b256-80cb32fb99c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:08.073869 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 924/1846] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:22:07 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:22:08.084596 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a03175-4b33-4071-83e6-587a9de58441 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:08.086241 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-73a03175-4b33-4071-83e6-587a9de58441 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:08.142806 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a03175-4b33-4071-83e6-587a9de58441 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:08.146417 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac22b1-f726-46fc-84b1-91b9171dff6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:08.147053 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac22b1-f726-46fc-84b1-91b9171dff6c service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:08.147336 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac22b1-f726-46fc-84b1-91b9171dff6c service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:08.147612 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac22b1-f726-46fc-84b1-91b9171dff6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:08.156310 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aac22b1-f726-46fc-84b1-91b9171dff6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:08.157726 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aac22b1-f726-46fc-84b1-91b9171dff6c service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:08.166901 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 923/1847] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:22:08 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:22:08.558049 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd86612-d295-4eae-b256-80cb32fb99c0 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:08.630052 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd86612-d295-4eae-b256-80cb32fb99c0 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:08.634643 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a7cd2d-6ed6-4582-a23d-447da94a58d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:08.635534 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a7cd2d-6ed6-4582-a23d-447da94a58d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:08.635822 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a7cd2d-6ed6-4582-a23d-447da94a58d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:08.636134 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a7cd2d-6ed6-4582-a23d-447da94a58d9 admin admin] PATH_INFO: `/v3/users/0b5dd280637a43b792180a82b7d35b63` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:08.637327 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a7cd2d-6ed6-4582-a23d-447da94a58d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b5dd280637a43b792180a82b7d35b63)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:08.639884 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a7cd2d-6ed6-4582-a23d-447da94a58d9 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:08.688665 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-d6a7cd2d-6ed6-4582-a23d-447da94a58d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b5dd280637a43b792180a82b7d35b63'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:08.689898 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-d6a7cd2d-6ed6-4582-a23d-447da94a58d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b5dd280637a43b792180a82b7d35b63'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:08.698313 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-d6a7cd2d-6ed6-4582-a23d-447da94a58d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b5dd280637a43b792180a82b7d35b63'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:08.703793 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:08.714265 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-d6a7cd2d-6ed6-4582-a23d-447da94a58d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b5dd280637a43b792180a82b7d35b63'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:08.715343 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-d6a7cd2d-6ed6-4582-a23d-447da94a58d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b5dd280637a43b792180a82b7d35b63'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:08.735078 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 925/1848] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:22:08 2022] DELETE /identity/v3/users/0b5dd280637a43b792180a82b7d35b63 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:22:08.739567 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0aa9fb-1e67-4580-b36a-f943e85f4130 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:08.739866 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0aa9fb-1e67-4580-b36a-f943e85f4130 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:08.740200 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0aa9fb-1e67-4580-b36a-f943e85f4130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:08.757820 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ec0aa9fb-1e67-4580-b36a-f943e85f4130 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:22:08.759050 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ec0aa9fb-1e67-4580-b36a-f943e85f4130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:08.848882 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 924/1849] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:22:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:22:08.873770 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a7cd2d-6ed6-4582-a23d-447da94a58d9 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:08.875343 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-d6a7cd2d-6ed6-4582-a23d-447da94a58d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:08.949992 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a7cd2d-6ed6-4582-a23d-447da94a58d9 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:08.955559 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab752c65-9195-4e09-adfd-2d97f224515b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:08.956329 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab752c65-9195-4e09-adfd-2d97f224515b service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:08.957223 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab752c65-9195-4e09-adfd-2d97f224515b service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:08.957695 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab752c65-9195-4e09-adfd-2d97f224515b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:08.971180 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab752c65-9195-4e09-adfd-2d97f224515b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:08.973092 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab752c65-9195-4e09-adfd-2d97f224515b service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:08.999123 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 926/1850] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:22:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:22:09.034368 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bed1d-d8e4-443e-b4a7-c5bf0c7bbae5 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:09.035636 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bed1d-d8e4-443e-b4a7-c5bf0c7bbae5 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:09.036256 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bed1d-d8e4-443e-b4a7-c5bf0c7bbae5 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:09.038256 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 925/1851] 10.222.0.15 () {54 vars in 921 bytes} [Tue Jun 21 20:22:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:22:09.047675 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691abaa0-f8bf-4cac-941c-9d648e0d2b58 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:09.048014 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691abaa0-f8bf-4cac-941c-9d648e0d2b58 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:09.048503 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691abaa0-f8bf-4cac-941c-9d648e0d2b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:09.077403 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-691abaa0-f8bf-4cac-941c-9d648e0d2b58 None None] MFA Rules not processed for user `3918fe05c8634bc39f3e295374701465`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:22:09.077755 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-691abaa0-f8bf-4cac-941c-9d648e0d2b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:09.163896 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 927/1852] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Jun 21 20:22:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:22:09.177657 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3bed1d-d8e4-443e-b4a7-c5bf0c7bbae5 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:09.179752 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-cd3bed1d-d8e4-443e-b4a7-c5bf0c7bbae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:09.201000 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3bed1d-d8e4-443e-b4a7-c5bf0c7bbae5 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:09.206528 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388fee64-b2fc-4a00-b5c7-cf118fa103cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3918fe05c8634bc39f3e295374701465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:09.207227 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388fee64-b2fc-4a00-b5c7-cf118fa103cc service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:09.207516 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388fee64-b2fc-4a00-b5c7-cf118fa103cc service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:09.207797 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388fee64-b2fc-4a00-b5c7-cf118fa103cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:09.217394 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388fee64-b2fc-4a00-b5c7-cf118fa103cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:09.219292 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388fee64-b2fc-4a00-b5c7-cf118fa103cc service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:09.229942 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 926/1853] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:22:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:22:09.394475 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691abaa0-f8bf-4cac-941c-9d648e0d2b58 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:09.396028 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-691abaa0-f8bf-4cac-941c-9d648e0d2b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:09.413226 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691abaa0-f8bf-4cac-941c-9d648e0d2b58 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:09.417842 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8089c7-c077-406d-9e80-dbbe09ff26d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:09.418720 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8089c7-c077-406d-9e80-dbbe09ff26d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:09.419011 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8089c7-c077-406d-9e80-dbbe09ff26d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:09.419785 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8089c7-c077-406d-9e80-dbbe09ff26d1 admin admin] PATH_INFO: `/v3/projects/96677babcd92480d869b80361a13a506` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:09.421024 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8089c7-c077-406d-9e80-dbbe09ff26d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96677babcd92480d869b80361a13a506)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:09.422931 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8089c7-c077-406d-9e80-dbbe09ff26d1 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:09.486220 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-8b8089c7-c077-406d-9e80-dbbe09ff26d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96677babcd92480d869b80361a13a506', 'request_id': 'req-8b8089c7-c077-406d-9e80-dbbe09ff26d1'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:09.491734 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-8b8089c7-c077-406d-9e80-dbbe09ff26d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96677babcd92480d869b80361a13a506', 'request_id': 'req-8b8089c7-c077-406d-9e80-dbbe09ff26d1'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:09.499129 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-8b8089c7-c077-406d-9e80-dbbe09ff26d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96677babcd92480d869b80361a13a506', 'request_id': 'req-8b8089c7-c077-406d-9e80-dbbe09ff26d1'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:09.500317 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:09.513197 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-8b8089c7-c077-406d-9e80-dbbe09ff26d1 admin admin] The token cache is being invalidate because project 96677babcd92480d869b80361a13a506 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:22:09.513595 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-8b8089c7-c077-406d-9e80-dbbe09ff26d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:09.514247 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-8b8089c7-c077-406d-9e80-dbbe09ff26d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:09.515811 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 928/1854] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:22:09 2022] DELETE /identity/v3/projects/96677babcd92480d869b80361a13a506 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:22:09.519740 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388fee64-b2fc-4a00-b5c7-cf118fa103cc service nova] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:09.524860 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:09.530914 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388fee64-b2fc-4a00-b5c7-cf118fa103cc service nova] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:09.585881 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a5ebf-dfff-448e-8413-af718c4da989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:09.586759 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a5ebf-dfff-448e-8413-af718c4da989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:09.587043 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a5ebf-dfff-448e-8413-af718c4da989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:09.587318 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a5ebf-dfff-448e-8413-af718c4da989 admin admin] PATH_INFO: `/v3/users/eff52af41e24449bb2d03a452ea7666e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:09.588771 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6a5ebf-dfff-448e-8413-af718c4da989 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eff52af41e24449bb2d03a452ea7666e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:09.591196 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6a5ebf-dfff-448e-8413-af718c4da989 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:09.638739 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0a6a5ebf-dfff-448e-8413-af718c4da989 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eff52af41e24449bb2d03a452ea7666e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:09.639401 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0a6a5ebf-dfff-448e-8413-af718c4da989 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eff52af41e24449bb2d03a452ea7666e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:09.640035 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0a6a5ebf-dfff-448e-8413-af718c4da989 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eff52af41e24449bb2d03a452ea7666e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:09.653836 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0a6a5ebf-dfff-448e-8413-af718c4da989 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eff52af41e24449bb2d03a452ea7666e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:09.661301 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0a6a5ebf-dfff-448e-8413-af718c4da989 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eff52af41e24449bb2d03a452ea7666e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:09.674013 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 927/1855] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:22:09 2022] DELETE /identity/v3/users/eff52af41e24449bb2d03a452ea7666e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:22:10.066429 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8089c7-c077-406d-9e80-dbbe09ff26d1 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:10.068722 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-8b8089c7-c077-406d-9e80-dbbe09ff26d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:10.133375 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8089c7-c077-406d-9e80-dbbe09ff26d1 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:10.222250 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dfba45-a9ea-4ff9-8cd6-1acaa68bded8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:10.223146 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dfba45-a9ea-4ff9-8cd6-1acaa68bded8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:10.223436 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dfba45-a9ea-4ff9-8cd6-1acaa68bded8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:10.223851 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dfba45-a9ea-4ff9-8cd6-1acaa68bded8 admin admin] PATH_INFO: `/v3/projects/81737ce4645e469eac93e6bf96c1af15` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:10.225114 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dfba45-a9ea-4ff9-8cd6-1acaa68bded8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81737ce4645e469eac93e6bf96c1af15)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:10.227169 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dfba45-a9ea-4ff9-8cd6-1acaa68bded8 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:10.289551 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-66dfba45-a9ea-4ff9-8cd6-1acaa68bded8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81737ce4645e469eac93e6bf96c1af15', 'request_id': 'req-66dfba45-a9ea-4ff9-8cd6-1acaa68bded8'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:10.298938 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-66dfba45-a9ea-4ff9-8cd6-1acaa68bded8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81737ce4645e469eac93e6bf96c1af15', 'request_id': 'req-66dfba45-a9ea-4ff9-8cd6-1acaa68bded8'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:10.314454 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-66dfba45-a9ea-4ff9-8cd6-1acaa68bded8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81737ce4645e469eac93e6bf96c1af15', 'request_id': 'req-66dfba45-a9ea-4ff9-8cd6-1acaa68bded8'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:10.334187 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-66dfba45-a9ea-4ff9-8cd6-1acaa68bded8 admin admin] The token cache is being invalidate because project 81737ce4645e469eac93e6bf96c1af15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:22:10.334499 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-66dfba45-a9ea-4ff9-8cd6-1acaa68bded8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:10.335779 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-66dfba45-a9ea-4ff9-8cd6-1acaa68bded8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:10.343310 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 929/1856] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:22:10 2022] DELETE /identity/v3/projects/81737ce4645e469eac93e6bf96c1af15 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:22:10.345687 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31967a-4260-4915-9118-3ba1f4aebe10 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:10.346678 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31967a-4260-4915-9118-3ba1f4aebe10 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:10.347050 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31967a-4260-4915-9118-3ba1f4aebe10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:10.380514 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-5e31967a-4260-4915-9118-3ba1f4aebe10 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:22:10.386470 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5e31967a-4260-4915-9118-3ba1f4aebe10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:10.493096 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 928/1857] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:22:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:22:10.501961 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b72702-43fe-46c5-a547-61c336c62d37 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:10.502457 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b72702-43fe-46c5-a547-61c336c62d37 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:10.502770 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b72702-43fe-46c5-a547-61c336c62d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:10.525236 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-72b72702-43fe-46c5-a547-61c336c62d37 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:22:10.526677 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-72b72702-43fe-46c5-a547-61c336c62d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:10.536736 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 930/1858] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:22:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:22:10.540618 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e31967a-4260-4915-9118-3ba1f4aebe10 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:10.551434 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e31967a-4260-4915-9118-3ba1f4aebe10 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:10.557597 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4b927-5bea-4cb1-8ef9-c9782f7f2a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:10.558505 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4b927-5bea-4cb1-8ef9-c9782f7f2a93 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:10.558820 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4b927-5bea-4cb1-8ef9-c9782f7f2a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:10.559136 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4b927-5bea-4cb1-8ef9-c9782f7f2a93 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:10.560607 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b4b927-5bea-4cb1-8ef9-c9782f7f2a93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:22:10.560855 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b4b927-5bea-4cb1-8ef9-c9782f7f2a93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:10.562603 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b4b927-5bea-4cb1-8ef9-c9782f7f2a93 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:10.579822 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 929/1859] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:22:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:22:10.581480 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b72702-43fe-46c5-a547-61c336c62d37 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:10.594306 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b72702-43fe-46c5-a547-61c336c62d37 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:10.604438 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314626f-ad65-432d-b89c-4c564a1e1937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:10.605991 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314626f-ad65-432d-b89c-4c564a1e1937 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:10.606648 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314626f-ad65-432d-b89c-4c564a1e1937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:10.608211 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314626f-ad65-432d-b89c-4c564a1e1937 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:10.609483 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3314626f-ad65-432d-b89c-4c564a1e1937 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:10.611853 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3314626f-ad65-432d-b89c-4c564a1e1937 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:10.663340 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 931/1860] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:22:10 2022] POST /identity/v3/projects => generated 385 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:22:10.666442 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4b927-5bea-4cb1-8ef9-c9782f7f2a93 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:10.682392 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4b927-5bea-4cb1-8ef9-c9782f7f2a93 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:10.689508 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:10.777935 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a99d2b-008e-4685-b5b4-cff380917876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:10.778724 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a99d2b-008e-4685-b5b4-cff380917876 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:10.779022 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a99d2b-008e-4685-b5b4-cff380917876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:10.779377 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a99d2b-008e-4685-b5b4-cff380917876 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:10.780040 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a99d2b-008e-4685-b5b4-cff380917876 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:10.787693 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a99d2b-008e-4685-b5b4-cff380917876 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:10.840868 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314626f-ad65-432d-b89c-4c564a1e1937 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:10.847894 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 930/1861] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:22:10 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:22:10.853437 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314626f-ad65-432d-b89c-4c564a1e1937 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:10.862846 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a99d2b-008e-4685-b5b4-cff380917876 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:10.865367 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-43a99d2b-008e-4685-b5b4-cff380917876 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:10.868856 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b29b10-cd98-4108-a46a-c1d87d61ec95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:10.870258 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b29b10-cd98-4108-a46a-c1d87d61ec95 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:10.871483 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b29b10-cd98-4108-a46a-c1d87d61ec95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:10.872154 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b29b10-cd98-4108-a46a-c1d87d61ec95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:10.873875 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b29b10-cd98-4108-a46a-c1d87d61ec95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:10.877823 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b29b10-cd98-4108-a46a-c1d87d61ec95 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:10.883823 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a99d2b-008e-4685-b5b4-cff380917876 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:10.890167 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0051d70e-d976-4dfd-8e4e-e38f3b80476c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:10.891329 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051d70e-d976-4dfd-8e4e-e38f3b80476c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:10.891622 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051d70e-d976-4dfd-8e4e-e38f3b80476c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:10.891907 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051d70e-d976-4dfd-8e4e-e38f3b80476c admin admin] PATH_INFO: `/v3/users/8f3f051405274d19a70daced07f46587` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:10.893421 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0051d70e-d976-4dfd-8e4e-e38f3b80476c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f3f051405274d19a70daced07f46587)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:10.894712 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 932/1862] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:22:10.897320 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0051d70e-d976-4dfd-8e4e-e38f3b80476c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:10.900508 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b29b10-cd98-4108-a46a-c1d87d61ec95 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:10.915783 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b29b10-cd98-4108-a46a-c1d87d61ec95 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:10.924098 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262de6e4-9965-4995-b965-cbc3bfcb1013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:10.925668 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262de6e4-9965-4995-b965-cbc3bfcb1013 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:10.926755 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262de6e4-9965-4995-b965-cbc3bfcb1013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:10.927067 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262de6e4-9965-4995-b965-cbc3bfcb1013 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:10.927968 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262de6e4-9965-4995-b965-cbc3bfcb1013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:10.929874 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262de6e4-9965-4995-b965-cbc3bfcb1013 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:10.944867 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 933/1863] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:22:10.948749 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262de6e4-9965-4995-b965-cbc3bfcb1013 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:10.961203 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262de6e4-9965-4995-b965-cbc3bfcb1013 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:10.969190 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8931b39-888c-4e6a-b1a9-3fa7279b6296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:10.970445 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8931b39-888c-4e6a-b1a9-3fa7279b6296 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:10.970736 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8931b39-888c-4e6a-b1a9-3fa7279b6296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:10.971013 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8931b39-888c-4e6a-b1a9-3fa7279b6296 admin admin] PATH_INFO: `/v3/projects/a67f73b267b84a74af617f7427448f2e/users/406009ec18534260bd467e4c85e1226c/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:10.977388 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0051d70e-d976-4dfd-8e4e-e38f3b80476c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f3f051405274d19a70daced07f46587'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:10.978526 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0051d70e-d976-4dfd-8e4e-e38f3b80476c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f3f051405274d19a70daced07f46587'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:10.979523 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0051d70e-d976-4dfd-8e4e-e38f3b80476c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f3f051405274d19a70daced07f46587'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:10.995560 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8931b39-888c-4e6a-b1a9-3fa7279b6296 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a67f73b267b84a74af617f7427448f2e, user_id=406009ec18534260bd467e4c85e1226c, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:10.995998 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0051d70e-d976-4dfd-8e4e-e38f3b80476c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f3f051405274d19a70daced07f46587'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:11.004238 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8931b39-888c-4e6a-b1a9-3fa7279b6296 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:11.006187 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0051d70e-d976-4dfd-8e4e-e38f3b80476c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f3f051405274d19a70daced07f46587'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:11.032282 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 931/1865] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:22:10 2022] DELETE /identity/v3/users/8f3f051405274d19a70daced07f46587 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:22:11.032282 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2977fe1-18a4-4205-83b9-1893a31e61b1 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:11.032282 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2977fe1-18a4-4205-83b9-1893a31e61b1 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:11.032282 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2977fe1-18a4-4205-83b9-1893a31e61b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:11.033421 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 934/1865] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:22:10 2022] PUT /identity/v3/projects/a67f73b267b84a74af617f7427448f2e/users/406009ec18534260bd467e4c85e1226c/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:22:11.035804 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcf726-4f08-4d30-bba4-86f1333adac3 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:11.036484 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcf726-4f08-4d30-bba4-86f1333adac3 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:11.050710 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c2977fe1-18a4-4205-83b9-1893a31e61b1 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:22:11.051046 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcf726-4f08-4d30-bba4-86f1333adac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:11.051943 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c2977fe1-18a4-4205-83b9-1893a31e61b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:11.087748 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:11.103215 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-d0bcf726-4f08-4d30-bba4-86f1333adac3 None None] MFA Rules not processed for user `406009ec18534260bd467e4c85e1226c`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:22:11.105672 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-d0bcf726-4f08-4d30-bba4-86f1333adac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:11.134670 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 932/1866] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:22:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:22:11.145157 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2977fe1-18a4-4205-83b9-1893a31e61b1 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:11.148270 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c2977fe1-18a4-4205-83b9-1893a31e61b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:11.168306 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:11.200184 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 935/1867] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:22:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:22:11.204411 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bcf726-4f08-4d30-bba4-86f1333adac3 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:11.205766 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-d0bcf726-4f08-4d30-bba4-86f1333adac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:11.221647 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bcf726-4f08-4d30-bba4-86f1333adac3 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:11.227074 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd12bc7-ebf0-4799-b765-b696b8022a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:11.227743 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd12bc7-ebf0-4799-b765-b696b8022a12 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:11.228066 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd12bc7-ebf0-4799-b765-b696b8022a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:11.228345 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd12bc7-ebf0-4799-b765-b696b8022a12 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:11.228507 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2977fe1-18a4-4205-83b9-1893a31e61b1 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:11.229044 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd12bc7-ebf0-4799-b765-b696b8022a12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:11.230997 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd12bc7-ebf0-4799-b765-b696b8022a12 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:11.233793 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe579e-99f9-4fac-98cd-cddc6d9a2abe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:11.234463 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe579e-99f9-4fac-98cd-cddc6d9a2abe service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:11.234759 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe579e-99f9-4fac-98cd-cddc6d9a2abe service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:11.235070 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe579e-99f9-4fac-98cd-cddc6d9a2abe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:11.247220 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fe579e-99f9-4fac-98cd-cddc6d9a2abe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:11.249272 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fe579e-99f9-4fac-98cd-cddc6d9a2abe service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:11.264075 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 933/1868] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:22:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 20:22:11.284315 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 936/1869] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:22:11 2022] POST /identity/v3/projects => generated 383 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 20:22:11.284687 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe579e-99f9-4fac-98cd-cddc6d9a2abe service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:11.301799 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe579e-99f9-4fac-98cd-cddc6d9a2abe service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:11.395841 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a8dcc-c25a-44c0-be79-8eb084acc55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:11.397394 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a8dcc-c25a-44c0-be79-8eb084acc55c admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:11.398072 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a8dcc-c25a-44c0-be79-8eb084acc55c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:11.398560 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a8dcc-c25a-44c0-be79-8eb084acc55c admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:11.399947 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9a8dcc-c25a-44c0-be79-8eb084acc55c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:11.402205 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9a8dcc-c25a-44c0-be79-8eb084acc55c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:11.429911 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 934/1870] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:22:11 2022] POST /identity/v3/users => generated 298 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:22:11.431305 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd12bc7-ebf0-4799-b765-b696b8022a12 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:11.443995 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd12bc7-ebf0-4799-b765-b696b8022a12 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:11.449909 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6add6ee-5072-4070-a8a5-2a56da435849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:11.450987 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6add6ee-5072-4070-a8a5-2a56da435849 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:11.451275 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6add6ee-5072-4070-a8a5-2a56da435849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:11.451562 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6add6ee-5072-4070-a8a5-2a56da435849 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:11.454532 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6add6ee-5072-4070-a8a5-2a56da435849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:11.454532 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6add6ee-5072-4070-a8a5-2a56da435849 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:11.471137 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 937/1871] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:22:11 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:22:11.471956 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a8dcc-c25a-44c0-be79-8eb084acc55c admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:11.483160 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a8dcc-c25a-44c0-be79-8eb084acc55c admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:11.487824 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d8b01-5b0b-4dc1-a2f1-d43c30dc8253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:11.488751 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d8b01-5b0b-4dc1-a2f1-d43c30dc8253 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:11.489033 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d8b01-5b0b-4dc1-a2f1-d43c30dc8253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:11.489310 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d8b01-5b0b-4dc1-a2f1-d43c30dc8253 admin admin] PATH_INFO: `/v3/projects/72a232e13b404234afcea7c8e521195f/users/f6d6f8980e9b41cd921c12aaa9417860/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:11.521611 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d8b01-5b0b-4dc1-a2f1-d43c30dc8253 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72a232e13b404234afcea7c8e521195f, user_id=f6d6f8980e9b41cd921c12aaa9417860, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:11.525242 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d8b01-5b0b-4dc1-a2f1-d43c30dc8253 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:11.550878 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 935/1872] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:22:11 2022] PUT /identity/v3/projects/72a232e13b404234afcea7c8e521195f/users/f6d6f8980e9b41cd921c12aaa9417860/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:22:11.552160 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6add6ee-5072-4070-a8a5-2a56da435849 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:11.564430 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6add6ee-5072-4070-a8a5-2a56da435849 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:11.632670 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bae591-d26b-4838-9af8-4d5c16aa310f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:11.633557 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bae591-d26b-4838-9af8-4d5c16aa310f admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:11.633867 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bae591-d26b-4838-9af8-4d5c16aa310f admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:11.634222 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bae591-d26b-4838-9af8-4d5c16aa310f admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:11.635044 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bae591-d26b-4838-9af8-4d5c16aa310f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:11.636930 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bae591-d26b-4838-9af8-4d5c16aa310f admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:11.651425 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 938/1873] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:22:11 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:22:11.652245 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d8b01-5b0b-4dc1-a2f1-d43c30dc8253 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:11.664202 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d8b01-5b0b-4dc1-a2f1-d43c30dc8253 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:11.671205 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d530ba7-69b3-44a0-8c70-38762451dd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:11.672240 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d530ba7-69b3-44a0-8c70-38762451dd23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:11.672588 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d530ba7-69b3-44a0-8c70-38762451dd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:11.672948 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d530ba7-69b3-44a0-8c70-38762451dd23 admin admin] PATH_INFO: `/v3/projects/72a232e13b404234afcea7c8e521195f/users/f6d6f8980e9b41cd921c12aaa9417860/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:11.675042 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d530ba7-69b3-44a0-8c70-38762451dd23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72a232e13b404234afcea7c8e521195f, user_id=f6d6f8980e9b41cd921c12aaa9417860, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:11.677818 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d530ba7-69b3-44a0-8c70-38762451dd23 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:11.689234 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 936/1874] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:22:11 2022] PUT /identity/v3/projects/72a232e13b404234afcea7c8e521195f/users/f6d6f8980e9b41cd921c12aaa9417860/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:22:11.700143 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a1a72-62ea-4284-b3c4-12588439b295 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:11.701109 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a1a72-62ea-4284-b3c4-12588439b295 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:11.701329 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a1a72-62ea-4284-b3c4-12588439b295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:11.732857 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-5f3a1a72-62ea-4284-b3c4-12588439b295 None None] MFA Rules not processed for user `f6d6f8980e9b41cd921c12aaa9417860`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:22:11.734381 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-5f3a1a72-62ea-4284-b3c4-12588439b295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:11.745311 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d530ba7-69b3-44a0-8c70-38762451dd23 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:11.747217 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3d530ba7-69b3-44a0-8c70-38762451dd23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:11.793078 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:11.820318 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d530ba7-69b3-44a0-8c70-38762451dd23 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:11.822323 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 939/1875] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:22:11 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:22:11.825121 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d336e-e615-48ea-886b-d661d5d67b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:11.826587 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d336e-e615-48ea-886b-d661d5d67b09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:11.826943 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d336e-e615-48ea-886b-d661d5d67b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:11.827309 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d336e-e615-48ea-886b-d661d5d67b09 admin admin] PATH_INFO: `/v3/projects/fe042238c02e4455a6ae4a30665f4dcf` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:11.828666 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4d336e-e615-48ea-886b-d661d5d67b09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe042238c02e4455a6ae4a30665f4dcf)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:11.830678 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4d336e-e615-48ea-886b-d661d5d67b09 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:11.834565 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a1a72-62ea-4284-b3c4-12588439b295 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:11.836198 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-5f3a1a72-62ea-4284-b3c4-12588439b295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:11.850668 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:11.897650 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fc4d336e-e615-48ea-886b-d661d5d67b09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe042238c02e4455a6ae4a30665f4dcf', 'request_id': 'req-fc4d336e-e615-48ea-886b-d661d5d67b09'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:11.916214 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fc4d336e-e615-48ea-886b-d661d5d67b09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe042238c02e4455a6ae4a30665f4dcf', 'request_id': 'req-fc4d336e-e615-48ea-886b-d661d5d67b09'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:11.919897 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a1a72-62ea-4284-b3c4-12588439b295 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:11.923907 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fc4d336e-e615-48ea-886b-d661d5d67b09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe042238c02e4455a6ae4a30665f4dcf', 'request_id': 'req-fc4d336e-e615-48ea-886b-d661d5d67b09'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:11.939126 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fc4d336e-e615-48ea-886b-d661d5d67b09 admin admin] The token cache is being invalidate because project fe042238c02e4455a6ae4a30665f4dcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:22:11.939429 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fc4d336e-e615-48ea-886b-d661d5d67b09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:11.940225 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fc4d336e-e615-48ea-886b-d661d5d67b09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:11.942068 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 937/1876] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:22:11 2022] DELETE /identity/v3/projects/fe042238c02e4455a6ae4a30665f4dcf => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:22:11.945618 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d336e-e615-48ea-886b-d661d5d67b09 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:11.947025 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-fc4d336e-e615-48ea-886b-d661d5d67b09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:11.980883 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4aba6e-ff0e-489e-a644-3df69f1bf332 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:11.981616 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4aba6e-ff0e-489e-a644-3df69f1bf332 service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:11.981897 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4aba6e-ff0e-489e-a644-3df69f1bf332 service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:11.982178 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4aba6e-ff0e-489e-a644-3df69f1bf332 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:11.984007 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-5a4aba6e-ff0e-489e-a644-3df69f1bf332 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:12.019987 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d336e-e615-48ea-886b-d661d5d67b09 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:12.025503 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76946ec9-c8e7-4809-b57f-a95b6ab6a9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:12.026993 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76946ec9-c8e7-4809-b57f-a95b6ab6a9d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:12.027283 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76946ec9-c8e7-4809-b57f-a95b6ab6a9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:12.027564 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76946ec9-c8e7-4809-b57f-a95b6ab6a9d8 admin admin] PATH_INFO: `/v3/users/a4a86d9cadb84f98a232ed35a1730432` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:12.028892 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76946ec9-c8e7-4809-b57f-a95b6ab6a9d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4a86d9cadb84f98a232ed35a1730432)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:12.030948 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76946ec9-c8e7-4809-b57f-a95b6ab6a9d8 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:12.048768 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4aba6e-ff0e-489e-a644-3df69f1bf332 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:12.050317 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4aba6e-ff0e-489e-a644-3df69f1bf332 service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:12.062100 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 940/1877] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:22:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 20:22:12.090430 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-76946ec9-c8e7-4809-b57f-a95b6ab6a9d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4a86d9cadb84f98a232ed35a1730432'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:12.091514 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-76946ec9-c8e7-4809-b57f-a95b6ab6a9d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4a86d9cadb84f98a232ed35a1730432'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:12.092481 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-76946ec9-c8e7-4809-b57f-a95b6ab6a9d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4a86d9cadb84f98a232ed35a1730432'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:12.107227 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-76946ec9-c8e7-4809-b57f-a95b6ab6a9d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4a86d9cadb84f98a232ed35a1730432'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:12.116053 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-76946ec9-c8e7-4809-b57f-a95b6ab6a9d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4a86d9cadb84f98a232ed35a1730432'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:12.130949 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 938/1878] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:22:11 2022] DELETE /identity/v3/users/a4a86d9cadb84f98a232ed35a1730432 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:22:12.475502 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4aba6e-ff0e-489e-a644-3df69f1bf332 service cinder] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:12.499779 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4aba6e-ff0e-489e-a644-3df69f1bf332 service cinder] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:12.577842 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:12.584318 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9390c7a-9abc-4f7d-8ac7-3445dd4143cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:12.585207 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9390c7a-9abc-4f7d-8ac7-3445dd4143cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:12.585497 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9390c7a-9abc-4f7d-8ac7-3445dd4143cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:12.585781 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9390c7a-9abc-4f7d-8ac7-3445dd4143cd admin admin] PATH_INFO: `/v3/projects/21331f304148478d938a79b0a4badc6b` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:12.587012 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9390c7a-9abc-4f7d-8ac7-3445dd4143cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=21331f304148478d938a79b0a4badc6b)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:12.589373 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9390c7a-9abc-4f7d-8ac7-3445dd4143cd admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:12.649511 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-e9390c7a-9abc-4f7d-8ac7-3445dd4143cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21331f304148478d938a79b0a4badc6b', 'request_id': 'req-e9390c7a-9abc-4f7d-8ac7-3445dd4143cd'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:12.656072 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-e9390c7a-9abc-4f7d-8ac7-3445dd4143cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21331f304148478d938a79b0a4badc6b', 'request_id': 'req-e9390c7a-9abc-4f7d-8ac7-3445dd4143cd'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:12.663546 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-e9390c7a-9abc-4f7d-8ac7-3445dd4143cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21331f304148478d938a79b0a4badc6b', 'request_id': 'req-e9390c7a-9abc-4f7d-8ac7-3445dd4143cd'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:12.675106 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-e9390c7a-9abc-4f7d-8ac7-3445dd4143cd admin admin] The token cache is being invalidate because project 21331f304148478d938a79b0a4badc6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:22:12.675395 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-e9390c7a-9abc-4f7d-8ac7-3445dd4143cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:12.676060 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-e9390c7a-9abc-4f7d-8ac7-3445dd4143cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:12.677885 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 941/1879] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:22:12 2022] DELETE /identity/v3/projects/21331f304148478d938a79b0a4badc6b => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:22:12.682750 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3b0b2-ab0c-40a4-97cb-e95235a236ba None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:12.683230 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3b0b2-ab0c-40a4-97cb-e95235a236ba None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:12.683455 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3b0b2-ab0c-40a4-97cb-e95235a236ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:12.706658 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c1c3b0b2-ab0c-40a4-97cb-e95235a236ba None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:22:12.708680 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c1c3b0b2-ab0c-40a4-97cb-e95235a236ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:12.721206 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:12.792977 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 939/1880] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:22:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:22:12.801352 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ac318-0a88-4d80-910f-9acddfff4c32 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:12.801581 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ac318-0a88-4d80-910f-9acddfff4c32 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:12.801836 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ac318-0a88-4d80-910f-9acddfff4c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:12.821263 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-fd4ac318-0a88-4d80-910f-9acddfff4c32 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:22:12.822706 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-fd4ac318-0a88-4d80-910f-9acddfff4c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:12.832654 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 942/1881] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:22:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:22:12.840249 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c3b0b2-ab0c-40a4-97cb-e95235a236ba None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:12.856026 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c3b0b2-ab0c-40a4-97cb-e95235a236ba None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:12.863122 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e20a5-050e-48ef-85a9-24e57dbdfb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:12.864100 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e20a5-050e-48ef-85a9-24e57dbdfb53 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:12.864424 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e20a5-050e-48ef-85a9-24e57dbdfb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:12.864746 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e20a5-050e-48ef-85a9-24e57dbdfb53 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:12.865501 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e20a5-050e-48ef-85a9-24e57dbdfb53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:22:12.865819 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e20a5-050e-48ef-85a9-24e57dbdfb53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:12.867987 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e20a5-050e-48ef-85a9-24e57dbdfb53 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:12.882751 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 940/1882] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:22:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:22:12.886858 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ac318-0a88-4d80-910f-9acddfff4c32 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:12.897435 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ac318-0a88-4d80-910f-9acddfff4c32 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:12.902634 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45560c66-8160-447e-ae77-6e8a086ec935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:12.904005 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45560c66-8160-447e-ae77-6e8a086ec935 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:12.904238 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45560c66-8160-447e-ae77-6e8a086ec935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:12.904520 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45560c66-8160-447e-ae77-6e8a086ec935 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:12.905215 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45560c66-8160-447e-ae77-6e8a086ec935 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:12.907115 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45560c66-8160-447e-ae77-6e8a086ec935 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:12.941014 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 943/1883] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:22:12 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:22:12.942787 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e20a5-050e-48ef-85a9-24e57dbdfb53 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:12.972292 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e20a5-050e-48ef-85a9-24e57dbdfb53 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:13.030066 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab91fc-ec18-49ab-95e1-26ffe617dafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:13.030752 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab91fc-ec18-49ab-95e1-26ffe617dafb admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:13.031043 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab91fc-ec18-49ab-95e1-26ffe617dafb admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:13.031326 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab91fc-ec18-49ab-95e1-26ffe617dafb admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:13.032053 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ab91fc-ec18-49ab-95e1-26ffe617dafb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:13.033965 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ab91fc-ec18-49ab-95e1-26ffe617dafb admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:13.055094 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 941/1884] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:22:12 2022] POST /identity/v3/users => generated 292 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:22:13.059084 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45560c66-8160-447e-ae77-6e8a086ec935 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:13.069453 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45560c66-8160-447e-ae77-6e8a086ec935 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:13.074054 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df2dc9-4f03-4ee9-86fd-4d5063d7fddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:13.074754 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df2dc9-4f03-4ee9-86fd-4d5063d7fddc admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:13.075050 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df2dc9-4f03-4ee9-86fd-4d5063d7fddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:13.075846 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df2dc9-4f03-4ee9-86fd-4d5063d7fddc admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:13.076608 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71df2dc9-4f03-4ee9-86fd-4d5063d7fddc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:13.078199 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71df2dc9-4f03-4ee9-86fd-4d5063d7fddc admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:13.088672 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 944/1885] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:22:13.093073 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab91fc-ec18-49ab-95e1-26ffe617dafb admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:13.103020 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab91fc-ec18-49ab-95e1-26ffe617dafb admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:13.107800 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57db018-784c-424c-bc1c-4bc36d257a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:13.108506 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57db018-784c-424c-bc1c-4bc36d257a4e admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:13.108827 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57db018-784c-424c-bc1c-4bc36d257a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:13.109269 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57db018-784c-424c-bc1c-4bc36d257a4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:13.110047 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57db018-784c-424c-bc1c-4bc36d257a4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:13.111634 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57db018-784c-424c-bc1c-4bc36d257a4e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:13.121667 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 942/1886] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:22:13.125686 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df2dc9-4f03-4ee9-86fd-4d5063d7fddc admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:13.135469 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df2dc9-4f03-4ee9-86fd-4d5063d7fddc admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:13.140617 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f3897-34c6-4784-ab95-38a1d88d3a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:13.141487 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f3897-34c6-4784-ab95-38a1d88d3a12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:13.141774 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f3897-34c6-4784-ab95-38a1d88d3a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:13.142055 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f3897-34c6-4784-ab95-38a1d88d3a12 admin admin] PATH_INFO: `/v3/projects/c883ed93b647448c8ef629b4455ca354/users/ef87b286ac6e48628234231b11325d95/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:13.156674 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f3897-34c6-4784-ab95-38a1d88d3a12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c883ed93b647448c8ef629b4455ca354, user_id=ef87b286ac6e48628234231b11325d95, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:13.159309 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f3897-34c6-4784-ab95-38a1d88d3a12 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:13.172256 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 945/1887] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:22:13 2022] PUT /identity/v3/projects/c883ed93b647448c8ef629b4455ca354/users/ef87b286ac6e48628234231b11325d95/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:22:13.182545 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a38e7-a4c7-4ba9-86e2-cd64ffbe192b None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:13.182840 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a38e7-a4c7-4ba9-86e2-cd64ffbe192b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:13.183123 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a38e7-a4c7-4ba9-86e2-cd64ffbe192b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:13.210463 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-0b9a38e7-a4c7-4ba9-86e2-cd64ffbe192b None None] MFA Rules not processed for user `ef87b286ac6e48628234231b11325d95`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:22:13.211664 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0b9a38e7-a4c7-4ba9-86e2-cd64ffbe192b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:13.276213 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 943/1888] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:22:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:22:13.288549 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f3897-34c6-4784-ab95-38a1d88d3a12 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:13.291533 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-0f5f3897-34c6-4784-ab95-38a1d88d3a12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:13.349917 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f3897-34c6-4784-ab95-38a1d88d3a12 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:13.353712 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80944a25-57bd-4569-bcaa-02cddd8ad014 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:13.354357 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80944a25-57bd-4569-bcaa-02cddd8ad014 service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:13.354644 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80944a25-57bd-4569-bcaa-02cddd8ad014 service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:13.354923 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80944a25-57bd-4569-bcaa-02cddd8ad014 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:13.365083 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80944a25-57bd-4569-bcaa-02cddd8ad014 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:13.366682 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80944a25-57bd-4569-bcaa-02cddd8ad014 service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:13.376026 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 946/1889] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:22:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:22:16.179710 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a38e7-a4c7-4ba9-86e2-cd64ffbe192b None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:16.192035 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:16.243837 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a38e7-a4c7-4ba9-86e2-cd64ffbe192b None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:16.248310 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e305311-c903-4384-bbba-ae121a5c5425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:16.249218 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e305311-c903-4384-bbba-ae121a5c5425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:16.249507 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e305311-c903-4384-bbba-ae121a5c5425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:16.249789 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e305311-c903-4384-bbba-ae121a5c5425 admin admin] PATH_INFO: `/v3/users/ef87b286ac6e48628234231b11325d95` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:16.250979 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e305311-c903-4384-bbba-ae121a5c5425 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef87b286ac6e48628234231b11325d95)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:16.252924 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e305311-c903-4384-bbba-ae121a5c5425 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:16.300101 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2e305311-c903-4384-bbba-ae121a5c5425 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef87b286ac6e48628234231b11325d95'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:16.300768 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2e305311-c903-4384-bbba-ae121a5c5425 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef87b286ac6e48628234231b11325d95'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:16.301400 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2e305311-c903-4384-bbba-ae121a5c5425 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef87b286ac6e48628234231b11325d95'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:16.313768 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2e305311-c903-4384-bbba-ae121a5c5425 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef87b286ac6e48628234231b11325d95'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:16.323312 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2e305311-c903-4384-bbba-ae121a5c5425 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef87b286ac6e48628234231b11325d95'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:16.342828 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 944/1890] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:22:16 2022] DELETE /identity/v3/users/ef87b286ac6e48628234231b11325d95 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:22:16.347373 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7db6d1-aa9d-4b56-8239-a1ff43cacf57 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:16.347952 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7db6d1-aa9d-4b56-8239-a1ff43cacf57 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:16.348695 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7db6d1-aa9d-4b56-8239-a1ff43cacf57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:16.366120 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-ac7db6d1-aa9d-4b56-8239-a1ff43cacf57 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:22:16.367333 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-ac7db6d1-aa9d-4b56-8239-a1ff43cacf57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:16.390237 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:16.443566 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 947/1891] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:22:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:22:16.456222 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e305311-c903-4384-bbba-ae121a5c5425 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:16.458171 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2e305311-c903-4384-bbba-ae121a5c5425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:16.522954 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e305311-c903-4384-bbba-ae121a5c5425 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:16.527054 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d8995a-b284-4719-8786-cecc3ffda121 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:16.527725 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8995a-b284-4719-8786-cecc3ffda121 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:16.528046 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8995a-b284-4719-8786-cecc3ffda121 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:16.528463 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8995a-b284-4719-8786-cecc3ffda121 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:16.539534 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d8995a-b284-4719-8786-cecc3ffda121 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:16.541031 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d8995a-b284-4719-8786-cecc3ffda121 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:16.552892 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 945/1892] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:22:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:22:16.889971 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7db6d1-aa9d-4b56-8239-a1ff43cacf57 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:16.891474 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-ac7db6d1-aa9d-4b56-8239-a1ff43cacf57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:16.966137 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7db6d1-aa9d-4b56-8239-a1ff43cacf57 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:16.971026 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6171e-7d0a-49cc-b442-4f0887fc7691 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:16.971704 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6171e-7d0a-49cc-b442-4f0887fc7691 service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:16.972099 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6171e-7d0a-49cc-b442-4f0887fc7691 service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:16.972658 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6171e-7d0a-49cc-b442-4f0887fc7691 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:16.974797 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-d5f6171e-7d0a-49cc-b442-4f0887fc7691 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:17.074539 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d8995a-b284-4719-8786-cecc3ffda121 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:17.076168 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-46d8995a-b284-4719-8786-cecc3ffda121 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:17.091539 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f6171e-7d0a-49cc-b442-4f0887fc7691 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:17.093104 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f6171e-7d0a-49cc-b442-4f0887fc7691 service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:17.097191 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d8995a-b284-4719-8786-cecc3ffda121 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:17.107384 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7cf167-db64-4a09-9252-ea309b4628cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:17.108648 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cf167-db64-4a09-9252-ea309b4628cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:17.109387 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cf167-db64-4a09-9252-ea309b4628cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:17.111119 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cf167-db64-4a09-9252-ea309b4628cd admin admin] PATH_INFO: `/v3/projects/c883ed93b647448c8ef629b4455ca354` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:17.113510 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7cf167-db64-4a09-9252-ea309b4628cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c883ed93b647448c8ef629b4455ca354)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:17.115909 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 948/1893] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:22:16 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:22:17.116373 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7cf167-db64-4a09-9252-ea309b4628cd admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:17.154250 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:17.178975 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-4e7cf167-db64-4a09-9252-ea309b4628cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c883ed93b647448c8ef629b4455ca354', 'request_id': 'req-4e7cf167-db64-4a09-9252-ea309b4628cd'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:17.189111 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-4e7cf167-db64-4a09-9252-ea309b4628cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c883ed93b647448c8ef629b4455ca354', 'request_id': 'req-4e7cf167-db64-4a09-9252-ea309b4628cd'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:17.195496 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-4e7cf167-db64-4a09-9252-ea309b4628cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c883ed93b647448c8ef629b4455ca354', 'request_id': 'req-4e7cf167-db64-4a09-9252-ea309b4628cd'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:17.210674 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-4e7cf167-db64-4a09-9252-ea309b4628cd admin admin] The token cache is being invalidate because project c883ed93b647448c8ef629b4455ca354 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:22:17.210916 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-4e7cf167-db64-4a09-9252-ea309b4628cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:17.211876 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-4e7cf167-db64-4a09-9252-ea309b4628cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:17.217664 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 946/1894] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:22:17 2022] DELETE /identity/v3/projects/c883ed93b647448c8ef629b4455ca354 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:22:17.219859 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2e9aa-2c3c-40de-9e99-60289da56893 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:17.220286 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2e9aa-2c3c-40de-9e99-60289da56893 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:17.220671 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2e9aa-2c3c-40de-9e99-60289da56893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:17.251351 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-d9f2e9aa-2c3c-40de-9e99-60289da56893 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:22:17.253144 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-d9f2e9aa-2c3c-40de-9e99-60289da56893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:17.339035 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 949/1895] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:22:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:22:17.349294 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9ac52-ea6b-4f88-ab0c-1681b39c7442 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:17.349589 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9ac52-ea6b-4f88-ab0c-1681b39c7442 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:17.349875 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9ac52-ea6b-4f88-ab0c-1681b39c7442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:17.369091 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-cdb9ac52-ea6b-4f88-ab0c-1681b39c7442 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:22:17.370328 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-cdb9ac52-ea6b-4f88-ab0c-1681b39c7442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:17.378334 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 947/1896] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:22:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:22:17.382656 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f2e9aa-2c3c-40de-9e99-60289da56893 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:17.395400 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f2e9aa-2c3c-40de-9e99-60289da56893 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:17.400237 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b40afc-c8a0-4205-bdb7-37091c5edda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:17.400928 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b40afc-c8a0-4205-bdb7-37091c5edda3 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:17.401211 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b40afc-c8a0-4205-bdb7-37091c5edda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:17.401491 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b40afc-c8a0-4205-bdb7-37091c5edda3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:17.402256 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b40afc-c8a0-4205-bdb7-37091c5edda3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:22:17.402566 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b40afc-c8a0-4205-bdb7-37091c5edda3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:17.404702 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b40afc-c8a0-4205-bdb7-37091c5edda3 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:17.417129 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 950/1897] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:22:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:22:17.422353 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb9ac52-ea6b-4f88-ab0c-1681b39c7442 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:17.438674 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb9ac52-ea6b-4f88-ab0c-1681b39c7442 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:17.444225 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85041abd-83ac-4d99-b701-dcc516f15284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:17.445116 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85041abd-83ac-4d99-b701-dcc516f15284 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:17.445478 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85041abd-83ac-4d99-b701-dcc516f15284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:17.445827 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85041abd-83ac-4d99-b701-dcc516f15284 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:17.446953 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85041abd-83ac-4d99-b701-dcc516f15284 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:17.449136 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85041abd-83ac-4d99-b701-dcc516f15284 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:17.485708 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 948/1898] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:22:17 2022] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:22:17.489343 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b40afc-c8a0-4205-bdb7-37091c5edda3 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:17.497751 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:17.507426 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b40afc-c8a0-4205-bdb7-37091c5edda3 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:17.574692 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1f330-6e62-4161-aaf6-98d1aba02f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:17.576087 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1f330-6e62-4161-aaf6-98d1aba02f7d admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:17.576384 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1f330-6e62-4161-aaf6-98d1aba02f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:17.576665 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1f330-6e62-4161-aaf6-98d1aba02f7d admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:17.577396 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb1f330-6e62-4161-aaf6-98d1aba02f7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:17.579463 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb1f330-6e62-4161-aaf6-98d1aba02f7d admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:17.602927 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 951/1899] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:22:17 2022] POST /identity/v3/users => generated 287 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:22:17.606800 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85041abd-83ac-4d99-b701-dcc516f15284 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:17.619193 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85041abd-83ac-4d99-b701-dcc516f15284 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:17.624902 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5186801-d567-4c8f-85b7-b290457b3573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:17.625587 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5186801-d567-4c8f-85b7-b290457b3573 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:17.625876 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5186801-d567-4c8f-85b7-b290457b3573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:17.626160 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5186801-d567-4c8f-85b7-b290457b3573 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:17.626901 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5186801-d567-4c8f-85b7-b290457b3573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:17.628551 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5186801-d567-4c8f-85b7-b290457b3573 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:17.640737 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 949/1900] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:22:17.644614 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1f330-6e62-4161-aaf6-98d1aba02f7d admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:17.655305 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1f330-6e62-4161-aaf6-98d1aba02f7d admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:17.660033 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d38db-bec2-4426-a3f9-f36d646d1bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:17.660700 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d38db-bec2-4426-a3f9-f36d646d1bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:17.660990 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d38db-bec2-4426-a3f9-f36d646d1bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:17.661273 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d38db-bec2-4426-a3f9-f36d646d1bb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:17.662014 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978d38db-bec2-4426-a3f9-f36d646d1bb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:17.663609 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978d38db-bec2-4426-a3f9-f36d646d1bb0 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:17.673644 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 952/1901] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:22:17.677649 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5186801-d567-4c8f-85b7-b290457b3573 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:17.687683 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5186801-d567-4c8f-85b7-b290457b3573 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:17.693651 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a82f5-44e3-42b6-b548-0206d599b738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:17.694864 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a82f5-44e3-42b6-b548-0206d599b738 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:17.695378 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a82f5-44e3-42b6-b548-0206d599b738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:17.695718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a82f5-44e3-42b6-b548-0206d599b738 admin admin] PATH_INFO: `/v3/projects/b72e909d7bd941e99ee609f04b13f8d0/users/83a20c7cec4b4f85a0f1f79a309f1da4/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:17.711379 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a82f5-44e3-42b6-b548-0206d599b738 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b72e909d7bd941e99ee609f04b13f8d0, user_id=83a20c7cec4b4f85a0f1f79a309f1da4, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:17.714724 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a82f5-44e3-42b6-b548-0206d599b738 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:17.731148 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 950/1902] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:22:17 2022] PUT /identity/v3/projects/b72e909d7bd941e99ee609f04b13f8d0/users/83a20c7cec4b4f85a0f1f79a309f1da4/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:22:17.741353 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1793088-27b2-44a1-aafe-19e1fd0e5142 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:17.741653 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1793088-27b2-44a1-aafe-19e1fd0e5142 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:17.741955 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1793088-27b2-44a1-aafe-19e1fd0e5142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:17.772677 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-a1793088-27b2-44a1-aafe-19e1fd0e5142 None None] MFA Rules not processed for user `83a20c7cec4b4f85a0f1f79a309f1da4`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:22:17.774422 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-a1793088-27b2-44a1-aafe-19e1fd0e5142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:17.869569 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 953/1903] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:22:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:22:17.886826 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a82f5-44e3-42b6-b548-0206d599b738 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:17.889230 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-365a82f5-44e3-42b6-b548-0206d599b738 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:17.959548 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a82f5-44e3-42b6-b548-0206d599b738 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:17.963968 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d5926a-5225-4c64-a835-c137297d3141 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:17.964775 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5926a-5225-4c64-a835-c137297d3141 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:17.965161 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5926a-5225-4c64-a835-c137297d3141 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:17.965540 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5926a-5225-4c64-a835-c137297d3141 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:17.975175 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d5926a-5225-4c64-a835-c137297d3141 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:17.976822 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d5926a-5225-4c64-a835-c137297d3141 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:17.986910 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 951/1904] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:22:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:22:18.012081 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1793088-27b2-44a1-aafe-19e1fd0e5142 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:18.095463 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1793088-27b2-44a1-aafe-19e1fd0e5142 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:18.100859 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b177632-5f8d-4958-9668-450b83a5a5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:18.101799 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b177632-5f8d-4958-9668-450b83a5a5c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:18.102086 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b177632-5f8d-4958-9668-450b83a5a5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:18.103695 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b177632-5f8d-4958-9668-450b83a5a5c0 admin admin] PATH_INFO: `/v3/users/83a20c7cec4b4f85a0f1f79a309f1da4` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:18.105790 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b177632-5f8d-4958-9668-450b83a5a5c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83a20c7cec4b4f85a0f1f79a309f1da4)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:18.108016 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b177632-5f8d-4958-9668-450b83a5a5c0 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:18.125370 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:18.192592 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-3b177632-5f8d-4958-9668-450b83a5a5c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83a20c7cec4b4f85a0f1f79a309f1da4'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:18.193581 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-3b177632-5f8d-4958-9668-450b83a5a5c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83a20c7cec4b4f85a0f1f79a309f1da4'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:18.210507 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-3b177632-5f8d-4958-9668-450b83a5a5c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83a20c7cec4b4f85a0f1f79a309f1da4'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:18.225334 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-3b177632-5f8d-4958-9668-450b83a5a5c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83a20c7cec4b4f85a0f1f79a309f1da4'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:18.226304 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-3b177632-5f8d-4958-9668-450b83a5a5c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83a20c7cec4b4f85a0f1f79a309f1da4'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:18.242615 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 954/1905] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:22:18 2022] DELETE /identity/v3/users/83a20c7cec4b4f85a0f1f79a309f1da4 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:22:18.247605 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc4b0a-00a3-4104-b1fb-41dd882cd926 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:18.248370 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc4b0a-00a3-4104-b1fb-41dd882cd926 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:18.248738 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc4b0a-00a3-4104-b1fb-41dd882cd926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:18.267155 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-19bc4b0a-00a3-4104-b1fb-41dd882cd926 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:22:18.268592 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-19bc4b0a-00a3-4104-b1fb-41dd882cd926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:18.319600 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:18.334769 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 952/1906] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:22:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 20:22:18.344666 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b177632-5f8d-4958-9668-450b83a5a5c0 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:18.346111 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-3b177632-5f8d-4958-9668-450b83a5a5c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:18.404395 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b177632-5f8d-4958-9668-450b83a5a5c0 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:18.408605 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59d94dd-fd8e-4706-bcb1-337b5e6c9100 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:18.409277 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d94dd-fd8e-4706-bcb1-337b5e6c9100 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:18.409601 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d94dd-fd8e-4706-bcb1-337b5e6c9100 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:18.409977 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d94dd-fd8e-4706-bcb1-337b5e6c9100 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:18.419688 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59d94dd-fd8e-4706-bcb1-337b5e6c9100 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:18.421144 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59d94dd-fd8e-4706-bcb1-337b5e6c9100 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:18.430589 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 955/1907] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:22:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:22:18.746583 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc4b0a-00a3-4104-b1fb-41dd882cd926 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:18.749205 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-19bc4b0a-00a3-4104-b1fb-41dd882cd926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:18.762991 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc4b0a-00a3-4104-b1fb-41dd882cd926 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:18.768836 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c8c627-06d0-4425-bf31-ac05fdf0805a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:18.769714 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8c627-06d0-4425-bf31-ac05fdf0805a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:18.770009 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8c627-06d0-4425-bf31-ac05fdf0805a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:18.770291 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8c627-06d0-4425-bf31-ac05fdf0805a admin admin] PATH_INFO: `/v3/projects/b72e909d7bd941e99ee609f04b13f8d0` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:18.771645 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c8c627-06d0-4425-bf31-ac05fdf0805a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b72e909d7bd941e99ee609f04b13f8d0)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:18.773729 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c8c627-06d0-4425-bf31-ac05fdf0805a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:18.847838 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f1c8c627-06d0-4425-bf31-ac05fdf0805a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b72e909d7bd941e99ee609f04b13f8d0', 'request_id': 'req-f1c8c627-06d0-4425-bf31-ac05fdf0805a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:18.856085 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f1c8c627-06d0-4425-bf31-ac05fdf0805a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b72e909d7bd941e99ee609f04b13f8d0', 'request_id': 'req-f1c8c627-06d0-4425-bf31-ac05fdf0805a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:18.862504 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f1c8c627-06d0-4425-bf31-ac05fdf0805a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b72e909d7bd941e99ee609f04b13f8d0', 'request_id': 'req-f1c8c627-06d0-4425-bf31-ac05fdf0805a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:18.873627 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f1c8c627-06d0-4425-bf31-ac05fdf0805a admin admin] The token cache is being invalidate because project b72e909d7bd941e99ee609f04b13f8d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:22:18.873914 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f1c8c627-06d0-4425-bf31-ac05fdf0805a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:18.874550 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f1c8c627-06d0-4425-bf31-ac05fdf0805a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:18.876163 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 953/1908] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:22:18 2022] DELETE /identity/v3/projects/b72e909d7bd941e99ee609f04b13f8d0 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:22:18.881060 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692f78d-e5b7-4a6d-87ff-32a0518b24c5 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:18.881352 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692f78d-e5b7-4a6d-87ff-32a0518b24c5 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:18.881633 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692f78d-e5b7-4a6d-87ff-32a0518b24c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:18.899402 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-1692f78d-e5b7-4a6d-87ff-32a0518b24c5 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:22:18.900625 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-1692f78d-e5b7-4a6d-87ff-32a0518b24c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:18.966697 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 956/1909] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:22:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:22:18.974342 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59fc39a-c11e-488d-8306-4e5799874410 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:18.974637 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59fc39a-c11e-488d-8306-4e5799874410 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:18.974970 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59fc39a-c11e-488d-8306-4e5799874410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:18.994447 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-b59fc39a-c11e-488d-8306-4e5799874410 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:22:18.995779 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b59fc39a-c11e-488d-8306-4e5799874410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:19.007779 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 954/1910] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:22:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:22:19.009064 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1692f78d-e5b7-4a6d-87ff-32a0518b24c5 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:19.020026 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1692f78d-e5b7-4a6d-87ff-32a0518b24c5 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:19.025174 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f505f56-041a-4b69-9fa9-a7d9509a9e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:19.025916 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f505f56-041a-4b69-9fa9-a7d9509a9e53 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:19.026269 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f505f56-041a-4b69-9fa9-a7d9509a9e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:19.026658 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f505f56-041a-4b69-9fa9-a7d9509a9e53 admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:19.027597 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f505f56-041a-4b69-9fa9-a7d9509a9e53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:22:19.028507 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f505f56-041a-4b69-9fa9-a7d9509a9e53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:19.030531 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f505f56-041a-4b69-9fa9-a7d9509a9e53 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:19.043409 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 957/1911] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:22:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:22:19.052731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59fc39a-c11e-488d-8306-4e5799874410 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:19.062659 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59fc39a-c11e-488d-8306-4e5799874410 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:19.067614 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14abbd87-560e-46aa-ba89-cdd4b67b2b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:19.068321 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abbd87-560e-46aa-ba89-cdd4b67b2b30 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:19.068613 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abbd87-560e-46aa-ba89-cdd4b67b2b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:19.068892 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abbd87-560e-46aa-ba89-cdd4b67b2b30 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:19.069600 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14abbd87-560e-46aa-ba89-cdd4b67b2b30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:19.071501 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14abbd87-560e-46aa-ba89-cdd4b67b2b30 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:19.101609 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 955/1912] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:22:19 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:22:19.105935 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f505f56-041a-4b69-9fa9-a7d9509a9e53 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:19.116760 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f505f56-041a-4b69-9fa9-a7d9509a9e53 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:19.139301 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:19.185196 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b885d40-1b9c-4feb-96ef-6a3bf4a141d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:19.186198 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b885d40-1b9c-4feb-96ef-6a3bf4a141d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:19.186484 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b885d40-1b9c-4feb-96ef-6a3bf4a141d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:19.186771 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b885d40-1b9c-4feb-96ef-6a3bf4a141d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:19.188018 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b885d40-1b9c-4feb-96ef-6a3bf4a141d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:19.189560 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b885d40-1b9c-4feb-96ef-6a3bf4a141d6 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:19.211595 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 958/1913] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:22:19 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:22:19.216481 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14abbd87-560e-46aa-ba89-cdd4b67b2b30 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:19.227578 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14abbd87-560e-46aa-ba89-cdd4b67b2b30 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:19.232379 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe8c953-b912-48a9-9f45-b3aca00d4cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:19.233072 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8c953-b912-48a9-9f45-b3aca00d4cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:19.233362 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8c953-b912-48a9-9f45-b3aca00d4cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:19.233794 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8c953-b912-48a9-9f45-b3aca00d4cd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:19.234541 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe8c953-b912-48a9-9f45-b3aca00d4cd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:19.236174 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe8c953-b912-48a9-9f45-b3aca00d4cd2 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:19.250741 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 956/1914] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:22:19.252614 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b885d40-1b9c-4feb-96ef-6a3bf4a141d6 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:19.262257 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b885d40-1b9c-4feb-96ef-6a3bf4a141d6 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:19.267710 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f6887-6c41-44ee-97dc-047e7c2cd5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:19.268433 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f6887-6c41-44ee-97dc-047e7c2cd5fe admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:19.268732 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f6887-6c41-44ee-97dc-047e7c2cd5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:19.269006 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f6887-6c41-44ee-97dc-047e7c2cd5fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:19.269753 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58f6887-6c41-44ee-97dc-047e7c2cd5fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:19.271376 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58f6887-6c41-44ee-97dc-047e7c2cd5fe admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:19.284300 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 959/1915] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 20:22:19.288000 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe8c953-b912-48a9-9f45-b3aca00d4cd2 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:19.303703 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe8c953-b912-48a9-9f45-b3aca00d4cd2 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:19.309098 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebbc712-808a-421e-bf63-f295e90fb2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:19.310567 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebbc712-808a-421e-bf63-f295e90fb2bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:19.311229 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebbc712-808a-421e-bf63-f295e90fb2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:19.311706 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebbc712-808a-421e-bf63-f295e90fb2bd admin admin] PATH_INFO: `/v3/projects/da40b0bae0934f559bbe4e46cd25e46e/users/33496add33de4df2904aa0c7c8d48973/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:19.331162 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebbc712-808a-421e-bf63-f295e90fb2bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=da40b0bae0934f559bbe4e46cd25e46e, user_id=33496add33de4df2904aa0c7c8d48973, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:19.334672 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebbc712-808a-421e-bf63-f295e90fb2bd admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:19.367503 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 957/1916] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:22:19 2022] PUT /identity/v3/projects/da40b0bae0934f559bbe4e46cd25e46e/users/33496add33de4df2904aa0c7c8d48973/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:22:19.389959 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c632cb2-faca-490a-86ee-a5751bf7da19 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:19.390485 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c632cb2-faca-490a-86ee-a5751bf7da19 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:19.390768 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c632cb2-faca-490a-86ee-a5751bf7da19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:19.442844 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-6c632cb2-faca-490a-86ee-a5751bf7da19 None None] MFA Rules not processed for user `33496add33de4df2904aa0c7c8d48973`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:22:19.446169 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-6c632cb2-faca-490a-86ee-a5751bf7da19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:19.551985 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 960/1917] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:22:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:22:19.564699 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebbc712-808a-421e-bf63-f295e90fb2bd admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:19.566607 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4ebbc712-808a-421e-bf63-f295e90fb2bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:19.647061 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebbc712-808a-421e-bf63-f295e90fb2bd admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:19.654695 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51003cce-9227-4068-bd89-53be8f8ff4fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:19.655650 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51003cce-9227-4068-bd89-53be8f8ff4fc service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:19.656517 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51003cce-9227-4068-bd89-53be8f8ff4fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:19.656976 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51003cce-9227-4068-bd89-53be8f8ff4fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:19.667217 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51003cce-9227-4068-bd89-53be8f8ff4fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:19.669361 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51003cce-9227-4068-bd89-53be8f8ff4fc service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:19.678996 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 958/1918] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:22:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:22:22.149223 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c632cb2-faca-490a-86ee-a5751bf7da19 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:22.150651 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-6c632cb2-faca-490a-86ee-a5751bf7da19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:22.214545 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c632cb2-faca-490a-86ee-a5751bf7da19 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:22.219665 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f173d03-0bac-49b9-abb2-a9741716bd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:22.220590 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f173d03-0bac-49b9-abb2-a9741716bd85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:22.220876 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f173d03-0bac-49b9-abb2-a9741716bd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:22.221155 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f173d03-0bac-49b9-abb2-a9741716bd85 admin admin] PATH_INFO: `/v3/users/406009ec18534260bd467e4c85e1226c` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:22.222363 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f173d03-0bac-49b9-abb2-a9741716bd85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=406009ec18534260bd467e4c85e1226c)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:22.224326 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f173d03-0bac-49b9-abb2-a9741716bd85 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:22.259942 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:22.274560 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-7f173d03-0bac-49b9-abb2-a9741716bd85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '406009ec18534260bd467e4c85e1226c'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:22.275296 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-7f173d03-0bac-49b9-abb2-a9741716bd85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '406009ec18534260bd467e4c85e1226c'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:22.283197 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-7f173d03-0bac-49b9-abb2-a9741716bd85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '406009ec18534260bd467e4c85e1226c'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:22.296075 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-7f173d03-0bac-49b9-abb2-a9741716bd85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '406009ec18534260bd467e4c85e1226c'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:22.296732 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-7f173d03-0bac-49b9-abb2-a9741716bd85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '406009ec18534260bd467e4c85e1226c'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:22.309085 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 961/1919] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:22:22 2022] DELETE /identity/v3/users/406009ec18534260bd467e4c85e1226c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:22:22.313529 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4375a99-8293-4050-af1a-b0d58ce29f37 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:22.314128 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4375a99-8293-4050-af1a-b0d58ce29f37 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:22.314128 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4375a99-8293-4050-af1a-b0d58ce29f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:22.331631 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e4375a99-8293-4050-af1a-b0d58ce29f37 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:22:22.332873 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e4375a99-8293-4050-af1a-b0d58ce29f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:22.345285 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:22.398293 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 959/1920] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:22:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:22:22.408311 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f173d03-0bac-49b9-abb2-a9741716bd85 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:22.409817 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-7f173d03-0bac-49b9-abb2-a9741716bd85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:22.469480 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f173d03-0bac-49b9-abb2-a9741716bd85 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:22.474621 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00a6dc-981b-4620-9e5f-1570ea616ccf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:22.475491 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00a6dc-981b-4620-9e5f-1570ea616ccf service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:22.475798 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00a6dc-981b-4620-9e5f-1570ea616ccf service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:22.476200 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00a6dc-981b-4620-9e5f-1570ea616ccf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:22.486143 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d00a6dc-981b-4620-9e5f-1570ea616ccf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:22.487709 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d00a6dc-981b-4620-9e5f-1570ea616ccf service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:22.498837 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 962/1921] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:22:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:22:22.879540 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4375a99-8293-4050-af1a-b0d58ce29f37 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:22.883255 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e4375a99-8293-4050-af1a-b0d58ce29f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:22.914822 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4375a99-8293-4050-af1a-b0d58ce29f37 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:22.921084 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a29da1-8a4d-414c-b5d9-b15ece63ee3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:22.922195 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a29da1-8a4d-414c-b5d9-b15ece63ee3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:22.922576 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a29da1-8a4d-414c-b5d9-b15ece63ee3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:22.922786 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a29da1-8a4d-414c-b5d9-b15ece63ee3f admin admin] PATH_INFO: `/v3/projects/a67f73b267b84a74af617f7427448f2e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:22.924258 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a29da1-8a4d-414c-b5d9-b15ece63ee3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a67f73b267b84a74af617f7427448f2e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:22.926256 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a29da1-8a4d-414c-b5d9-b15ece63ee3f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:22.975438 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-06a29da1-8a4d-414c-b5d9-b15ece63ee3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a67f73b267b84a74af617f7427448f2e', 'request_id': 'req-06a29da1-8a4d-414c-b5d9-b15ece63ee3f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:22.983622 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-06a29da1-8a4d-414c-b5d9-b15ece63ee3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a67f73b267b84a74af617f7427448f2e', 'request_id': 'req-06a29da1-8a4d-414c-b5d9-b15ece63ee3f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:22.989234 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-06a29da1-8a4d-414c-b5d9-b15ece63ee3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a67f73b267b84a74af617f7427448f2e', 'request_id': 'req-06a29da1-8a4d-414c-b5d9-b15ece63ee3f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:23.000717 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-06a29da1-8a4d-414c-b5d9-b15ece63ee3f admin admin] The token cache is being invalidate because project a67f73b267b84a74af617f7427448f2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:22:23.001007 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-06a29da1-8a4d-414c-b5d9-b15ece63ee3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:23.001646 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-06a29da1-8a4d-414c-b5d9-b15ece63ee3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:23.003422 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 960/1922] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:22:22 2022] DELETE /identity/v3/projects/a67f73b267b84a74af617f7427448f2e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:22:23.007012 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00a6dc-981b-4620-9e5f-1570ea616ccf service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:23.016756 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00a6dc-981b-4620-9e5f-1570ea616ccf service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:23.086385 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5255a3e-dae8-440d-846c-c0c5f783ec11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:23.087965 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5255a3e-dae8-440d-846c-c0c5f783ec11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:23.088117 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5255a3e-dae8-440d-846c-c0c5f783ec11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:23.088467 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5255a3e-dae8-440d-846c-c0c5f783ec11 admin admin] PATH_INFO: `/v3/users/f6d6f8980e9b41cd921c12aaa9417860` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:23.090026 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5255a3e-dae8-440d-846c-c0c5f783ec11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6d6f8980e9b41cd921c12aaa9417860)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:23.092398 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5255a3e-dae8-440d-846c-c0c5f783ec11 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:23.172327 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-f5255a3e-dae8-440d-846c-c0c5f783ec11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6d6f8980e9b41cd921c12aaa9417860'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:23.174715 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-f5255a3e-dae8-440d-846c-c0c5f783ec11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6d6f8980e9b41cd921c12aaa9417860'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:23.189252 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-f5255a3e-dae8-440d-846c-c0c5f783ec11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6d6f8980e9b41cd921c12aaa9417860'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:23.193978 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:23.221182 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-f5255a3e-dae8-440d-846c-c0c5f783ec11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6d6f8980e9b41cd921c12aaa9417860'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:23.222751 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-f5255a3e-dae8-440d-846c-c0c5f783ec11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6d6f8980e9b41cd921c12aaa9417860'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:23.241497 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 963/1923] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:22:23 2022] DELETE /identity/v3/users/f6d6f8980e9b41cd921c12aaa9417860 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:22:23.670981 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a29da1-8a4d-414c-b5d9-b15ece63ee3f admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:23.672539 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-06a29da1-8a4d-414c-b5d9-b15ece63ee3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:23.719479 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a29da1-8a4d-414c-b5d9-b15ece63ee3f admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:23.900892 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4642f-464c-42f5-b3c8-da52d948597e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:23.901837 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4642f-464c-42f5-b3c8-da52d948597e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:23.902195 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4642f-464c-42f5-b3c8-da52d948597e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:23.902586 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4642f-464c-42f5-b3c8-da52d948597e admin admin] PATH_INFO: `/v3/projects/72a232e13b404234afcea7c8e521195f` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:23.905042 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d4642f-464c-42f5-b3c8-da52d948597e admin admin] RBAC: Authorizing `identity:delete_project(project_id=72a232e13b404234afcea7c8e521195f)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:23.906966 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d4642f-464c-42f5-b3c8-da52d948597e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:23.957400 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:23.964161 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-33d4642f-464c-42f5-b3c8-da52d948597e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72a232e13b404234afcea7c8e521195f', 'request_id': 'req-33d4642f-464c-42f5-b3c8-da52d948597e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:23.976646 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-33d4642f-464c-42f5-b3c8-da52d948597e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72a232e13b404234afcea7c8e521195f', 'request_id': 'req-33d4642f-464c-42f5-b3c8-da52d948597e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:23.985140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-33d4642f-464c-42f5-b3c8-da52d948597e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72a232e13b404234afcea7c8e521195f', 'request_id': 'req-33d4642f-464c-42f5-b3c8-da52d948597e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:23.997037 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-33d4642f-464c-42f5-b3c8-da52d948597e admin admin] The token cache is being invalidate because project 72a232e13b404234afcea7c8e521195f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:22:23.997439 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-33d4642f-464c-42f5-b3c8-da52d948597e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:23.998721 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-33d4642f-464c-42f5-b3c8-da52d948597e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:24.000405 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 961/1924] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:22:23 2022] DELETE /identity/v3/projects/72a232e13b404234afcea7c8e521195f => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:22:24.007081 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a4d97-2d0b-4a5a-91fa-8d82e56828bb None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:24.008187 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a4d97-2d0b-4a5a-91fa-8d82e56828bb None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:24.008511 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a4d97-2d0b-4a5a-91fa-8d82e56828bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:24.032205 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-fc4a4d97-2d0b-4a5a-91fa-8d82e56828bb None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:22:24.032205 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-fc4a4d97-2d0b-4a5a-91fa-8d82e56828bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:24.116613 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 964/1925] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:22:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:22:24.126507 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebfc188-8b4f-4be0-9ba8-36fe713116bc None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:24.126809 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebfc188-8b4f-4be0-9ba8-36fe713116bc None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:24.127097 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebfc188-8b4f-4be0-9ba8-36fe713116bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:24.271866 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-4ebfc188-8b4f-4be0-9ba8-36fe713116bc None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:22:24.273278 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4ebfc188-8b4f-4be0-9ba8-36fe713116bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:24.285291 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 962/1926] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:22:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:22:24.289307 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4a4d97-2d0b-4a5a-91fa-8d82e56828bb None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:24.300564 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4a4d97-2d0b-4a5a-91fa-8d82e56828bb None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:24.306588 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d66ff-88d2-44af-8734-d2820bedb3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:24.307544 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d66ff-88d2-44af-8734-d2820bedb3b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:24.308090 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d66ff-88d2-44af-8734-d2820bedb3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:24.308575 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d66ff-88d2-44af-8734-d2820bedb3b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:24.309515 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4d66ff-88d2-44af-8734-d2820bedb3b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:22:24.310791 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4d66ff-88d2-44af-8734-d2820bedb3b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:24.312649 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4d66ff-88d2-44af-8734-d2820bedb3b6 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:24.329469 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 965/1927] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:22:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:22:24.330794 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebfc188-8b4f-4be0-9ba8-36fe713116bc None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:24.340864 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebfc188-8b4f-4be0-9ba8-36fe713116bc None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:24.346158 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69677966-fb99-4780-bde9-22cb0011854e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:24.347104 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69677966-fb99-4780-bde9-22cb0011854e admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:24.347707 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69677966-fb99-4780-bde9-22cb0011854e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:24.348231 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69677966-fb99-4780-bde9-22cb0011854e admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:24.349274 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69677966-fb99-4780-bde9-22cb0011854e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:24.351732 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69677966-fb99-4780-bde9-22cb0011854e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:24.403503 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 963/1928] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:22:24 2022] POST /identity/v3/projects => generated 377 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:22:24.407003 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d66ff-88d2-44af-8734-d2820bedb3b6 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:24.418509 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d66ff-88d2-44af-8734-d2820bedb3b6 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:24.556798 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dbd831-e5d4-463a-938c-8c2eb3a6cb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:24.559345 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbd831-e5d4-463a-938c-8c2eb3a6cb6d admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:24.559879 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbd831-e5d4-463a-938c-8c2eb3a6cb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:24.560944 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbd831-e5d4-463a-938c-8c2eb3a6cb6d admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:24.561685 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dbd831-e5d4-463a-938c-8c2eb3a6cb6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:24.567093 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dbd831-e5d4-463a-938c-8c2eb3a6cb6d admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:24.622534 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 966/1929] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:22:24 2022] POST /identity/v3/users => generated 289 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:22:24.629578 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69677966-fb99-4780-bde9-22cb0011854e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:24.646520 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69677966-fb99-4780-bde9-22cb0011854e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:24.652986 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea603abd-a1a0-4630-8765-c693b44866a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:24.654554 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea603abd-a1a0-4630-8765-c693b44866a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:24.654942 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea603abd-a1a0-4630-8765-c693b44866a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:24.655323 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea603abd-a1a0-4630-8765-c693b44866a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:24.656274 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea603abd-a1a0-4630-8765-c693b44866a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:24.658119 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea603abd-a1a0-4630-8765-c693b44866a7 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:24.673806 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 964/1930] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 20:22:24.677760 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dbd831-e5d4-463a-938c-8c2eb3a6cb6d admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:24.689938 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dbd831-e5d4-463a-938c-8c2eb3a6cb6d admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:24.697574 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab859bd7-dee3-4d20-8a9d-6491dd5bf290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:24.698495 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab859bd7-dee3-4d20-8a9d-6491dd5bf290 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:24.698979 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab859bd7-dee3-4d20-8a9d-6491dd5bf290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:24.699558 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab859bd7-dee3-4d20-8a9d-6491dd5bf290 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:24.700815 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab859bd7-dee3-4d20-8a9d-6491dd5bf290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:24.703080 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab859bd7-dee3-4d20-8a9d-6491dd5bf290 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:24.714613 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 967/1931] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 20:22:24.719436 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea603abd-a1a0-4630-8765-c693b44866a7 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:24.731098 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea603abd-a1a0-4630-8765-c693b44866a7 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:24.736637 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b9ca2-ec34-4e0e-a1a6-1886e03d6c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:24.737569 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b9ca2-ec34-4e0e-a1a6-1886e03d6c2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:24.737853 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b9ca2-ec34-4e0e-a1a6-1886e03d6c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:24.738127 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b9ca2-ec34-4e0e-a1a6-1886e03d6c2b admin admin] PATH_INFO: `/v3/projects/e21f05a3d72141af9b1844c3d2e23bb4/users/e537c8a1c6974d528381d82ab01c5122/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:24.762336 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32b9ca2-ec34-4e0e-a1a6-1886e03d6c2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e21f05a3d72141af9b1844c3d2e23bb4, user_id=e537c8a1c6974d528381d82ab01c5122, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:24.765116 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32b9ca2-ec34-4e0e-a1a6-1886e03d6c2b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:24.783693 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 965/1932] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:22:24 2022] PUT /identity/v3/projects/e21f05a3d72141af9b1844c3d2e23bb4/users/e537c8a1c6974d528381d82ab01c5122/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:22:24.795655 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b941e48-7754-4d78-ba74-4afb547241c3 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:24.796096 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b941e48-7754-4d78-ba74-4afb547241c3 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:24.796458 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b941e48-7754-4d78-ba74-4afb547241c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:24.867905 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-4b941e48-7754-4d78-ba74-4afb547241c3 None None] MFA Rules not processed for user `e537c8a1c6974d528381d82ab01c5122`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:22:24.869210 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-4b941e48-7754-4d78-ba74-4afb547241c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:24.902911 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:24.978993 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 968/1933] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:22:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:22:24.984364 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b9ca2-ec34-4e0e-a1a6-1886e03d6c2b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:25.130238 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b9ca2-ec34-4e0e-a1a6-1886e03d6c2b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:25.136278 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6df670-aa76-4f28-9d2d-92b56b8e90a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:25.136965 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6df670-aa76-4f28-9d2d-92b56b8e90a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:25.137387 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6df670-aa76-4f28-9d2d-92b56b8e90a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:25.137775 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6df670-aa76-4f28-9d2d-92b56b8e90a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:25.139127 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6df670-aa76-4f28-9d2d-92b56b8e90a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:25.141296 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6df670-aa76-4f28-9d2d-92b56b8e90a4 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:25.173203 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 966/1934] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:22:24 2022] POST /identity/v3/projects => generated 375 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 20:22:25.177143 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b941e48-7754-4d78-ba74-4afb547241c3 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:25.189809 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b941e48-7754-4d78-ba74-4afb547241c3 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:25.277528 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a335466-2a12-4268-a8d8-95841ae624c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:25.279875 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a335466-2a12-4268-a8d8-95841ae624c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:25.280313 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a335466-2a12-4268-a8d8-95841ae624c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:25.280905 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a335466-2a12-4268-a8d8-95841ae624c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:25.281750 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a335466-2a12-4268-a8d8-95841ae624c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:25.285363 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a335466-2a12-4268-a8d8-95841ae624c4 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:25.321537 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 969/1935] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:22:25 2022] POST /identity/v3/users => generated 288 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:22:25.326184 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6df670-aa76-4f28-9d2d-92b56b8e90a4 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:25.342585 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6df670-aa76-4f28-9d2d-92b56b8e90a4 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:25.360904 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9527212b-25db-4bec-adca-78312456205f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:25.361614 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527212b-25db-4bec-adca-78312456205f admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:25.362517 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527212b-25db-4bec-adca-78312456205f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:25.362517 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527212b-25db-4bec-adca-78312456205f admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:25.362921 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9527212b-25db-4bec-adca-78312456205f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:25.364625 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9527212b-25db-4bec-adca-78312456205f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:25.382275 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 967/1936] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:22:25.387212 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a335466-2a12-4268-a8d8-95841ae624c4 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:25.398630 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a335466-2a12-4268-a8d8-95841ae624c4 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:25.403446 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d7724-08e0-4109-bc1d-7daecc80cf23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:25.404731 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d7724-08e0-4109-bc1d-7daecc80cf23 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:25.405021 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d7724-08e0-4109-bc1d-7daecc80cf23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:25.405311 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d7724-08e0-4109-bc1d-7daecc80cf23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:25.406330 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d7724-08e0-4109-bc1d-7daecc80cf23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:25.407963 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d7724-08e0-4109-bc1d-7daecc80cf23 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:25.422233 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 970/1937] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:22:25.423595 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9527212b-25db-4bec-adca-78312456205f admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:25.434926 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9527212b-25db-4bec-adca-78312456205f admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:25.441583 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34e374-dde6-42a9-b3b7-84ba8a086765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:25.443195 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34e374-dde6-42a9-b3b7-84ba8a086765 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:25.443195 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34e374-dde6-42a9-b3b7-84ba8a086765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:25.443195 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34e374-dde6-42a9-b3b7-84ba8a086765 admin admin] PATH_INFO: `/v3/projects/c7393adeb7fb468b87288a6894d9c0a0/users/3f689eab3e644248a8fc611a1cdd13ec/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:25.479541 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc34e374-dde6-42a9-b3b7-84ba8a086765 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7393adeb7fb468b87288a6894d9c0a0, user_id=3f689eab3e644248a8fc611a1cdd13ec, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:25.482640 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc34e374-dde6-42a9-b3b7-84ba8a086765 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:25.503821 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 968/1938] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:22:25 2022] PUT /identity/v3/projects/c7393adeb7fb468b87288a6894d9c0a0/users/3f689eab3e644248a8fc611a1cdd13ec/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:22:25.514792 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e42fc2-50af-49d7-be56-e613d24b5050 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:25.515092 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e42fc2-50af-49d7-be56-e613d24b5050 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:25.515387 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e42fc2-50af-49d7-be56-e613d24b5050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:25.555262 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-f7e42fc2-50af-49d7-be56-e613d24b5050 None None] MFA Rules not processed for user `3f689eab3e644248a8fc611a1cdd13ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:22:25.556662 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-f7e42fc2-50af-49d7-be56-e613d24b5050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:25.678405 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34e374-dde6-42a9-b3b7-84ba8a086765 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:25.680718 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 971/1939] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:22:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:22:25.702351 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:25.781482 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34e374-dde6-42a9-b3b7-84ba8a086765 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:25.787392 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caafa0f-51c9-402d-8c1a-cdd4be4087b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:25.789083 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caafa0f-51c9-402d-8c1a-cdd4be4087b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:25.791849 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caafa0f-51c9-402d-8c1a-cdd4be4087b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:25.792175 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caafa0f-51c9-402d-8c1a-cdd4be4087b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:25.793106 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caafa0f-51c9-402d-8c1a-cdd4be4087b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:25.795668 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caafa0f-51c9-402d-8c1a-cdd4be4087b9 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:25.848070 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 969/1940] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:22:25 2022] POST /identity/v3/projects => generated 377 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:22:25.851782 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e42fc2-50af-49d7-be56-e613d24b5050 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:25.868843 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e42fc2-50af-49d7-be56-e613d24b5050 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:25.908434 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:25.943592 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f243bb-762f-434c-8bb5-71d25b624924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:25.943592 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f243bb-762f-434c-8bb5-71d25b624924 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:25.943972 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f243bb-762f-434c-8bb5-71d25b624924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:25.943972 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f243bb-762f-434c-8bb5-71d25b624924 admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:25.944664 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f243bb-762f-434c-8bb5-71d25b624924 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:25.946845 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f243bb-762f-434c-8bb5-71d25b624924 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:25.973983 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 972/1941] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:22:25 2022] POST /identity/v3/users => generated 295 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:22:25.977897 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caafa0f-51c9-402d-8c1a-cdd4be4087b9 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:25.991287 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caafa0f-51c9-402d-8c1a-cdd4be4087b9 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:25.997327 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512c27ca-ad60-4b02-b120-ff79bffa0673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:25.999027 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c27ca-ad60-4b02-b120-ff79bffa0673 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:25.999396 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c27ca-ad60-4b02-b120-ff79bffa0673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:25.999747 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c27ca-ad60-4b02-b120-ff79bffa0673 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:26.000710 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512c27ca-ad60-4b02-b120-ff79bffa0673 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:26.002425 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512c27ca-ad60-4b02-b120-ff79bffa0673 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:26.027331 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 970/1942] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:22:26.032321 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f243bb-762f-434c-8bb5-71d25b624924 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:26.060752 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f243bb-762f-434c-8bb5-71d25b624924 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:26.071093 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89170169-ffb1-4170-a47c-7245d0f7e314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:26.072715 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89170169-ffb1-4170-a47c-7245d0f7e314 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:26.074587 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89170169-ffb1-4170-a47c-7245d0f7e314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:26.074987 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89170169-ffb1-4170-a47c-7245d0f7e314 admin admin] PATH_INFO: `/v3/projects/d6b59a3d5d6743c88d4978cd8e0a0c4c/users/37a39769e6d8418182a1e45293428b2e/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:26.102244 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89170169-ffb1-4170-a47c-7245d0f7e314 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6b59a3d5d6743c88d4978cd8e0a0c4c, user_id=37a39769e6d8418182a1e45293428b2e, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:26.108386 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89170169-ffb1-4170-a47c-7245d0f7e314 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:26.141812 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 973/1943] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:22:26 2022] PUT /identity/v3/projects/d6b59a3d5d6743c88d4978cd8e0a0c4c/users/37a39769e6d8418182a1e45293428b2e/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:22:26.146278 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512c27ca-ad60-4b02-b120-ff79bffa0673 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:26.162751 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512c27ca-ad60-4b02-b120-ff79bffa0673 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:26.277569 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea4234b-7b33-4496-b27f-eeb8c68aa9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:26.278684 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea4234b-7b33-4496-b27f-eeb8c68aa9da admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:26.279711 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea4234b-7b33-4496-b27f-eeb8c68aa9da admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:26.280237 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea4234b-7b33-4496-b27f-eeb8c68aa9da admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:26.281646 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea4234b-7b33-4496-b27f-eeb8c68aa9da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:26.284623 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea4234b-7b33-4496-b27f-eeb8c68aa9da admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:26.300096 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 971/1944] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:22:26 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:22:26.301588 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89170169-ffb1-4170-a47c-7245d0f7e314 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:26.314834 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89170169-ffb1-4170-a47c-7245d0f7e314 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:26.320437 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf8612-3899-4b4e-b703-0d82f74d441c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:26.321337 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf8612-3899-4b4e-b703-0d82f74d441c admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:26.321621 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf8612-3899-4b4e-b703-0d82f74d441c admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:26.322179 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf8612-3899-4b4e-b703-0d82f74d441c admin admin] PATH_INFO: `/v3/projects/d6b59a3d5d6743c88d4978cd8e0a0c4c/users/37a39769e6d8418182a1e45293428b2e/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:26.324638 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febf8612-3899-4b4e-b703-0d82f74d441c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6b59a3d5d6743c88d4978cd8e0a0c4c, user_id=37a39769e6d8418182a1e45293428b2e, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:26.327476 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febf8612-3899-4b4e-b703-0d82f74d441c admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:26.348923 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 974/1945] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:22:26 2022] PUT /identity/v3/projects/d6b59a3d5d6743c88d4978cd8e0a0c4c/users/37a39769e6d8418182a1e45293428b2e/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:22:26.352229 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee69c7c-0290-493f-b720-d55f230444da None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:26.352588 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee69c7c-0290-493f-b720-d55f230444da None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:26.352873 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee69c7c-0290-493f-b720-d55f230444da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:26.383883 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-aee69c7c-0290-493f-b720-d55f230444da None None] MFA Rules not processed for user `37a39769e6d8418182a1e45293428b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:22:26.385053 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-aee69c7c-0290-493f-b720-d55f230444da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:26.471250 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 972/1946] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:22:26 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:22:26.488138 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf8612-3899-4b4e-b703-0d82f74d441c admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:26.488425 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-febf8612-3899-4b4e-b703-0d82f74d441c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:26.554897 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf8612-3899-4b4e-b703-0d82f74d441c admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:26.558888 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c121b-182c-42ae-a5cd-3df64aeeff1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:26.559839 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c121b-182c-42ae-a5cd-3df64aeeff1d service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:26.560027 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c121b-182c-42ae-a5cd-3df64aeeff1d service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:26.560405 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c121b-182c-42ae-a5cd-3df64aeeff1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:26.627895 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839c121b-182c-42ae-a5cd-3df64aeeff1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:26.629554 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839c121b-182c-42ae-a5cd-3df64aeeff1d service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:26.657055 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 975/1947] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:22:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:22:32.496491 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee69c7c-0290-493f-b720-d55f230444da None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:32.497932 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-aee69c7c-0290-493f-b720-d55f230444da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:32.510152 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee69c7c-0290-493f-b720-d55f230444da None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:32.514308 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b4aa2-30bd-4543-812b-4f8f321cbf23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:32.515024 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b4aa2-30bd-4543-812b-4f8f321cbf23 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:32.515376 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b4aa2-30bd-4543-812b-4f8f321cbf23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:32.515716 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b4aa2-30bd-4543-812b-4f8f321cbf23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:32.525486 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:32.577130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b4aa2-30bd-4543-812b-4f8f321cbf23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:32.578673 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b4aa2-30bd-4543-812b-4f8f321cbf23 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:32.587728 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 973/1948] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:22:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:22:34.343490 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c121b-182c-42ae-a5cd-3df64aeeff1d service cinder] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:34.351965 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c121b-182c-42ae-a5cd-3df64aeeff1d service cinder] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:34.355519 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e953cde7-7b12-493d-af10-b88511b7a2a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:34.356186 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953cde7-7b12-493d-af10-b88511b7a2a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:34.356471 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953cde7-7b12-493d-af10-b88511b7a2a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:34.356775 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953cde7-7b12-493d-af10-b88511b7a2a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:34.365744 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e953cde7-7b12-493d-af10-b88511b7a2a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:34.367165 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e953cde7-7b12-493d-af10-b88511b7a2a6 service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:34.376804 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 976/1949] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:22:34 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:22:40.211614 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b4aa2-30bd-4543-812b-4f8f321cbf23 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:40.217333 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8c4b4aa2-30bd-4543-812b-4f8f321cbf23 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:40.298807 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b4aa2-30bd-4543-812b-4f8f321cbf23 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:40.305150 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8a176d-f231-46bc-b74c-408cac600873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:40.306157 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a176d-f231-46bc-b74c-408cac600873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:40.306550 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a176d-f231-46bc-b74c-408cac600873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:40.307426 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a176d-f231-46bc-b74c-408cac600873 admin admin] PATH_INFO: `/v3/users/33496add33de4df2904aa0c7c8d48973` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:40.309100 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8a176d-f231-46bc-b74c-408cac600873 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33496add33de4df2904aa0c7c8d48973)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:40.312369 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8a176d-f231-46bc-b74c-408cac600873 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:40.412058 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5a8a176d-f231-46bc-b74c-408cac600873 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33496add33de4df2904aa0c7c8d48973'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:40.412770 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5a8a176d-f231-46bc-b74c-408cac600873 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33496add33de4df2904aa0c7c8d48973'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:40.413408 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5a8a176d-f231-46bc-b74c-408cac600873 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33496add33de4df2904aa0c7c8d48973'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:40.443189 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5a8a176d-f231-46bc-b74c-408cac600873 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33496add33de4df2904aa0c7c8d48973'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:40.464315 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5a8a176d-f231-46bc-b74c-408cac600873 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33496add33de4df2904aa0c7c8d48973'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:40.487899 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 974/1950] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:22:40 2022] DELETE /identity/v3/users/33496add33de4df2904aa0c7c8d48973 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:22:40.493050 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250835e-3bd2-4332-9dc7-2403921064a6 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:40.494631 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250835e-3bd2-4332-9dc7-2403921064a6 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:40.495118 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250835e-3bd2-4332-9dc7-2403921064a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:40.536738 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-5250835e-3bd2-4332-9dc7-2403921064a6 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:22:40.538259 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-5250835e-3bd2-4332-9dc7-2403921064a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:40.573040 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:40.618785 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 977/1951] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:22:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:22:40.628834 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8a176d-f231-46bc-b74c-408cac600873 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:40.630565 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5a8a176d-f231-46bc-b74c-408cac600873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:40.673270 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:40.705551 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8a176d-f231-46bc-b74c-408cac600873 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:40.717237 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed1bee-eb54-41c9-82fa-3a9d10079fda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:40.718623 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed1bee-eb54-41c9-82fa-3a9d10079fda service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:40.718989 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed1bee-eb54-41c9-82fa-3a9d10079fda service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:40.719396 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed1bee-eb54-41c9-82fa-3a9d10079fda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:40.742606 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ed1bee-eb54-41c9-82fa-3a9d10079fda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:40.746686 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ed1bee-eb54-41c9-82fa-3a9d10079fda service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:40.764557 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 975/1952] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:22:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:22:41.262754 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5250835e-3bd2-4332-9dc7-2403921064a6 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:41.263895 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-5250835e-3bd2-4332-9dc7-2403921064a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:41.277871 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5250835e-3bd2-4332-9dc7-2403921064a6 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:41.284236 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b13312c-a585-4026-b7e6-0649e9ea1c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:41.285151 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13312c-a585-4026-b7e6-0649e9ea1c10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:41.285151 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13312c-a585-4026-b7e6-0649e9ea1c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:41.285423 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13312c-a585-4026-b7e6-0649e9ea1c10 admin admin] PATH_INFO: `/v3/projects/da40b0bae0934f559bbe4e46cd25e46e` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:41.287390 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b13312c-a585-4026-b7e6-0649e9ea1c10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da40b0bae0934f559bbe4e46cd25e46e)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:41.291192 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b13312c-a585-4026-b7e6-0649e9ea1c10 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:41.368341 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-2b13312c-a585-4026-b7e6-0649e9ea1c10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da40b0bae0934f559bbe4e46cd25e46e', 'request_id': 'req-2b13312c-a585-4026-b7e6-0649e9ea1c10'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:41.378008 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-2b13312c-a585-4026-b7e6-0649e9ea1c10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da40b0bae0934f559bbe4e46cd25e46e', 'request_id': 'req-2b13312c-a585-4026-b7e6-0649e9ea1c10'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:41.387388 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-2b13312c-a585-4026-b7e6-0649e9ea1c10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da40b0bae0934f559bbe4e46cd25e46e', 'request_id': 'req-2b13312c-a585-4026-b7e6-0649e9ea1c10'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:41.406085 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-2b13312c-a585-4026-b7e6-0649e9ea1c10 admin admin] The token cache is being invalidate because project da40b0bae0934f559bbe4e46cd25e46e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:22:41.406777 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-2b13312c-a585-4026-b7e6-0649e9ea1c10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:41.408284 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-2b13312c-a585-4026-b7e6-0649e9ea1c10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:41.413473 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 978/1953] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:22:41 2022] DELETE /identity/v3/projects/da40b0bae0934f559bbe4e46cd25e46e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:22:41.415826 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b477b-0ab0-48d4-ac8c-059239a062df None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:41.416317 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b477b-0ab0-48d4-ac8c-059239a062df None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:41.416667 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b477b-0ab0-48d4-ac8c-059239a062df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:41.439207 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-6f9b477b-0ab0-48d4-ac8c-059239a062df None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:22:41.440587 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6f9b477b-0ab0-48d4-ac8c-059239a062df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:41.525564 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 976/1954] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:22:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:22:41.534729 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71f31d-44b7-4db0-adc3-1b1e748b2ffc None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:41.535886 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71f31d-44b7-4db0-adc3-1b1e748b2ffc None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:41.536417 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71f31d-44b7-4db0-adc3-1b1e748b2ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:41.568700 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-6e71f31d-44b7-4db0-adc3-1b1e748b2ffc None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:22:41.569998 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-6e71f31d-44b7-4db0-adc3-1b1e748b2ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:41.582060 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 979/1955] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:22:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:22:41.588692 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b477b-0ab0-48d4-ac8c-059239a062df None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:41.615306 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b477b-0ab0-48d4-ac8c-059239a062df None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:41.623907 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e6db0-5823-408a-862f-71b9c9d35929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:41.623907 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e6db0-5823-408a-862f-71b9c9d35929 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:41.623907 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e6db0-5823-408a-862f-71b9c9d35929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:41.623907 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e6db0-5823-408a-862f-71b9c9d35929 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:41.624291 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1e6db0-5823-408a-862f-71b9c9d35929 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:22:41.625343 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71f31d-44b7-4db0-adc3-1b1e748b2ffc None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:41.626919 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-6e71f31d-44b7-4db0-adc3-1b1e748b2ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:41.635563 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1e6db0-5823-408a-862f-71b9c9d35929 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:41.641518 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1e6db0-5823-408a-862f-71b9c9d35929 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:41.647942 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71f31d-44b7-4db0-adc3-1b1e748b2ffc None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:41.662352 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3440e2e8-d518-4524-b697-3dd46bee9b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:41.663427 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440e2e8-d518-4524-b697-3dd46bee9b9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:41.663780 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440e2e8-d518-4524-b697-3dd46bee9b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:41.665214 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440e2e8-d518-4524-b697-3dd46bee9b9f admin admin] PATH_INFO: `/v3/users/e537c8a1c6974d528381d82ab01c5122` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:41.666756 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3440e2e8-d518-4524-b697-3dd46bee9b9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e537c8a1c6974d528381d82ab01c5122)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:41.671433 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3440e2e8-d518-4524-b697-3dd46bee9b9f admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:41.672667 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 977/1956] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:22:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:22:41.673876 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e6db0-5823-408a-862f-71b9c9d35929 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:41.701365 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e6db0-5823-408a-862f-71b9c9d35929 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:41.732003 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7342dc5-256f-408b-8b50-ee1ff649c5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:41.736159 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7342dc5-256f-408b-8b50-ee1ff649c5bb admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:41.738027 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7342dc5-256f-408b-8b50-ee1ff649c5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:41.739484 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7342dc5-256f-408b-8b50-ee1ff649c5bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:41.740383 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7342dc5-256f-408b-8b50-ee1ff649c5bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:41.748623 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7342dc5-256f-408b-8b50-ee1ff649c5bb admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:41.864735 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-3440e2e8-d518-4524-b697-3dd46bee9b9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e537c8a1c6974d528381d82ab01c5122'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:41.866634 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-3440e2e8-d518-4524-b697-3dd46bee9b9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e537c8a1c6974d528381d82ab01c5122'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:41.872362 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 978/1957] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:22:41 2022] POST /identity/v3/projects => generated 383 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:22:41.876446 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7342dc5-256f-408b-8b50-ee1ff649c5bb admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:41.880298 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-3440e2e8-d518-4524-b697-3dd46bee9b9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e537c8a1c6974d528381d82ab01c5122'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:41.881210 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e7342dc5-256f-408b-8b50-ee1ff649c5bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:41.898827 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-3440e2e8-d518-4524-b697-3dd46bee9b9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e537c8a1c6974d528381d82ab01c5122'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:41.905296 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-3440e2e8-d518-4524-b697-3dd46bee9b9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e537c8a1c6974d528381d82ab01c5122'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:41.951617 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 980/1958] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:22:41 2022] DELETE /identity/v3/users/e537c8a1c6974d528381d82ab01c5122 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:22:41.957888 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59823bd9-677c-45f0-a810-1570a0e7aa6c None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:41.958184 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59823bd9-677c-45f0-a810-1570a0e7aa6c None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:41.958468 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59823bd9-677c-45f0-a810-1570a0e7aa6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:42.003658 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-59823bd9-677c-45f0-a810-1570a0e7aa6c None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:22:42.005815 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7342dc5-256f-408b-8b50-ee1ff649c5bb admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:42.007797 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-59823bd9-677c-45f0-a810-1570a0e7aa6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:42.057124 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:42.145900 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:42.160022 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5974d0-15c9-47cf-9592-1b65d6991a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:42.160703 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5974d0-15c9-47cf-9592-1b65d6991a05 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:42.160988 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5974d0-15c9-47cf-9592-1b65d6991a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:42.161271 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5974d0-15c9-47cf-9592-1b65d6991a05 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:42.161951 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5974d0-15c9-47cf-9592-1b65d6991a05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:42.162704 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 981/1959] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:22:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:22:42.163864 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5974d0-15c9-47cf-9592-1b65d6991a05 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:42.172184 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59823bd9-677c-45f0-a810-1570a0e7aa6c None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:42.173582 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-59823bd9-677c-45f0-a810-1570a0e7aa6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:42.186440 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 979/1960] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:22:41 2022] POST /identity/v3/users => generated 292 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:22:42.190386 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5974d0-15c9-47cf-9592-1b65d6991a05 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:42.201430 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5974d0-15c9-47cf-9592-1b65d6991a05 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:42.206207 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517443b4-7390-4c0b-844d-09491ac35784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:42.206803 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517443b4-7390-4c0b-844d-09491ac35784 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:42.207083 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517443b4-7390-4c0b-844d-09491ac35784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:42.207356 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517443b4-7390-4c0b-844d-09491ac35784 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:42.208118 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517443b4-7390-4c0b-844d-09491ac35784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:42.209699 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517443b4-7390-4c0b-844d-09491ac35784 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:42.219783 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 980/1961] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 20:22:42.223586 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517443b4-7390-4c0b-844d-09491ac35784 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:42.233412 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517443b4-7390-4c0b-844d-09491ac35784 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:42.237380 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59823bd9-677c-45f0-a810-1570a0e7aa6c None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:42.238093 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc36d8-87c5-4bdc-b8b3-920c3cd2994e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:42.238737 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc36d8-87c5-4bdc-b8b3-920c3cd2994e admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:42.239020 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc36d8-87c5-4bdc-b8b3-920c3cd2994e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:42.239296 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc36d8-87c5-4bdc-b8b3-920c3cd2994e admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:42.240057 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc36d8-87c5-4bdc-b8b3-920c3cd2994e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:42.241094 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dee648-53f8-422e-a547-bd55f393b7ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:42.241616 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc36d8-87c5-4bdc-b8b3-920c3cd2994e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:42.241737 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dee648-53f8-422e-a547-bd55f393b7ac service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:42.242053 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dee648-53f8-422e-a547-bd55f393b7ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:42.242331 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dee648-53f8-422e-a547-bd55f393b7ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:42.252075 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dee648-53f8-422e-a547-bd55f393b7ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:42.253494 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dee648-53f8-422e-a547-bd55f393b7ac service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:42.253603 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 981/1962] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 20:22:42.257596 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc36d8-87c5-4bdc-b8b3-920c3cd2994e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:42.263750 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 982/1963] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:22:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:22:42.267781 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc36d8-87c5-4bdc-b8b3-920c3cd2994e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:42.272610 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ed017-834e-4776-8f93-9ccdd9361381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:42.273490 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ed017-834e-4776-8f93-9ccdd9361381 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:42.273774 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ed017-834e-4776-8f93-9ccdd9361381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:42.274050 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ed017-834e-4776-8f93-9ccdd9361381 admin admin] PATH_INFO: `/v3/projects/c1c53ba1f3934403b578c85fbb2a128f/users/6aa799462c6a4339ab0ab3fc1601534d/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:42.288870 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ed017-834e-4776-8f93-9ccdd9361381 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1c53ba1f3934403b578c85fbb2a128f, user_id=6aa799462c6a4339ab0ab3fc1601534d, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:42.291496 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ed017-834e-4776-8f93-9ccdd9361381 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:42.306746 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 982/1964] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:22:42 2022] PUT /identity/v3/projects/c1c53ba1f3934403b578c85fbb2a128f/users/6aa799462c6a4339ab0ab3fc1601534d/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:22:42.312817 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d39970-18d6-467e-b093-b1e51579fcac None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:42.312817 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d39970-18d6-467e-b093-b1e51579fcac None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:42.313147 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d39970-18d6-467e-b093-b1e51579fcac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:42.330986 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-13d39970-18d6-467e-b093-b1e51579fcac None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:22:42.332224 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-13d39970-18d6-467e-b093-b1e51579fcac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:42.413679 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 983/1965] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:22:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:22:42.420708 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ed017-834e-4776-8f93-9ccdd9361381 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:42.479549 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ed017-834e-4776-8f93-9ccdd9361381 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:42.483678 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850e7bc-80e0-485f-b3cf-c792f6629178 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:42.484384 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850e7bc-80e0-485f-b3cf-c792f6629178 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:42.484672 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850e7bc-80e0-485f-b3cf-c792f6629178 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:42.484951 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850e7bc-80e0-485f-b3cf-c792f6629178 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:42.495448 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b850e7bc-80e0-485f-b3cf-c792f6629178 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:42.497679 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b850e7bc-80e0-485f-b3cf-c792f6629178 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:42.508173 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 983/1966] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:22:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:22:42.613994 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d39970-18d6-467e-b093-b1e51579fcac None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:42.615567 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-13d39970-18d6-467e-b093-b1e51579fcac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:42.634868 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d39970-18d6-467e-b093-b1e51579fcac None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:42.646559 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626c63c7-9d94-477c-aff6-457389c3b82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:42.647449 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c63c7-9d94-477c-aff6-457389c3b82b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:42.647734 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c63c7-9d94-477c-aff6-457389c3b82b admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:42.648050 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c63c7-9d94-477c-aff6-457389c3b82b admin admin] PATH_INFO: `/v3/projects/e21f05a3d72141af9b1844c3d2e23bb4` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:42.649252 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626c63c7-9d94-477c-aff6-457389c3b82b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e21f05a3d72141af9b1844c3d2e23bb4)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:42.651273 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626c63c7-9d94-477c-aff6-457389c3b82b admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:42.706019 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-626c63c7-9d94-477c-aff6-457389c3b82b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e21f05a3d72141af9b1844c3d2e23bb4', 'request_id': 'req-626c63c7-9d94-477c-aff6-457389c3b82b'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:42.710679 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:42.712353 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-626c63c7-9d94-477c-aff6-457389c3b82b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e21f05a3d72141af9b1844c3d2e23bb4', 'request_id': 'req-626c63c7-9d94-477c-aff6-457389c3b82b'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:42.720766 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-626c63c7-9d94-477c-aff6-457389c3b82b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e21f05a3d72141af9b1844c3d2e23bb4', 'request_id': 'req-626c63c7-9d94-477c-aff6-457389c3b82b'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:42.732635 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-626c63c7-9d94-477c-aff6-457389c3b82b admin admin] The token cache is being invalidate because project e21f05a3d72141af9b1844c3d2e23bb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:22:42.732856 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-626c63c7-9d94-477c-aff6-457389c3b82b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:42.733603 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-626c63c7-9d94-477c-aff6-457389c3b82b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:42.735140 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 984/1967] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:22:42 2022] DELETE /identity/v3/projects/e21f05a3d72141af9b1844c3d2e23bb4 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:22:42.739170 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850e7bc-80e0-485f-b3cf-c792f6629178 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:42.749519 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850e7bc-80e0-485f-b3cf-c792f6629178 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:42.808580 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3971bc4-2710-4c79-bb73-d8f8e39c38bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:42.809996 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3971bc4-2710-4c79-bb73-d8f8e39c38bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:42.810285 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3971bc4-2710-4c79-bb73-d8f8e39c38bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:42.810565 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3971bc4-2710-4c79-bb73-d8f8e39c38bb admin admin] PATH_INFO: `/v3/users/3f689eab3e644248a8fc611a1cdd13ec` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:42.811813 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3971bc4-2710-4c79-bb73-d8f8e39c38bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f689eab3e644248a8fc611a1cdd13ec)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:42.813766 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3971bc4-2710-4c79-bb73-d8f8e39c38bb admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:42.877806 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:42.889119 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e3971bc4-2710-4c79-bb73-d8f8e39c38bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f689eab3e644248a8fc611a1cdd13ec'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:42.889831 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e3971bc4-2710-4c79-bb73-d8f8e39c38bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f689eab3e644248a8fc611a1cdd13ec'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:42.890878 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e3971bc4-2710-4c79-bb73-d8f8e39c38bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f689eab3e644248a8fc611a1cdd13ec'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:42.918979 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e3971bc4-2710-4c79-bb73-d8f8e39c38bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f689eab3e644248a8fc611a1cdd13ec'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:42.931303 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e3971bc4-2710-4c79-bb73-d8f8e39c38bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f689eab3e644248a8fc611a1cdd13ec'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:42.951599 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 984/1968] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:22:42 2022] DELETE /identity/v3/users/3f689eab3e644248a8fc611a1cdd13ec => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:22:43.279261 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf5a64-7cd3-4d30-a44a-999004dbbf51 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:43.280280 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf5a64-7cd3-4d30-a44a-999004dbbf51 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:43.280743 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf5a64-7cd3-4d30-a44a-999004dbbf51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:43.327672 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-2adf5a64-7cd3-4d30-a44a-999004dbbf51 None None] MFA Rules not processed for user `6aa799462c6a4339ab0ab3fc1601534d`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:22:43.329054 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-2adf5a64-7cd3-4d30-a44a-999004dbbf51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:43.340735 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3971bc4-2710-4c79-bb73-d8f8e39c38bb admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:43.342960 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e3971bc4-2710-4c79-bb73-d8f8e39c38bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:43.452453 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 985/1969] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:22:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:22:43.467240 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf5a64-7cd3-4d30-a44a-999004dbbf51 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:43.469986 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-2adf5a64-7cd3-4d30-a44a-999004dbbf51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:43.471022 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3971bc4-2710-4c79-bb73-d8f8e39c38bb admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:43.479011 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b62143-f450-4959-8b69-593474051bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:43.481568 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b62143-f450-4959-8b69-593474051bdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:43.482192 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b62143-f450-4959-8b69-593474051bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:43.482571 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b62143-f450-4959-8b69-593474051bdc admin admin] PATH_INFO: `/v3/projects/c7393adeb7fb468b87288a6894d9c0a0` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:43.483971 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b62143-f450-4959-8b69-593474051bdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7393adeb7fb468b87288a6894d9c0a0)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:43.486908 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b62143-f450-4959-8b69-593474051bdc admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:43.569354 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf5a64-7cd3-4d30-a44a-999004dbbf51 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:43.594637 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-11b62143-f450-4959-8b69-593474051bdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7393adeb7fb468b87288a6894d9c0a0', 'request_id': 'req-11b62143-f450-4959-8b69-593474051bdc'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:43.608731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-11b62143-f450-4959-8b69-593474051bdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7393adeb7fb468b87288a6894d9c0a0', 'request_id': 'req-11b62143-f450-4959-8b69-593474051bdc'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:43.616998 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-11b62143-f450-4959-8b69-593474051bdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7393adeb7fb468b87288a6894d9c0a0', 'request_id': 'req-11b62143-f450-4959-8b69-593474051bdc'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:43.628005 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7848162e-34eb-4305-b298-194ea494ad7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:43.628616 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848162e-34eb-4305-b298-194ea494ad7a service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:43.629085 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848162e-34eb-4305-b298-194ea494ad7a service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:43.629448 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848162e-34eb-4305-b298-194ea494ad7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:43.630958 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-11b62143-f450-4959-8b69-593474051bdc admin admin] The token cache is being invalidate because project c7393adeb7fb468b87288a6894d9c0a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:22:43.631302 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-11b62143-f450-4959-8b69-593474051bdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:43.631998 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-11b62143-f450-4959-8b69-593474051bdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:43.633544 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 985/1970] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:22:43 2022] DELETE /identity/v3/projects/c7393adeb7fb468b87288a6894d9c0a0 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:22:43.637319 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b62143-f450-4959-8b69-593474051bdc admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:43.639232 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-11b62143-f450-4959-8b69-593474051bdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:43.679899 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:43.687057 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:43.695350 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7848162e-34eb-4305-b298-194ea494ad7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:43.697000 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7848162e-34eb-4305-b298-194ea494ad7a service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:43.707752 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 986/1971] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:22:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:22:43.713578 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b62143-f450-4959-8b69-593474051bdc admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:43.718430 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e3687f-d664-426a-9293-e39f8416deed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:43.719325 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3687f-d664-426a-9293-e39f8416deed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:43.719614 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3687f-d664-426a-9293-e39f8416deed admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:43.719896 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3687f-d664-426a-9293-e39f8416deed admin admin] PATH_INFO: `/v3/users/37a39769e6d8418182a1e45293428b2e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:43.721288 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e3687f-d664-426a-9293-e39f8416deed admin admin] RBAC: Authorizing `identity:delete_user(user_id=37a39769e6d8418182a1e45293428b2e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:43.723198 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e3687f-d664-426a-9293-e39f8416deed admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:43.771003 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c6e3687f-d664-426a-9293-e39f8416deed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37a39769e6d8418182a1e45293428b2e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:43.771679 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c6e3687f-d664-426a-9293-e39f8416deed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37a39769e6d8418182a1e45293428b2e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:43.772351 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c6e3687f-d664-426a-9293-e39f8416deed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37a39769e6d8418182a1e45293428b2e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:43.784849 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c6e3687f-d664-426a-9293-e39f8416deed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37a39769e6d8418182a1e45293428b2e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:43.794436 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c6e3687f-d664-426a-9293-e39f8416deed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37a39769e6d8418182a1e45293428b2e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:43.807132 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 986/1972] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:22:43 2022] DELETE /identity/v3/users/37a39769e6d8418182a1e45293428b2e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:22:44.125897 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7848162e-34eb-4305-b298-194ea494ad7a service cinder] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:44.136910 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7848162e-34eb-4305-b298-194ea494ad7a service cinder] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:44.196094 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb32c4-af82-467a-a79a-0f78f967daa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:44.196951 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb32c4-af82-467a-a79a-0f78f967daa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:44.197236 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb32c4-af82-467a-a79a-0f78f967daa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:44.197512 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb32c4-af82-467a-a79a-0f78f967daa8 admin admin] PATH_INFO: `/v3/projects/d6b59a3d5d6743c88d4978cd8e0a0c4c` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:44.198710 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fb32c4-af82-467a-a79a-0f78f967daa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6b59a3d5d6743c88d4978cd8e0a0c4c)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:44.200653 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fb32c4-af82-467a-a79a-0f78f967daa8 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:44.246764 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-14fb32c4-af82-467a-a79a-0f78f967daa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6b59a3d5d6743c88d4978cd8e0a0c4c', 'request_id': 'req-14fb32c4-af82-467a-a79a-0f78f967daa8'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:44.252600 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-14fb32c4-af82-467a-a79a-0f78f967daa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6b59a3d5d6743c88d4978cd8e0a0c4c', 'request_id': 'req-14fb32c4-af82-467a-a79a-0f78f967daa8'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:44.259673 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-14fb32c4-af82-467a-a79a-0f78f967daa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6b59a3d5d6743c88d4978cd8e0a0c4c', 'request_id': 'req-14fb32c4-af82-467a-a79a-0f78f967daa8'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:44.270980 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-14fb32c4-af82-467a-a79a-0f78f967daa8 admin admin] The token cache is being invalidate because project d6b59a3d5d6743c88d4978cd8e0a0c4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:22:44.271270 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-14fb32c4-af82-467a-a79a-0f78f967daa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:44.271889 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-14fb32c4-af82-467a-a79a-0f78f967daa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:44.273428 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 987/1973] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:22:44 2022] DELETE /identity/v3/projects/d6b59a3d5d6743c88d4978cd8e0a0c4c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:22:44.279068 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527c229-315f-44f4-9c65-4dabf529adea None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:44.279301 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527c229-315f-44f4-9c65-4dabf529adea None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:44.279613 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527c229-315f-44f4-9c65-4dabf529adea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:44.297433 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-1527c229-315f-44f4-9c65-4dabf529adea None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:22:44.298662 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1527c229-315f-44f4-9c65-4dabf529adea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:44.355216 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 987/1974] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:22:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:22:44.363489 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2710b0d-9521-486b-8ce0-d05d425ed9cb None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:44.363821 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2710b0d-9521-486b-8ce0-d05d425ed9cb None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:44.364118 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2710b0d-9521-486b-8ce0-d05d425ed9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:44.382008 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-d2710b0d-9521-486b-8ce0-d05d425ed9cb None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:22:44.383189 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-d2710b0d-9521-486b-8ce0-d05d425ed9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:44.391045 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 988/1975] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:22:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:22:44.395380 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1527c229-315f-44f4-9c65-4dabf529adea None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:44.406995 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1527c229-315f-44f4-9c65-4dabf529adea None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:44.411572 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa146cb9-ec9a-4271-a1be-67b5ebd2ad94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:44.412267 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa146cb9-ec9a-4271-a1be-67b5ebd2ad94 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:44.412550 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa146cb9-ec9a-4271-a1be-67b5ebd2ad94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:44.412850 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa146cb9-ec9a-4271-a1be-67b5ebd2ad94 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:44.413576 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa146cb9-ec9a-4271-a1be-67b5ebd2ad94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:22:44.413889 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa146cb9-ec9a-4271-a1be-67b5ebd2ad94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:44.415464 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa146cb9-ec9a-4271-a1be-67b5ebd2ad94 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:44.428782 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 988/1976] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:22:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:22:44.433449 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2710b0d-9521-486b-8ce0-d05d425ed9cb None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:44.444182 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2710b0d-9521-486b-8ce0-d05d425ed9cb None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:44.449245 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12eade-91ef-4834-913f-3db3200bc6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:44.449914 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12eade-91ef-4834-913f-3db3200bc6ad admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:44.450202 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12eade-91ef-4834-913f-3db3200bc6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:44.450482 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12eade-91ef-4834-913f-3db3200bc6ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:44.451176 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d12eade-91ef-4834-913f-3db3200bc6ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:44.453152 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d12eade-91ef-4834-913f-3db3200bc6ad admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:44.483456 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 989/1977] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:22:44 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:22:44.484664 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa146cb9-ec9a-4271-a1be-67b5ebd2ad94 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:44.494761 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa146cb9-ec9a-4271-a1be-67b5ebd2ad94 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:44.539839 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:44.553402 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7360d223-99df-4c49-81e2-6761be2857d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:44.554076 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360d223-99df-4c49-81e2-6761be2857d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:44.554364 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360d223-99df-4c49-81e2-6761be2857d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:44.554642 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360d223-99df-4c49-81e2-6761be2857d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:44.555364 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7360d223-99df-4c49-81e2-6761be2857d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:44.557331 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7360d223-99df-4c49-81e2-6761be2857d8 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:44.579946 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 989/1978] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:22:44 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:22:44.581477 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12eade-91ef-4834-913f-3db3200bc6ad admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:44.592486 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12eade-91ef-4834-913f-3db3200bc6ad admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:44.597050 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ede0e0-8641-41c9-b08d-b8d27da15b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:44.597710 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ede0e0-8641-41c9-b08d-b8d27da15b7c admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:44.597997 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ede0e0-8641-41c9-b08d-b8d27da15b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:44.598283 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ede0e0-8641-41c9-b08d-b8d27da15b7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:44.599009 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ede0e0-8641-41c9-b08d-b8d27da15b7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:44.600631 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ede0e0-8641-41c9-b08d-b8d27da15b7c admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:44.613989 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 990/1979] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:22:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:22:44.615114 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7360d223-99df-4c49-81e2-6761be2857d8 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:44.625633 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7360d223-99df-4c49-81e2-6761be2857d8 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:44.630382 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b71ab2-a6ba-48fc-b3b4-f401bf4f3d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:44.631045 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b71ab2-a6ba-48fc-b3b4-f401bf4f3d42 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:44.631333 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b71ab2-a6ba-48fc-b3b4-f401bf4f3d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:44.631613 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b71ab2-a6ba-48fc-b3b4-f401bf4f3d42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:44.632380 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b71ab2-a6ba-48fc-b3b4-f401bf4f3d42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:44.633957 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b71ab2-a6ba-48fc-b3b4-f401bf4f3d42 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:44.644630 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 990/1980] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:22:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:22:44.649023 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ede0e0-8641-41c9-b08d-b8d27da15b7c admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:44.659859 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ede0e0-8641-41c9-b08d-b8d27da15b7c admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:44.664558 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f0d818-acc3-47f8-9590-52a2d0ece5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:44.665468 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f0d818-acc3-47f8-9590-52a2d0ece5eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:44.665750 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f0d818-acc3-47f8-9590-52a2d0ece5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:44.666025 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f0d818-acc3-47f8-9590-52a2d0ece5eb admin admin] PATH_INFO: `/v3/projects/8aec22694f384bd3a7a7428bb1b48b2c/users/621ea4d1aae040298ba8420d767b33b0/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:44.681316 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f0d818-acc3-47f8-9590-52a2d0ece5eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8aec22694f384bd3a7a7428bb1b48b2c, user_id=621ea4d1aae040298ba8420d767b33b0, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:44.684007 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f0d818-acc3-47f8-9590-52a2d0ece5eb admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:44.701579 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 991/1981] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:22:44 2022] PUT /identity/v3/projects/8aec22694f384bd3a7a7428bb1b48b2c/users/621ea4d1aae040298ba8420d767b33b0/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:22:44.705840 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b82940-2420-4ef3-9336-d2fd2be12aa7 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:44.706219 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b82940-2420-4ef3-9336-d2fd2be12aa7 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:44.706596 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b82940-2420-4ef3-9336-d2fd2be12aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:44.725329 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-d3b82940-2420-4ef3-9336-d2fd2be12aa7 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:22:44.726569 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d3b82940-2420-4ef3-9336-d2fd2be12aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:44.787737 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 991/1982] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:22:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:22:44.798005 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f0d818-acc3-47f8-9590-52a2d0ece5eb admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:44.799816 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-e5f0d818-acc3-47f8-9590-52a2d0ece5eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:44.813581 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:44.887912 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f0d818-acc3-47f8-9590-52a2d0ece5eb admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:44.891510 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390dc10f-05c9-425c-b536-4e7a4ee9f223 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:44.892186 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390dc10f-05c9-425c-b536-4e7a4ee9f223 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:44.892477 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390dc10f-05c9-425c-b536-4e7a4ee9f223 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:44.892756 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390dc10f-05c9-425c-b536-4e7a4ee9f223 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:44.901569 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390dc10f-05c9-425c-b536-4e7a4ee9f223 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:44.907807 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390dc10f-05c9-425c-b536-4e7a4ee9f223 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:44.917318 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 992/1983] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:22:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:22:45.090038 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db977e64-2509-4cc5-940a-1ebfba2e639a None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:45.090038 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db977e64-2509-4cc5-940a-1ebfba2e639a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:45.090038 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db977e64-2509-4cc5-940a-1ebfba2e639a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:45.109165 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-db977e64-2509-4cc5-940a-1ebfba2e639a None None] MFA Rules not processed for user `6aa799462c6a4339ab0ab3fc1601534d`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:22:45.110737 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-db977e64-2509-4cc5-940a-1ebfba2e639a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:45.169576 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 992/1984] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:22:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 20:22:49.462380 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d4495-cf7e-425e-b51e-0ca5b4d907bd None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:49.462966 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d4495-cf7e-425e-b51e-0ca5b4d907bd None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:49.462966 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d4495-cf7e-425e-b51e-0ca5b4d907bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:49.492577 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-c28d4495-cf7e-425e-b51e-0ca5b4d907bd None None] MFA Rules not processed for user `621ea4d1aae040298ba8420d767b33b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:22:49.493798 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-c28d4495-cf7e-425e-b51e-0ca5b4d907bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:49.571653 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 993/1985] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:22:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:22:49.577275 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db977e64-2509-4cc5-940a-1ebfba2e639a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:49.590676 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db977e64-2509-4cc5-940a-1ebfba2e639a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:49.608189 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dadcd6-22fa-49c8-b1f7-25c316a1f48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:49.608891 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dadcd6-22fa-49c8-b1f7-25c316a1f48c admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:49.609179 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dadcd6-22fa-49c8-b1f7-25c316a1f48c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:49.609461 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dadcd6-22fa-49c8-b1f7-25c316a1f48c admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:49.610226 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dadcd6-22fa-49c8-b1f7-25c316a1f48c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:49.612203 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dadcd6-22fa-49c8-b1f7-25c316a1f48c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:49.647415 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 993/1986] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:22:49 2022] POST /identity/v3/projects => generated 383 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:22:49.657096 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d4495-cf7e-425e-b51e-0ca5b4d907bd None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:49.671368 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d4495-cf7e-425e-b51e-0ca5b4d907bd None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:49.744203 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f3ac67-bd1e-4eb5-9a24-8b5d32c40f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:49.744893 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3ac67-bd1e-4eb5-9a24-8b5d32c40f31 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:49.745185 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3ac67-bd1e-4eb5-9a24-8b5d32c40f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:49.745472 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3ac67-bd1e-4eb5-9a24-8b5d32c40f31 admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:49.746204 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f3ac67-bd1e-4eb5-9a24-8b5d32c40f31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:49.748691 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f3ac67-bd1e-4eb5-9a24-8b5d32c40f31 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:49.772578 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 994/1987] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:22:49 2022] POST /identity/v3/users => generated 298 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 20:22:49.776568 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dadcd6-22fa-49c8-b1f7-25c316a1f48c admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:49.787729 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dadcd6-22fa-49c8-b1f7-25c316a1f48c admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:49.792673 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c756afa3-8397-4a18-903c-6a813100d0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:49.793901 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756afa3-8397-4a18-903c-6a813100d0a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:49.794191 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756afa3-8397-4a18-903c-6a813100d0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:49.794472 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756afa3-8397-4a18-903c-6a813100d0a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:49.795213 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c756afa3-8397-4a18-903c-6a813100d0a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:49.796883 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c756afa3-8397-4a18-903c-6a813100d0a4 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:49.808113 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 994/1988] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:22:49.812952 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f3ac67-bd1e-4eb5-9a24-8b5d32c40f31 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:49.823541 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f3ac67-bd1e-4eb5-9a24-8b5d32c40f31 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:49.828375 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8e4acb-eead-41f8-8518-7b9ec18e2202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:49.829295 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e4acb-eead-41f8-8518-7b9ec18e2202 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:49.829584 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e4acb-eead-41f8-8518-7b9ec18e2202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:49.829869 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e4acb-eead-41f8-8518-7b9ec18e2202 admin admin] PATH_INFO: `/v3/projects/9007dfcfa89449f88aeac7e56a33de94/users/d33f382841204e15947bc5a22f42d802/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:49.847639 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8e4acb-eead-41f8-8518-7b9ec18e2202 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9007dfcfa89449f88aeac7e56a33de94, user_id=d33f382841204e15947bc5a22f42d802, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:49.850361 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8e4acb-eead-41f8-8518-7b9ec18e2202 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:49.865905 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 995/1989] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:22:49 2022] PUT /identity/v3/projects/9007dfcfa89449f88aeac7e56a33de94/users/d33f382841204e15947bc5a22f42d802/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:22:49.870067 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c756afa3-8397-4a18-903c-6a813100d0a4 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:49.881199 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c756afa3-8397-4a18-903c-6a813100d0a4 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:49.928431 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:49.962428 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8389e52b-5221-4158-a77b-a426842fb446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:49.963136 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8389e52b-5221-4158-a77b-a426842fb446 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:49.963415 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8389e52b-5221-4158-a77b-a426842fb446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:49.963693 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8389e52b-5221-4158-a77b-a426842fb446 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:49.964461 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8389e52b-5221-4158-a77b-a426842fb446 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:49.966095 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8389e52b-5221-4158-a77b-a426842fb446 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:49.978032 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 995/1990] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:22:49.982866 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8e4acb-eead-41f8-8518-7b9ec18e2202 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:49.993777 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8e4acb-eead-41f8-8518-7b9ec18e2202 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:49.999783 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa93537-2db8-48c4-8355-a9324d1b8cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:50.000709 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa93537-2db8-48c4-8355-a9324d1b8cc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:50.000997 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa93537-2db8-48c4-8355-a9324d1b8cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:50.001268 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa93537-2db8-48c4-8355-a9324d1b8cc5 admin admin] PATH_INFO: `/v3/projects/9007dfcfa89449f88aeac7e56a33de94/users/d33f382841204e15947bc5a22f42d802/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:50.003312 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa93537-2db8-48c4-8355-a9324d1b8cc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9007dfcfa89449f88aeac7e56a33de94, user_id=d33f382841204e15947bc5a22f42d802, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:50.005902 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa93537-2db8-48c4-8355-a9324d1b8cc5 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:50.009617 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:50.019530 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 996/1991] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:22:49 2022] PUT /identity/v3/projects/9007dfcfa89449f88aeac7e56a33de94/users/d33f382841204e15947bc5a22f42d802/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:22:54.909010 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8389e52b-5221-4158-a77b-a426842fb446 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:54.913099 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8389e52b-5221-4158-a77b-a426842fb446 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:54.927593 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8389e52b-5221-4158-a77b-a426842fb446 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:55.020032 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514382fe-2a88-4fcd-ab20-e2b378e2f038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:55.021417 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514382fe-2a88-4fcd-ab20-e2b378e2f038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:55.021801 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514382fe-2a88-4fcd-ab20-e2b378e2f038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:55.022231 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514382fe-2a88-4fcd-ab20-e2b378e2f038 admin admin] PATH_INFO: `/v3/users/6d65fd9190124853941677eb704c5957` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:55.027969 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514382fe-2a88-4fcd-ab20-e2b378e2f038 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d65fd9190124853941677eb704c5957)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:55.027969 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514382fe-2a88-4fcd-ab20-e2b378e2f038 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:55.104963 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-514382fe-2a88-4fcd-ab20-e2b378e2f038 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d65fd9190124853941677eb704c5957'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:55.106924 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-514382fe-2a88-4fcd-ab20-e2b378e2f038 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d65fd9190124853941677eb704c5957'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:55.107789 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-514382fe-2a88-4fcd-ab20-e2b378e2f038 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d65fd9190124853941677eb704c5957'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:55.130295 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-514382fe-2a88-4fcd-ab20-e2b378e2f038 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d65fd9190124853941677eb704c5957'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:55.148954 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-514382fe-2a88-4fcd-ab20-e2b378e2f038 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d65fd9190124853941677eb704c5957'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:55.203182 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 996/1992] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:22:54 2022] DELETE /identity/v3/users/6d65fd9190124853941677eb704c5957 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:22:55.208026 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63fecf-8047-49fa-9249-660060e7a2d1 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:55.208927 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63fecf-8047-49fa-9249-660060e7a2d1 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:55.209459 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63fecf-8047-49fa-9249-660060e7a2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:55.246835 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-7e63fecf-8047-49fa-9249-660060e7a2d1 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:22:55.248331 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-7e63fecf-8047-49fa-9249-660060e7a2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:55.354352 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 997/1993] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:22:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:22:55.371959 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514382fe-2a88-4fcd-ab20-e2b378e2f038 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:55.376345 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-514382fe-2a88-4fcd-ab20-e2b378e2f038 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:55.518587 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514382fe-2a88-4fcd-ab20-e2b378e2f038 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:55.524694 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77762add-60c5-4955-aa0b-e8b804a57534 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:55.525445 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77762add-60c5-4955-aa0b-e8b804a57534 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:55.525783 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77762add-60c5-4955-aa0b-e8b804a57534 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:55.526071 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77762add-60c5-4955-aa0b-e8b804a57534 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:55.545987 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77762add-60c5-4955-aa0b-e8b804a57534 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:55.547618 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77762add-60c5-4955-aa0b-e8b804a57534 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:55.557645 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:55.574612 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 997/1994] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:22:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:22:56.564756 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e63fecf-8047-49fa-9249-660060e7a2d1 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:56.568388 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-7e63fecf-8047-49fa-9249-660060e7a2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:56.583259 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7d416-c422-4afa-8d9d-1ec886a7c788 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:56.583795 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7d416-c422-4afa-8d9d-1ec886a7c788 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:56.583795 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7d416-c422-4afa-8d9d-1ec886a7c788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:56.593588 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e63fecf-8047-49fa-9249-660060e7a2d1 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:56.606021 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195cca5e-cfe2-4e3b-b7a6-fa5ff0f969e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:56.608123 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195cca5e-cfe2-4e3b-b7a6-fa5ff0f969e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:56.608415 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195cca5e-cfe2-4e3b-b7a6-fa5ff0f969e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:56.608792 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195cca5e-cfe2-4e3b-b7a6-fa5ff0f969e2 admin admin] PATH_INFO: `/v3/projects/2d3af53430694b48bc98719d699fe03b` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:56.610099 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195cca5e-cfe2-4e3b-b7a6-fa5ff0f969e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d3af53430694b48bc98719d699fe03b)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:56.612405 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195cca5e-cfe2-4e3b-b7a6-fa5ff0f969e2 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:56.651367 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-19f7d416-c422-4afa-8d9d-1ec886a7c788 None None] MFA Rules not processed for user `d33f382841204e15947bc5a22f42d802`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:22:56.652813 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-19f7d416-c422-4afa-8d9d-1ec886a7c788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:56.716824 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-195cca5e-cfe2-4e3b-b7a6-fa5ff0f969e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d3af53430694b48bc98719d699fe03b', 'request_id': 'req-195cca5e-cfe2-4e3b-b7a6-fa5ff0f969e2'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:56.724221 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-195cca5e-cfe2-4e3b-b7a6-fa5ff0f969e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d3af53430694b48bc98719d699fe03b', 'request_id': 'req-195cca5e-cfe2-4e3b-b7a6-fa5ff0f969e2'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:56.737696 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-195cca5e-cfe2-4e3b-b7a6-fa5ff0f969e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d3af53430694b48bc98719d699fe03b', 'request_id': 'req-195cca5e-cfe2-4e3b-b7a6-fa5ff0f969e2'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:56.754123 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-195cca5e-cfe2-4e3b-b7a6-fa5ff0f969e2 admin admin] The token cache is being invalidate because project 2d3af53430694b48bc98719d699fe03b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:22:56.754776 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-195cca5e-cfe2-4e3b-b7a6-fa5ff0f969e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:56.755488 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-195cca5e-cfe2-4e3b-b7a6-fa5ff0f969e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:56.760205 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 998/1995] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:22:56 2022] DELETE /identity/v3/projects/2d3af53430694b48bc98719d699fe03b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:22:56.761722 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195cca5e-cfe2-4e3b-b7a6-fa5ff0f969e2 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:56.765782 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-195cca5e-cfe2-4e3b-b7a6-fa5ff0f969e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:56.772524 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 998/1996] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:22:56 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:22:56.785813 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f7d416-c422-4afa-8d9d-1ec886a7c788 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:56.788842 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-19f7d416-c422-4afa-8d9d-1ec886a7c788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:56.872312 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f7d416-c422-4afa-8d9d-1ec886a7c788 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:56.882439 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195cca5e-cfe2-4e3b-b7a6-fa5ff0f969e2 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:56.887490 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9d7d4-0e2b-4216-8491-b870e15f8da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:56.888458 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9d7d4-0e2b-4216-8491-b870e15f8da4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:56.888749 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9d7d4-0e2b-4216-8491-b870e15f8da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:56.889027 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9d7d4-0e2b-4216-8491-b870e15f8da4 admin admin] PATH_INFO: `/v3/users/9a745988f70e492fa14fc63d49c86924` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:56.890236 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e9d7d4-0e2b-4216-8491-b870e15f8da4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a745988f70e492fa14fc63d49c86924)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:56.892166 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e9d7d4-0e2b-4216-8491-b870e15f8da4 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:56.915652 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:56.935290 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2b41c-373c-41b9-bf3b-a240b75111ca service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30400df887ee433086d1810331785891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:56.936129 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2b41c-373c-41b9-bf3b-a240b75111ca service glance] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:56.936512 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2b41c-373c-41b9-bf3b-a240b75111ca service glance] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:56.936977 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2b41c-373c-41b9-bf3b-a240b75111ca service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:56.938781 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a2f2b41c-373c-41b9-bf3b-a240b75111ca service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:56.946368 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-66e9d7d4-0e2b-4216-8491-b870e15f8da4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a745988f70e492fa14fc63d49c86924'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:56.946368 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-66e9d7d4-0e2b-4216-8491-b870e15f8da4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a745988f70e492fa14fc63d49c86924'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:56.954292 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-66e9d7d4-0e2b-4216-8491-b870e15f8da4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a745988f70e492fa14fc63d49c86924'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:56.969476 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-66e9d7d4-0e2b-4216-8491-b870e15f8da4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a745988f70e492fa14fc63d49c86924'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:56.970946 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-66e9d7d4-0e2b-4216-8491-b870e15f8da4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a745988f70e492fa14fc63d49c86924'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:56.986723 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 999/1997] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:22:56 2022] DELETE /identity/v3/users/9a745988f70e492fa14fc63d49c86924 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:22:57.005128 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:57.010805 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2b41c-373c-41b9-bf3b-a240b75111ca service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:57.012727 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2b41c-373c-41b9-bf3b-a240b75111ca service glance] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:57.030645 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 999/1998] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:22:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:22:57.151546 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e71afce-ad14-4bf7-9919-7f8692cdb677 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:57.151836 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e71afce-ad14-4bf7-9919-7f8692cdb677 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:57.152170 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e71afce-ad14-4bf7-9919-7f8692cdb677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:57.179361 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-2e71afce-ad14-4bf7-9919-7f8692cdb677 None None] MFA Rules not processed for user `5cf067b8833f4596a1b91073a66768f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:22:57.180747 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-2e71afce-ad14-4bf7-9919-7f8692cdb677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:57.248210 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1000/1999] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jun 21 20:22:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:22:57.305275 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2b41c-373c-41b9-bf3b-a240b75111ca service glance] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:57.307216 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a2f2b41c-373c-41b9-bf3b-a240b75111ca service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:57.320246 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e71afce-ad14-4bf7-9919-7f8692cdb677 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:57.321685 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-2e71afce-ad14-4bf7-9919-7f8692cdb677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:57.413509 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2b41c-373c-41b9-bf3b-a240b75111ca service glance] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:57.450650 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e71afce-ad14-4bf7-9919-7f8692cdb677 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:57.460001 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91f1a18-bee2-4d7d-a28c-888ea4d0f1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:57.462086 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f1a18-bee2-4d7d-a28c-888ea4d0f1e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:57.462377 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f1a18-bee2-4d7d-a28c-888ea4d0f1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:57.462655 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f1a18-bee2-4d7d-a28c-888ea4d0f1e5 admin admin] PATH_INFO: `/v3/projects/5db14d56fe6e42788d97b0a9c13db8dd` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:57.463964 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91f1a18-bee2-4d7d-a28c-888ea4d0f1e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5db14d56fe6e42788d97b0a9c13db8dd)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:57.467001 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91f1a18-bee2-4d7d-a28c-888ea4d0f1e5 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:57.522661 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c444552d-f644-4950-9464-c77b88c8d506 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '038537bd12174154ba259e097b97b8bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:57.524273 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444552d-f644-4950-9464-c77b88c8d506 service swift] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:57.524953 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444552d-f644-4950-9464-c77b88c8d506 service swift] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:57.526338 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444552d-f644-4950-9464-c77b88c8d506 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:57.538530 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c444552d-f644-4950-9464-c77b88c8d506 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:57.541031 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c444552d-f644-4950-9464-c77b88c8d506 service swift] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:57.554314 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:57.560304 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-d91f1a18-bee2-4d7d-a28c-888ea4d0f1e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5db14d56fe6e42788d97b0a9c13db8dd', 'request_id': 'req-d91f1a18-bee2-4d7d-a28c-888ea4d0f1e5'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:57.571417 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-d91f1a18-bee2-4d7d-a28c-888ea4d0f1e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5db14d56fe6e42788d97b0a9c13db8dd', 'request_id': 'req-d91f1a18-bee2-4d7d-a28c-888ea4d0f1e5'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:57.572693 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1000/2000] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jun 21 20:22:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 20:22:57.594105 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-d91f1a18-bee2-4d7d-a28c-888ea4d0f1e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5db14d56fe6e42788d97b0a9c13db8dd', 'request_id': 'req-d91f1a18-bee2-4d7d-a28c-888ea4d0f1e5'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:57.612123 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-d91f1a18-bee2-4d7d-a28c-888ea4d0f1e5 admin admin] The token cache is being invalidate because project 5db14d56fe6e42788d97b0a9c13db8dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:22:57.612406 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-d91f1a18-bee2-4d7d-a28c-888ea4d0f1e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:57.620116 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-d91f1a18-bee2-4d7d-a28c-888ea4d0f1e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:22:57.626617 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1001/2001] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:22:57 2022] DELETE /identity/v3/projects/5db14d56fe6e42788d97b0a9c13db8dd => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:22:57.628261 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f25629-345e-4a7c-9c2a-9e0ceb0607eb None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:57.628752 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f25629-345e-4a7c-9c2a-9e0ceb0607eb None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:57.628843 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f25629-345e-4a7c-9c2a-9e0ceb0607eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:57.659776 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-42f25629-345e-4a7c-9c2a-9e0ceb0607eb None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:22:57.662330 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-42f25629-345e-4a7c-9c2a-9e0ceb0607eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:57.824144 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1001/2002] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:22:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:22:57.833421 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415526e7-3eef-4838-951d-8007c85343bf None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:57.833777 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415526e7-3eef-4838-951d-8007c85343bf None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:57.834145 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415526e7-3eef-4838-951d-8007c85343bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:57.868234 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-415526e7-3eef-4838-951d-8007c85343bf None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:22:57.874540 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-415526e7-3eef-4838-951d-8007c85343bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:57.901136 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1002/2003] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:22:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:22:57.905769 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f25629-345e-4a7c-9c2a-9e0ceb0607eb None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:57.918072 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f25629-345e-4a7c-9c2a-9e0ceb0607eb None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:57.932718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8f877-9d35-48ec-b644-dd9c8b331cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:57.933472 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8f877-9d35-48ec-b644-dd9c8b331cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:57.934800 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8f877-9d35-48ec-b644-dd9c8b331cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:57.935100 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8f877-9d35-48ec-b644-dd9c8b331cf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:57.936684 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca8f877-9d35-48ec-b644-dd9c8b331cf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:22:57.937004 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca8f877-9d35-48ec-b644-dd9c8b331cf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:57.939234 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca8f877-9d35-48ec-b644-dd9c8b331cf4 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:57.974005 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1002/2004] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:22:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:22:57.974227 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415526e7-3eef-4838-951d-8007c85343bf None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:57.988129 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415526e7-3eef-4838-951d-8007c85343bf None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:58.000765 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78055e1d-a722-45c9-876d-1d132c0c2579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:58.001591 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78055e1d-a722-45c9-876d-1d132c0c2579 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:58.001888 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78055e1d-a722-45c9-876d-1d132c0c2579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:58.002215 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78055e1d-a722-45c9-876d-1d132c0c2579 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:58.003051 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78055e1d-a722-45c9-876d-1d132c0c2579 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:58.005036 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78055e1d-a722-45c9-876d-1d132c0c2579 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:58.053362 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1003/2005] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:22:57 2022] POST /identity/v3/projects => generated 389 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 20:22:58.056932 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8f877-9d35-48ec-b644-dd9c8b331cf4 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:58.069762 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8f877-9d35-48ec-b644-dd9c8b331cf4 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:58.094002 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:58.182551 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eee20e-f97c-434e-b1d7-acc56c7dff54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:58.183473 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eee20e-f97c-434e-b1d7-acc56c7dff54 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:58.186887 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eee20e-f97c-434e-b1d7-acc56c7dff54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:58.186887 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eee20e-f97c-434e-b1d7-acc56c7dff54 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:58.186887 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eee20e-f97c-434e-b1d7-acc56c7dff54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:58.188982 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eee20e-f97c-434e-b1d7-acc56c7dff54 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:58.234263 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1003/2006] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:22:58 2022] POST /identity/v3/users => generated 295 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:22:58.234481 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78055e1d-a722-45c9-876d-1d132c0c2579 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:58.245640 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78055e1d-a722-45c9-876d-1d132c0c2579 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:58.262025 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e026267-281f-4536-9de8-390c1ac9a07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:58.262732 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e026267-281f-4536-9de8-390c1ac9a07b admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:58.263026 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e026267-281f-4536-9de8-390c1ac9a07b admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:58.263311 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e026267-281f-4536-9de8-390c1ac9a07b admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:58.264115 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e026267-281f-4536-9de8-390c1ac9a07b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:58.265748 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e026267-281f-4536-9de8-390c1ac9a07b admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:58.298847 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1004/2007] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:22:58.299021 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eee20e-f97c-434e-b1d7-acc56c7dff54 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:58.328321 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eee20e-f97c-434e-b1d7-acc56c7dff54 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:58.347090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438fc980-3816-4472-8ae3-f305995d5d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:58.348037 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fc980-3816-4472-8ae3-f305995d5d92 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:58.348503 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fc980-3816-4472-8ae3-f305995d5d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:58.354654 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fc980-3816-4472-8ae3-f305995d5d92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:58.356158 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438fc980-3816-4472-8ae3-f305995d5d92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:58.361059 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438fc980-3816-4472-8ae3-f305995d5d92 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:58.404646 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1004/2008] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 20:22:58.408530 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e026267-281f-4536-9de8-390c1ac9a07b admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:58.426607 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e026267-281f-4536-9de8-390c1ac9a07b admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:58.441924 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc6d92-2a1f-4e4d-96f5-8f7273d8bc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:58.446344 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc6d92-2a1f-4e4d-96f5-8f7273d8bc7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:58.446344 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc6d92-2a1f-4e4d-96f5-8f7273d8bc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:58.446344 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc6d92-2a1f-4e4d-96f5-8f7273d8bc7c admin admin] PATH_INFO: `/v3/projects/5862a0d3ca844930afe23ea91d12c128/users/367ed950c64e464ea7a967cc89b69afe/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:58.476855 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc6d92-2a1f-4e4d-96f5-8f7273d8bc7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5862a0d3ca844930afe23ea91d12c128, user_id=367ed950c64e464ea7a967cc89b69afe, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:58.480716 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc6d92-2a1f-4e4d-96f5-8f7273d8bc7c admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:58.503067 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1005/2009] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:22:58 2022] PUT /identity/v3/projects/5862a0d3ca844930afe23ea91d12c128/users/367ed950c64e464ea7a967cc89b69afe/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:22:58.513710 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c7924-750d-46af-b619-249e678442ce None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:58.515142 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c7924-750d-46af-b619-249e678442ce None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:58.515763 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c7924-750d-46af-b619-249e678442ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:58.583384 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-744c7924-750d-46af-b619-249e678442ce None None] MFA Rules not processed for user `367ed950c64e464ea7a967cc89b69afe`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:22:58.585018 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-744c7924-750d-46af-b619-249e678442ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:58.714038 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1005/2010] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:22:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:22:58.718598 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc6d92-2a1f-4e4d-96f5-8f7273d8bc7c admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:58.799323 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc6d92-2a1f-4e4d-96f5-8f7273d8bc7c admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:58.805057 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe6e9df-4c34-474a-8a9b-64af7e88d955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:58.806043 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe6e9df-4c34-474a-8a9b-64af7e88d955 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:58.806195 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe6e9df-4c34-474a-8a9b-64af7e88d955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:58.806467 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe6e9df-4c34-474a-8a9b-64af7e88d955 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:58.807592 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe6e9df-4c34-474a-8a9b-64af7e88d955 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:58.809875 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe6e9df-4c34-474a-8a9b-64af7e88d955 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:58.872528 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c7924-750d-46af-b619-249e678442ce None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:58.878638 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1006/2011] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:22:58 2022] POST /identity/v3/projects => generated 389 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:22:58.884766 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c7924-750d-46af-b619-249e678442ce None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:59.012503 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12965b8-809d-4b49-80c5-c3e174669e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:59.013442 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12965b8-809d-4b49-80c5-c3e174669e71 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:59.013811 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12965b8-809d-4b49-80c5-c3e174669e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:59.014158 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12965b8-809d-4b49-80c5-c3e174669e71 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:59.014962 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12965b8-809d-4b49-80c5-c3e174669e71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:59.019060 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12965b8-809d-4b49-80c5-c3e174669e71 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:59.062313 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1006/2012] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:22:58 2022] POST /identity/v3/users => generated 301 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:22:59.063142 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe6e9df-4c34-474a-8a9b-64af7e88d955 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:59.073704 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe6e9df-4c34-474a-8a9b-64af7e88d955 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:59.082180 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b072375-2cbb-4688-8ddd-7385f043dc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:59.082910 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b072375-2cbb-4688-8ddd-7385f043dc19 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:59.083198 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b072375-2cbb-4688-8ddd-7385f043dc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:59.083480 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b072375-2cbb-4688-8ddd-7385f043dc19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:59.084265 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b072375-2cbb-4688-8ddd-7385f043dc19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:59.085890 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b072375-2cbb-4688-8ddd-7385f043dc19 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:59.103352 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12965b8-809d-4b49-80c5-c3e174669e71 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:59.104059 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1007/2013] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:22:59.118368 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12965b8-809d-4b49-80c5-c3e174669e71 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:59.130521 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb96b9-9007-4746-a517-087ac4e47ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:59.131482 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb96b9-9007-4746-a517-087ac4e47ab0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:59.131771 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb96b9-9007-4746-a517-087ac4e47ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:59.132685 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb96b9-9007-4746-a517-087ac4e47ab0 admin admin] PATH_INFO: `/v3/projects/4efae70719fe41e2b2dd87cdfa4a3406/users/0264aaf7a47a418f931651e0227ee392/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:59.150458 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:59.163995 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eb96b9-9007-4746-a517-087ac4e47ab0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4efae70719fe41e2b2dd87cdfa4a3406, user_id=0264aaf7a47a418f931651e0227ee392, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:59.167133 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eb96b9-9007-4746-a517-087ac4e47ab0 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:59.196164 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b072375-2cbb-4688-8ddd-7385f043dc19 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:59.202455 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1007/2014] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:22:59 2022] PUT /identity/v3/projects/4efae70719fe41e2b2dd87cdfa4a3406/users/0264aaf7a47a418f931651e0227ee392/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:22:59.210938 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b072375-2cbb-4688-8ddd-7385f043dc19 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:59.300480 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:22:59.335105 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251eac88-6c4f-4e6a-954d-d039941b6f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:59.337529 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251eac88-6c4f-4e6a-954d-d039941b6f02 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:59.337529 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251eac88-6c4f-4e6a-954d-d039941b6f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:59.337529 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251eac88-6c4f-4e6a-954d-d039941b6f02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:59.338250 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251eac88-6c4f-4e6a-954d-d039941b6f02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:59.339414 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251eac88-6c4f-4e6a-954d-d039941b6f02 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:59.371129 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1008/2015] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:22:59.376405 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb96b9-9007-4746-a517-087ac4e47ab0 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:59.401090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb96b9-9007-4746-a517-087ac4e47ab0 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:59.413951 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b3cadd-f50b-4ecd-b430-c3d3cd465a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:59.415235 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3cadd-f50b-4ecd-b430-c3d3cd465a33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:59.415689 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3cadd-f50b-4ecd-b430-c3d3cd465a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:59.416189 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3cadd-f50b-4ecd-b430-c3d3cd465a33 admin admin] PATH_INFO: `/v3/projects/4efae70719fe41e2b2dd87cdfa4a3406/users/0264aaf7a47a418f931651e0227ee392/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:59.420746 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b3cadd-f50b-4ecd-b430-c3d3cd465a33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4efae70719fe41e2b2dd87cdfa4a3406, user_id=0264aaf7a47a418f931651e0227ee392, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:59.423625 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b3cadd-f50b-4ecd-b430-c3d3cd465a33 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:59.448708 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1008/2016] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:22:59 2022] PUT /identity/v3/projects/4efae70719fe41e2b2dd87cdfa4a3406/users/0264aaf7a47a418f931651e0227ee392/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:22:59.448910 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257eeba-fe4f-4c1e-ac9b-824de2f1abeb None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:59.449005 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257eeba-fe4f-4c1e-ac9b-824de2f1abeb None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:59.449344 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257eeba-fe4f-4c1e-ac9b-824de2f1abeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:59.504160 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-e257eeba-fe4f-4c1e-ac9b-824de2f1abeb None None] MFA Rules not processed for user `0264aaf7a47a418f931651e0227ee392`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:22:59.505429 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-e257eeba-fe4f-4c1e-ac9b-824de2f1abeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:59.627858 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1009/2017] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:22:59 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 20:22:59.639174 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b3cadd-f50b-4ecd-b430-c3d3cd465a33 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:22:59.641683 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b3b3cadd-f50b-4ecd-b430-c3d3cd465a33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:22:59.733881 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b3cadd-f50b-4ecd-b430-c3d3cd465a33 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:22:59.739686 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfed95-c8e9-4646-845c-a32948dae289 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:22:59.740417 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfed95-c8e9-4646-845c-a32948dae289 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:22:59.740707 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfed95-c8e9-4646-845c-a32948dae289 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:22:59.740993 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfed95-c8e9-4646-845c-a32948dae289 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:22:59.753366 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dfed95-c8e9-4646-845c-a32948dae289 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:22:59.754980 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dfed95-c8e9-4646-845c-a32948dae289 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:22:59.766947 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1009/2018] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:22:59 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:22:59.924999 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e257eeba-fe4f-4c1e-ac9b-824de2f1abeb None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:00.030716 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e257eeba-fe4f-4c1e-ac9b-824de2f1abeb None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:00.036541 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d343b-653f-4373-9b29-a5851e9403b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:00.039867 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d343b-653f-4373-9b29-a5851e9403b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:00.040377 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d343b-653f-4373-9b29-a5851e9403b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:00.040874 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d343b-653f-4373-9b29-a5851e9403b9 admin admin] PATH_INFO: `/v3/users/367ed950c64e464ea7a967cc89b69afe` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:00.042414 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365d343b-653f-4373-9b29-a5851e9403b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=367ed950c64e464ea7a967cc89b69afe)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:00.044838 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365d343b-653f-4373-9b29-a5851e9403b9 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:00.124644 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-365d343b-653f-4373-9b29-a5851e9403b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '367ed950c64e464ea7a967cc89b69afe'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:00.125610 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-365d343b-653f-4373-9b29-a5851e9403b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '367ed950c64e464ea7a967cc89b69afe'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:00.150632 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-365d343b-653f-4373-9b29-a5851e9403b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '367ed950c64e464ea7a967cc89b69afe'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:00.166160 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:23:00.168411 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-365d343b-653f-4373-9b29-a5851e9403b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '367ed950c64e464ea7a967cc89b69afe'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:00.171029 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-365d343b-653f-4373-9b29-a5851e9403b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '367ed950c64e464ea7a967cc89b69afe'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:00.192682 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1010/2019] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:22:59 2022] DELETE /identity/v3/users/367ed950c64e464ea7a967cc89b69afe => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:23:00.194491 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de3cab-51d5-4be5-b59b-33009aac6efa None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:00.194788 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de3cab-51d5-4be5-b59b-33009aac6efa None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:00.195092 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de3cab-51d5-4be5-b59b-33009aac6efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:00.230013 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f8de3cab-51d5-4be5-b59b-33009aac6efa None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:23:00.231511 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f8de3cab-51d5-4be5-b59b-33009aac6efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:23:00.349501 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1010/2020] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:23:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:23:00.359854 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d343b-653f-4373-9b29-a5851e9403b9 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:00.361456 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-365d343b-653f-4373-9b29-a5851e9403b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:23:00.449667 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d343b-653f-4373-9b29-a5851e9403b9 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:00.453652 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c4d3d-862f-4b50-91d6-41efa81b1e8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:00.454325 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c4d3d-862f-4b50-91d6-41efa81b1e8d service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:00.454617 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c4d3d-862f-4b50-91d6-41efa81b1e8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:00.454900 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c4d3d-862f-4b50-91d6-41efa81b1e8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:00.474313 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c4d3d-862f-4b50-91d6-41efa81b1e8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:00.475977 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c4d3d-862f-4b50-91d6-41efa81b1e8d service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:00.493421 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1011/2021] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:23:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:23:01.010692 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de3cab-51d5-4be5-b59b-33009aac6efa None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:01.012761 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f8de3cab-51d5-4be5-b59b-33009aac6efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:23:01.053286 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de3cab-51d5-4be5-b59b-33009aac6efa None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:01.067020 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8fda2-54b0-4f04-b4e7-04c607eed6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:01.068520 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8fda2-54b0-4f04-b4e7-04c607eed6c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:01.069750 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8fda2-54b0-4f04-b4e7-04c607eed6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:01.070954 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8fda2-54b0-4f04-b4e7-04c607eed6c4 admin admin] PATH_INFO: `/v3/projects/5862a0d3ca844930afe23ea91d12c128` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:01.075517 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def8fda2-54b0-4f04-b4e7-04c607eed6c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5862a0d3ca844930afe23ea91d12c128)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:01.092775 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def8fda2-54b0-4f04-b4e7-04c607eed6c4 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:01.196383 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-def8fda2-54b0-4f04-b4e7-04c607eed6c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5862a0d3ca844930afe23ea91d12c128', 'request_id': 'req-def8fda2-54b0-4f04-b4e7-04c607eed6c4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:01.216842 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-def8fda2-54b0-4f04-b4e7-04c607eed6c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5862a0d3ca844930afe23ea91d12c128', 'request_id': 'req-def8fda2-54b0-4f04-b4e7-04c607eed6c4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:01.228357 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-def8fda2-54b0-4f04-b4e7-04c607eed6c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5862a0d3ca844930afe23ea91d12c128', 'request_id': 'req-def8fda2-54b0-4f04-b4e7-04c607eed6c4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:01.240259 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:23:01.260464 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-def8fda2-54b0-4f04-b4e7-04c607eed6c4 admin admin] The token cache is being invalidate because project 5862a0d3ca844930afe23ea91d12c128 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:23:01.261021 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-def8fda2-54b0-4f04-b4e7-04c607eed6c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:01.262477 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-def8fda2-54b0-4f04-b4e7-04c607eed6c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:01.265886 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1011/2022] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:23:01 2022] DELETE /identity/v3/projects/5862a0d3ca844930afe23ea91d12c128 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:23:01.268901 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c4d3d-862f-4b50-91d6-41efa81b1e8d service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:01.282043 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c4d3d-862f-4b50-91d6-41efa81b1e8d service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:01.368427 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd81890-c491-43f2-8e6f-de3ac8b701f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:01.369582 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd81890-c491-43f2-8e6f-de3ac8b701f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:01.370075 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd81890-c491-43f2-8e6f-de3ac8b701f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:01.370625 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd81890-c491-43f2-8e6f-de3ac8b701f5 admin admin] PATH_INFO: `/v3/users/0264aaf7a47a418f931651e0227ee392` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:01.372311 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd81890-c491-43f2-8e6f-de3ac8b701f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0264aaf7a47a418f931651e0227ee392)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:01.374594 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd81890-c491-43f2-8e6f-de3ac8b701f5 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:01.451957 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-1fd81890-c491-43f2-8e6f-de3ac8b701f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0264aaf7a47a418f931651e0227ee392'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:01.452932 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-1fd81890-c491-43f2-8e6f-de3ac8b701f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0264aaf7a47a418f931651e0227ee392'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:01.464898 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-1fd81890-c491-43f2-8e6f-de3ac8b701f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0264aaf7a47a418f931651e0227ee392'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:01.482599 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-1fd81890-c491-43f2-8e6f-de3ac8b701f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0264aaf7a47a418f931651e0227ee392'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:01.484331 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-1fd81890-c491-43f2-8e6f-de3ac8b701f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0264aaf7a47a418f931651e0227ee392'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:01.504033 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1012/2023] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:23:01 2022] DELETE /identity/v3/users/0264aaf7a47a418f931651e0227ee392 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:23:02.181926 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8fda2-54b0-4f04-b4e7-04c607eed6c4 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:02.183608 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-def8fda2-54b0-4f04-b4e7-04c607eed6c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:23:02.198407 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8fda2-54b0-4f04-b4e7-04c607eed6c4 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:02.288614 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e63c2-a0e4-424f-9a5c-ed567a8240be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:02.289580 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e63c2-a0e4-424f-9a5c-ed567a8240be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:02.289787 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e63c2-a0e4-424f-9a5c-ed567a8240be admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:02.290072 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e63c2-a0e4-424f-9a5c-ed567a8240be admin admin] PATH_INFO: `/v3/projects/4efae70719fe41e2b2dd87cdfa4a3406` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:02.291293 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92e63c2-a0e4-424f-9a5c-ed567a8240be admin admin] RBAC: Authorizing `identity:delete_project(project_id=4efae70719fe41e2b2dd87cdfa4a3406)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:02.293888 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92e63c2-a0e4-424f-9a5c-ed567a8240be admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:02.364024 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f92e63c2-a0e4-424f-9a5c-ed567a8240be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4efae70719fe41e2b2dd87cdfa4a3406', 'request_id': 'req-f92e63c2-a0e4-424f-9a5c-ed567a8240be'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:02.374620 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f92e63c2-a0e4-424f-9a5c-ed567a8240be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4efae70719fe41e2b2dd87cdfa4a3406', 'request_id': 'req-f92e63c2-a0e4-424f-9a5c-ed567a8240be'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:02.383373 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f92e63c2-a0e4-424f-9a5c-ed567a8240be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4efae70719fe41e2b2dd87cdfa4a3406', 'request_id': 'req-f92e63c2-a0e4-424f-9a5c-ed567a8240be'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:02.398844 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f92e63c2-a0e4-424f-9a5c-ed567a8240be admin admin] The token cache is being invalidate because project 4efae70719fe41e2b2dd87cdfa4a3406 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:23:02.399229 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f92e63c2-a0e4-424f-9a5c-ed567a8240be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:02.400263 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f92e63c2-a0e4-424f-9a5c-ed567a8240be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:02.405587 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1012/2024] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:23:02 2022] DELETE /identity/v3/projects/4efae70719fe41e2b2dd87cdfa4a3406 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:23:02.407390 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e7378-4df3-448a-b2f7-225c45d61b4c None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:02.407885 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e7378-4df3-448a-b2f7-225c45d61b4c None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:02.408111 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e7378-4df3-448a-b2f7-225c45d61b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:02.425342 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:23:02.437305 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-629e7378-4df3-448a-b2f7-225c45d61b4c None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:23:02.440796 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-629e7378-4df3-448a-b2f7-225c45d61b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:23:02.561865 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1013/2025] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:23:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:23:02.569895 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754bf758-7414-4451-9ff9-d5ce59026e40 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:02.570825 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754bf758-7414-4451-9ff9-d5ce59026e40 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:02.571322 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754bf758-7414-4451-9ff9-d5ce59026e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:02.605644 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-754bf758-7414-4451-9ff9-d5ce59026e40 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:23:02.606971 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-754bf758-7414-4451-9ff9-d5ce59026e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:23:02.615358 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1013/2026] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:23:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:23:02.619657 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e7378-4df3-448a-b2f7-225c45d61b4c None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:02.630136 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e7378-4df3-448a-b2f7-225c45d61b4c None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:02.634785 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a14ee-c71b-4900-81b6-17f04b73b905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:02.635468 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a14ee-c71b-4900-81b6-17f04b73b905 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:02.635758 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a14ee-c71b-4900-81b6-17f04b73b905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:02.636084 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a14ee-c71b-4900-81b6-17f04b73b905 admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:02.637365 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a14ee-c71b-4900-81b6-17f04b73b905 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:23:02.637680 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a14ee-c71b-4900-81b6-17f04b73b905 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:02.639596 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a14ee-c71b-4900-81b6-17f04b73b905 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:02.653199 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1014/2027] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:23:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:23:02.657329 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754bf758-7414-4451-9ff9-d5ce59026e40 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:02.667952 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754bf758-7414-4451-9ff9-d5ce59026e40 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:02.672880 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd621bb-660e-4004-adb7-662a4ba35b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:02.673543 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd621bb-660e-4004-adb7-662a4ba35b5c admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:02.673830 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd621bb-660e-4004-adb7-662a4ba35b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:02.674106 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd621bb-660e-4004-adb7-662a4ba35b5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:02.674808 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd621bb-660e-4004-adb7-662a4ba35b5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:02.677373 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd621bb-660e-4004-adb7-662a4ba35b5c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:02.713540 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1014/2028] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:23:02 2022] POST /identity/v3/projects => generated 387 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:23:02.718045 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a14ee-c71b-4900-81b6-17f04b73b905 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:02.730282 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a14ee-c71b-4900-81b6-17f04b73b905 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:02.804889 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa3eb08-320c-44e1-aef4-d57de6cff18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:02.805577 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3eb08-320c-44e1-aef4-d57de6cff18d admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:02.805865 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3eb08-320c-44e1-aef4-d57de6cff18d admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:02.806143 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3eb08-320c-44e1-aef4-d57de6cff18d admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:02.806856 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa3eb08-320c-44e1-aef4-d57de6cff18d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:02.808843 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa3eb08-320c-44e1-aef4-d57de6cff18d admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:02.853983 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1015/2029] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:23:02 2022] POST /identity/v3/users => generated 294 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:23:02.857945 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd621bb-660e-4004-adb7-662a4ba35b5c admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:02.872040 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd621bb-660e-4004-adb7-662a4ba35b5c admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:02.878432 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd24e8-fec4-44cd-b868-b85edfd98873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:02.879479 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd24e8-fec4-44cd-b868-b85edfd98873 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:02.879955 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd24e8-fec4-44cd-b868-b85edfd98873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:02.880473 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd24e8-fec4-44cd-b868-b85edfd98873 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:02.881227 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfd24e8-fec4-44cd-b868-b85edfd98873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:02.882821 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfd24e8-fec4-44cd-b868-b85edfd98873 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:02.898331 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1015/2030] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:23:02 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:23:02.899945 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa3eb08-320c-44e1-aef4-d57de6cff18d admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:02.938226 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa3eb08-320c-44e1-aef4-d57de6cff18d admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:02.952860 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc3d798-1da8-4598-918e-0faa5b805932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:02.953973 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3d798-1da8-4598-918e-0faa5b805932 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:02.954718 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3d798-1da8-4598-918e-0faa5b805932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:02.955167 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3d798-1da8-4598-918e-0faa5b805932 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:02.956297 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc3d798-1da8-4598-918e-0faa5b805932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:02.961751 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc3d798-1da8-4598-918e-0faa5b805932 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:02.988672 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1016/2031] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:23:02 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:23:02.992906 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd24e8-fec4-44cd-b868-b85edfd98873 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:03.008450 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd24e8-fec4-44cd-b868-b85edfd98873 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:03.019634 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4241d5c9-d3ca-48e2-8e4e-1ff6e83d35fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:03.020680 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241d5c9-d3ca-48e2-8e4e-1ff6e83d35fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:03.021028 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241d5c9-d3ca-48e2-8e4e-1ff6e83d35fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:03.021476 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241d5c9-d3ca-48e2-8e4e-1ff6e83d35fc admin admin] PATH_INFO: `/v3/projects/d7f187eee3724ff5bac84c12141a7f33/users/d04d5d5a103b4f4db35760f1d0191cc5/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:03.050287 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4241d5c9-d3ca-48e2-8e4e-1ff6e83d35fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7f187eee3724ff5bac84c12141a7f33, user_id=d04d5d5a103b4f4db35760f1d0191cc5, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:03.054778 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4241d5c9-d3ca-48e2-8e4e-1ff6e83d35fc admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:03.097023 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1016/2032] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:23:02 2022] PUT /identity/v3/projects/d7f187eee3724ff5bac84c12141a7f33/users/d04d5d5a103b4f4db35760f1d0191cc5/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:23:03.100072 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a347c8-488f-4183-9b66-a8f909a75828 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:03.100623 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a347c8-488f-4183-9b66-a8f909a75828 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:03.101168 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a347c8-488f-4183-9b66-a8f909a75828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:03.161056 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-95a347c8-488f-4183-9b66-a8f909a75828 None None] MFA Rules not processed for user `d04d5d5a103b4f4db35760f1d0191cc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:23:03.162570 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-95a347c8-488f-4183-9b66-a8f909a75828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:23:03.315668 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1017/2033] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:23:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:23:03.321105 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4241d5c9-d3ca-48e2-8e4e-1ff6e83d35fc admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:03.361635 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:23:03.412538 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4241d5c9-d3ca-48e2-8e4e-1ff6e83d35fc admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:03.418412 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9015e6-3e8f-4636-9881-be9ce02b1b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:03.419375 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9015e6-3e8f-4636-9881-be9ce02b1b0f admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:03.419834 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9015e6-3e8f-4636-9881-be9ce02b1b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:03.420314 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9015e6-3e8f-4636-9881-be9ce02b1b0f admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:03.421192 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9015e6-3e8f-4636-9881-be9ce02b1b0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:03.423279 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9015e6-3e8f-4636-9881-be9ce02b1b0f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:03.478947 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1017/2034] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:23:03 2022] POST /identity/v3/projects => generated 385 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:23:03.483561 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a347c8-488f-4183-9b66-a8f909a75828 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:03.489650 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:23:03.497182 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a347c8-488f-4183-9b66-a8f909a75828 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:03.575709 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f8cf8-d9a0-48cd-84dd-774e9e0d22c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:03.576490 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f8cf8-d9a0-48cd-84dd-774e9e0d22c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:03.576873 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f8cf8-d9a0-48cd-84dd-774e9e0d22c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:03.577159 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f8cf8-d9a0-48cd-84dd-774e9e0d22c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:03.578062 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302f8cf8-d9a0-48cd-84dd-774e9e0d22c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:03.579911 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302f8cf8-d9a0-48cd-84dd-774e9e0d22c1 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:03.603808 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1018/2035] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:23:03 2022] POST /identity/v3/users => generated 299 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:23:03.608890 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9015e6-3e8f-4636-9881-be9ce02b1b0f admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:03.624242 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9015e6-3e8f-4636-9881-be9ce02b1b0f admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:03.636908 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62e3f5-76da-4c71-89e3-ec5268e8ed74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:03.638116 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62e3f5-76da-4c71-89e3-ec5268e8ed74 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:03.638505 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62e3f5-76da-4c71-89e3-ec5268e8ed74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:03.638794 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62e3f5-76da-4c71-89e3-ec5268e8ed74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:03.639940 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62e3f5-76da-4c71-89e3-ec5268e8ed74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:03.641729 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62e3f5-76da-4c71-89e3-ec5268e8ed74 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:03.654967 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1018/2036] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 20:23:03.659519 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f8cf8-d9a0-48cd-84dd-774e9e0d22c1 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:03.674234 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f8cf8-d9a0-48cd-84dd-774e9e0d22c1 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:03.680320 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1468156b-acbb-4563-9104-58e3303e3003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:03.681270 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468156b-acbb-4563-9104-58e3303e3003 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:03.681580 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468156b-acbb-4563-9104-58e3303e3003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:03.681857 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468156b-acbb-4563-9104-58e3303e3003 admin admin] PATH_INFO: `/v3/projects/d70b9993333342e9a0ca21f903ed9100/users/57c24a93d2f64b7da117c27e42ad8321/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:03.708137 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1468156b-acbb-4563-9104-58e3303e3003 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d70b9993333342e9a0ca21f903ed9100, user_id=57c24a93d2f64b7da117c27e42ad8321, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:03.711292 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1468156b-acbb-4563-9104-58e3303e3003 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:03.731232 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1019/2037] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:23:03 2022] PUT /identity/v3/projects/d70b9993333342e9a0ca21f903ed9100/users/57c24a93d2f64b7da117c27e42ad8321/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:23:03.736353 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62e3f5-76da-4c71-89e3-ec5268e8ed74 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:03.749927 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62e3f5-76da-4c71-89e3-ec5268e8ed74 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:03.818951 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deabbdf2-9a0b-4518-8468-06f67b1fb94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:03.819540 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabbdf2-9a0b-4518-8468-06f67b1fb94c admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:03.819823 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabbdf2-9a0b-4518-8468-06f67b1fb94c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:03.820131 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabbdf2-9a0b-4518-8468-06f67b1fb94c admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:03.820892 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deabbdf2-9a0b-4518-8468-06f67b1fb94c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:03.822504 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deabbdf2-9a0b-4518-8468-06f67b1fb94c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:03.837898 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1019/2038] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:23:03.839469 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1468156b-acbb-4563-9104-58e3303e3003 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:03.851960 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1468156b-acbb-4563-9104-58e3303e3003 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:03.860133 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b42e2-ca50-4f3a-97d7-590758180fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:03.861516 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b42e2-ca50-4f3a-97d7-590758180fed admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:03.861854 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b42e2-ca50-4f3a-97d7-590758180fed admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:03.862137 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b42e2-ca50-4f3a-97d7-590758180fed admin admin] PATH_INFO: `/v3/projects/d70b9993333342e9a0ca21f903ed9100/users/57c24a93d2f64b7da117c27e42ad8321/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:03.864290 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251b42e2-ca50-4f3a-97d7-590758180fed admin admin] RBAC: Authorizing `identity:create_grant(project_id=d70b9993333342e9a0ca21f903ed9100, user_id=57c24a93d2f64b7da117c27e42ad8321, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:03.866968 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251b42e2-ca50-4f3a-97d7-590758180fed admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:03.888205 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1020/2039] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:23:03 2022] PUT /identity/v3/projects/d70b9993333342e9a0ca21f903ed9100/users/57c24a93d2f64b7da117c27e42ad8321/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:23:03.892987 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be3a4b-e373-42b4-9681-c65464b80292 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:03.893130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be3a4b-e373-42b4-9681-c65464b80292 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:03.893469 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be3a4b-e373-42b4-9681-c65464b80292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:03.926513 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-07be3a4b-e373-42b4-9681-c65464b80292 None None] MFA Rules not processed for user `57c24a93d2f64b7da117c27e42ad8321`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:23:03.927764 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-07be3a4b-e373-42b4-9681-c65464b80292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:23:04.019472 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1020/2040] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:23:03 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:23:04.031565 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b42e2-ca50-4f3a-97d7-590758180fed admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:04.033274 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-251b42e2-ca50-4f3a-97d7-590758180fed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:23:04.105363 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b42e2-ca50-4f3a-97d7-590758180fed admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:04.109577 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d3d78-61f8-459e-aaf6-65adfc2612d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:04.110243 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d3d78-61f8-459e-aaf6-65adfc2612d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:04.110534 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d3d78-61f8-459e-aaf6-65adfc2612d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:04.110808 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d3d78-61f8-459e-aaf6-65adfc2612d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:04.122394 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0d3d78-61f8-459e-aaf6-65adfc2612d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:04.123875 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0d3d78-61f8-459e-aaf6-65adfc2612d8 service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:04.135483 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1021/2041] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:23:04 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 20:23:05.086071 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be3a4b-e373-42b4-9681-c65464b80292 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:05.116270 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:23:05.184744 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be3a4b-e373-42b4-9681-c65464b80292 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:05.191369 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44e5726-4a60-4bf1-9bbf-cc901b63c60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:05.192548 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e5726-4a60-4bf1-9bbf-cc901b63c60b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:05.193116 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e5726-4a60-4bf1-9bbf-cc901b63c60b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:05.193665 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e5726-4a60-4bf1-9bbf-cc901b63c60b admin admin] PATH_INFO: `/v3/users/d04d5d5a103b4f4db35760f1d0191cc5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:05.195988 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44e5726-4a60-4bf1-9bbf-cc901b63c60b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d04d5d5a103b4f4db35760f1d0191cc5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:05.200133 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44e5726-4a60-4bf1-9bbf-cc901b63c60b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:05.263496 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a44e5726-4a60-4bf1-9bbf-cc901b63c60b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd04d5d5a103b4f4db35760f1d0191cc5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:05.264449 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a44e5726-4a60-4bf1-9bbf-cc901b63c60b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd04d5d5a103b4f4db35760f1d0191cc5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:05.265133 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a44e5726-4a60-4bf1-9bbf-cc901b63c60b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd04d5d5a103b4f4db35760f1d0191cc5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:05.289535 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a44e5726-4a60-4bf1-9bbf-cc901b63c60b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd04d5d5a103b4f4db35760f1d0191cc5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:05.301156 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a44e5726-4a60-4bf1-9bbf-cc901b63c60b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd04d5d5a103b4f4db35760f1d0191cc5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:05.324148 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1021/2042] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:23:05 2022] DELETE /identity/v3/users/d04d5d5a103b4f4db35760f1d0191cc5 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:23:05.328924 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d7cc6-d8fc-4e7d-80fc-40334d8cf751 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:05.329387 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d7cc6-d8fc-4e7d-80fc-40334d8cf751 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:05.330163 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d7cc6-d8fc-4e7d-80fc-40334d8cf751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:05.357527 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-d94d7cc6-d8fc-4e7d-80fc-40334d8cf751 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:23:05.359255 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-d94d7cc6-d8fc-4e7d-80fc-40334d8cf751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:23:05.442616 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:23:05.468001 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1022/2043] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:23:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:23:05.478285 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44e5726-4a60-4bf1-9bbf-cc901b63c60b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:05.479777 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a44e5726-4a60-4bf1-9bbf-cc901b63c60b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:23:05.546556 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44e5726-4a60-4bf1-9bbf-cc901b63c60b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:05.550308 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae9cf73-f1b8-4ed1-99ec-5122a31c448d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:05.550993 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9cf73-f1b8-4ed1-99ec-5122a31c448d service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:05.551276 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9cf73-f1b8-4ed1-99ec-5122a31c448d service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:05.551557 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9cf73-f1b8-4ed1-99ec-5122a31c448d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:05.569028 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae9cf73-f1b8-4ed1-99ec-5122a31c448d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:05.569028 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae9cf73-f1b8-4ed1-99ec-5122a31c448d service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:05.575981 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1022/2044] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:23:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:23:06.010733 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d7cc6-d8fc-4e7d-80fc-40334d8cf751 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:06.013330 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-d94d7cc6-d8fc-4e7d-80fc-40334d8cf751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:23:06.034253 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d7cc6-d8fc-4e7d-80fc-40334d8cf751 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:06.046468 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb536c-5a02-4708-92a6-2b89c94fb259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:06.046943 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb536c-5a02-4708-92a6-2b89c94fb259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:06.047231 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb536c-5a02-4708-92a6-2b89c94fb259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:06.047510 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb536c-5a02-4708-92a6-2b89c94fb259 admin admin] PATH_INFO: `/v3/projects/d7f187eee3724ff5bac84c12141a7f33` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:06.048923 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bb536c-5a02-4708-92a6-2b89c94fb259 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7f187eee3724ff5bac84c12141a7f33)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:06.051033 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bb536c-5a02-4708-92a6-2b89c94fb259 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:06.125171 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-42bb536c-5a02-4708-92a6-2b89c94fb259 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7f187eee3724ff5bac84c12141a7f33', 'request_id': 'req-42bb536c-5a02-4708-92a6-2b89c94fb259'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:06.134742 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-42bb536c-5a02-4708-92a6-2b89c94fb259 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7f187eee3724ff5bac84c12141a7f33', 'request_id': 'req-42bb536c-5a02-4708-92a6-2b89c94fb259'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:06.146304 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-42bb536c-5a02-4708-92a6-2b89c94fb259 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7f187eee3724ff5bac84c12141a7f33', 'request_id': 'req-42bb536c-5a02-4708-92a6-2b89c94fb259'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:06.161254 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-42bb536c-5a02-4708-92a6-2b89c94fb259 admin admin] The token cache is being invalidate because project d7f187eee3724ff5bac84c12141a7f33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:23:06.161608 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-42bb536c-5a02-4708-92a6-2b89c94fb259 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:06.162297 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-42bb536c-5a02-4708-92a6-2b89c94fb259 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:06.164247 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1023/2045] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:23:06 2022] DELETE /identity/v3/projects/d7f187eee3724ff5bac84c12141a7f33 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:23:06.168695 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae9cf73-f1b8-4ed1-99ec-5122a31c448d service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:06.184901 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae9cf73-f1b8-4ed1-99ec-5122a31c448d service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:06.267197 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:23:06.303527 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d6d526-c05f-41e7-bdac-a97c75246264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:06.304981 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6d526-c05f-41e7-bdac-a97c75246264 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:06.305419 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6d526-c05f-41e7-bdac-a97c75246264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:06.305847 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6d526-c05f-41e7-bdac-a97c75246264 admin admin] PATH_INFO: `/v3/users/57c24a93d2f64b7da117c27e42ad8321` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:06.308293 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d6d526-c05f-41e7-bdac-a97c75246264 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57c24a93d2f64b7da117c27e42ad8321)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:06.310427 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d6d526-c05f-41e7-bdac-a97c75246264 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:06.391242 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-65d6d526-c05f-41e7-bdac-a97c75246264 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57c24a93d2f64b7da117c27e42ad8321'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:06.392253 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-65d6d526-c05f-41e7-bdac-a97c75246264 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57c24a93d2f64b7da117c27e42ad8321'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:06.392854 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-65d6d526-c05f-41e7-bdac-a97c75246264 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57c24a93d2f64b7da117c27e42ad8321'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:06.407102 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-65d6d526-c05f-41e7-bdac-a97c75246264 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57c24a93d2f64b7da117c27e42ad8321'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:06.420310 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-65d6d526-c05f-41e7-bdac-a97c75246264 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57c24a93d2f64b7da117c27e42ad8321'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:06.438040 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1023/2046] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:23:06 2022] DELETE /identity/v3/users/57c24a93d2f64b7da117c27e42ad8321 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:23:06.824438 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb536c-5a02-4708-92a6-2b89c94fb259 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:06.826364 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-42bb536c-5a02-4708-92a6-2b89c94fb259 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:23:06.848367 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb536c-5a02-4708-92a6-2b89c94fb259 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:06.952583 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa2a6b-8f5c-4c46-a8e2-71f8bf9d8d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:06.953636 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa2a6b-8f5c-4c46-a8e2-71f8bf9d8d7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:06.954142 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa2a6b-8f5c-4c46-a8e2-71f8bf9d8d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:06.954431 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa2a6b-8f5c-4c46-a8e2-71f8bf9d8d7b admin admin] PATH_INFO: `/v3/projects/d70b9993333342e9a0ca21f903ed9100` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:06.955653 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fa2a6b-8f5c-4c46-a8e2-71f8bf9d8d7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d70b9993333342e9a0ca21f903ed9100)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:06.957599 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fa2a6b-8f5c-4c46-a8e2-71f8bf9d8d7b admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:07.022598 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-47fa2a6b-8f5c-4c46-a8e2-71f8bf9d8d7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd70b9993333342e9a0ca21f903ed9100', 'request_id': 'req-47fa2a6b-8f5c-4c46-a8e2-71f8bf9d8d7b'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:07.028846 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-47fa2a6b-8f5c-4c46-a8e2-71f8bf9d8d7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd70b9993333342e9a0ca21f903ed9100', 'request_id': 'req-47fa2a6b-8f5c-4c46-a8e2-71f8bf9d8d7b'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:07.041459 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-47fa2a6b-8f5c-4c46-a8e2-71f8bf9d8d7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd70b9993333342e9a0ca21f903ed9100', 'request_id': 'req-47fa2a6b-8f5c-4c46-a8e2-71f8bf9d8d7b'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:07.060131 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-47fa2a6b-8f5c-4c46-a8e2-71f8bf9d8d7b admin admin] The token cache is being invalidate because project d70b9993333342e9a0ca21f903ed9100 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:23:07.060391 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-47fa2a6b-8f5c-4c46-a8e2-71f8bf9d8d7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:07.061082 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-47fa2a6b-8f5c-4c46-a8e2-71f8bf9d8d7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:07.063048 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1024/2047] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:23:06 2022] DELETE /identity/v3/projects/d70b9993333342e9a0ca21f903ed9100 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:23:07.067833 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b8cce-28b3-4f68-b6ab-a30190b7d9b4 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:07.068313 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b8cce-28b3-4f68-b6ab-a30190b7d9b4 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:07.068592 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b8cce-28b3-4f68-b6ab-a30190b7d9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:07.092812 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-173b8cce-28b3-4f68-b6ab-a30190b7d9b4 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:23:07.094130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-173b8cce-28b3-4f68-b6ab-a30190b7d9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:23:07.191201 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1024/2048] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:23:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:23:07.193324 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25a21e-2d1f-40c7-a8cc-bfaa0cfcc9a2 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:07.193324 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25a21e-2d1f-40c7-a8cc-bfaa0cfcc9a2 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:07.194114 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25a21e-2d1f-40c7-a8cc-bfaa0cfcc9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:07.217275 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-4e25a21e-2d1f-40c7-a8cc-bfaa0cfcc9a2 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:23:07.218911 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-4e25a21e-2d1f-40c7-a8cc-bfaa0cfcc9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:23:07.231842 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1025/2049] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:23:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:23:07.233089 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b8cce-28b3-4f68-b6ab-a30190b7d9b4 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:07.244644 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b8cce-28b3-4f68-b6ab-a30190b7d9b4 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:07.251070 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea835134-c27a-4325-810f-1e192c3892ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:07.251908 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea835134-c27a-4325-810f-1e192c3892ce admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:07.252382 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea835134-c27a-4325-810f-1e192c3892ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:07.252682 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea835134-c27a-4325-810f-1e192c3892ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:07.253436 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea835134-c27a-4325-810f-1e192c3892ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:23:07.253851 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea835134-c27a-4325-810f-1e192c3892ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:07.255508 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea835134-c27a-4325-810f-1e192c3892ce admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:07.273841 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1025/2050] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:23:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:23:07.275133 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25a21e-2d1f-40c7-a8cc-bfaa0cfcc9a2 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:07.281200 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:23:07.288742 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25a21e-2d1f-40c7-a8cc-bfaa0cfcc9a2 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:07.304759 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041451b9-d56c-468c-8e1b-143f6478daf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:07.305650 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041451b9-d56c-468c-8e1b-143f6478daf8 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:07.306036 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041451b9-d56c-468c-8e1b-143f6478daf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:07.306435 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041451b9-d56c-468c-8e1b-143f6478daf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:07.307235 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041451b9-d56c-468c-8e1b-143f6478daf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:07.309900 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041451b9-d56c-468c-8e1b-143f6478daf8 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:07.357075 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1026/2051] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:23:07 2022] POST /identity/v3/projects => generated 377 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:23:07.360894 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea835134-c27a-4325-810f-1e192c3892ce admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:07.373716 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea835134-c27a-4325-810f-1e192c3892ce admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:07.468196 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:23:07.486172 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc6008-12b4-4c44-baea-6367bc1a359c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:07.487513 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc6008-12b4-4c44-baea-6367bc1a359c admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:07.489696 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc6008-12b4-4c44-baea-6367bc1a359c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:07.490146 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc6008-12b4-4c44-baea-6367bc1a359c admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:07.491136 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc6008-12b4-4c44-baea-6367bc1a359c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:07.495242 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc6008-12b4-4c44-baea-6367bc1a359c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:07.545918 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1026/2052] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:23:07 2022] POST /identity/v3/users => generated 289 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 20:23:07.549709 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041451b9-d56c-468c-8e1b-143f6478daf8 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:07.568546 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041451b9-d56c-468c-8e1b-143f6478daf8 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:07.580272 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8298fb80-0cee-49f2-9d95-76a394f02053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:07.587406 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298fb80-0cee-49f2-9d95-76a394f02053 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:07.591338 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298fb80-0cee-49f2-9d95-76a394f02053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:07.591787 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298fb80-0cee-49f2-9d95-76a394f02053 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:07.592696 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8298fb80-0cee-49f2-9d95-76a394f02053 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:07.598744 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8298fb80-0cee-49f2-9d95-76a394f02053 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:07.644955 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1027/2053] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:23:07 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:23:07.645748 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc6008-12b4-4c44-baea-6367bc1a359c admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:07.660578 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc6008-12b4-4c44-baea-6367bc1a359c admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:07.666436 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32715ae5-6c62-4669-81f1-84e691db4b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:07.667241 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32715ae5-6c62-4669-81f1-84e691db4b85 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:07.668360 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32715ae5-6c62-4669-81f1-84e691db4b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:07.668948 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32715ae5-6c62-4669-81f1-84e691db4b85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:07.669807 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32715ae5-6c62-4669-81f1-84e691db4b85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:07.672038 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32715ae5-6c62-4669-81f1-84e691db4b85 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:07.688892 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1027/2054] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:23:07 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 20:23:07.692833 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8298fb80-0cee-49f2-9d95-76a394f02053 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:07.712372 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8298fb80-0cee-49f2-9d95-76a394f02053 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:07.723489 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159964a-fb26-4e91-8dae-a1575442d858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:07.724605 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159964a-fb26-4e91-8dae-a1575442d858 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:07.724996 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159964a-fb26-4e91-8dae-a1575442d858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:07.725381 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159964a-fb26-4e91-8dae-a1575442d858 admin admin] PATH_INFO: `/v3/projects/9cf9f7c619a54669a5e9c70f491115d0/users/7d5e51ecffdc44199dc32cd5be701853/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:07.758774 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1159964a-fb26-4e91-8dae-a1575442d858 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cf9f7c619a54669a5e9c70f491115d0, user_id=7d5e51ecffdc44199dc32cd5be701853, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:07.762274 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1159964a-fb26-4e91-8dae-a1575442d858 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:07.809921 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1028/2055] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:23:07 2022] PUT /identity/v3/projects/9cf9f7c619a54669a5e9c70f491115d0/users/7d5e51ecffdc44199dc32cd5be701853/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:23:07.814658 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95dc6b-0ead-4c95-a89b-46b7a51bd43f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:07.814658 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95dc6b-0ead-4c95-a89b-46b7a51bd43f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:07.815195 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95dc6b-0ead-4c95-a89b-46b7a51bd43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:07.871570 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-6e95dc6b-0ead-4c95-a89b-46b7a51bd43f None None] MFA Rules not processed for user `7d5e51ecffdc44199dc32cd5be701853`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:23:07.872984 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6e95dc6b-0ead-4c95-a89b-46b7a51bd43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:23:08.022136 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1028/2056] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:23:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:23:08.037138 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159964a-fb26-4e91-8dae-a1575442d858 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:08.038978 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-1159964a-fb26-4e91-8dae-a1575442d858 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:23:08.127766 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159964a-fb26-4e91-8dae-a1575442d858 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:08.138881 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae87572-9588-41eb-bb91-2a77f5b70163 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30400df887ee433086d1810331785891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:08.144875 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae87572-9588-41eb-bb91-2a77f5b70163 service glance] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:08.146242 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae87572-9588-41eb-bb91-2a77f5b70163 service glance] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:08.146690 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae87572-9588-41eb-bb91-2a77f5b70163 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:08.166056 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae87572-9588-41eb-bb91-2a77f5b70163 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:08.167661 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae87572-9588-41eb-bb91-2a77f5b70163 service glance] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:08.186373 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1029/2057] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:23:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:23:10.331907 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459e60d-16f5-49e8-a38f-d2a9594367ae None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:10.332910 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459e60d-16f5-49e8-a38f-d2a9594367ae None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:10.333201 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459e60d-16f5-49e8-a38f-d2a9594367ae None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:10.334899 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1029/2058] 10.222.0.15 () {54 vars in 921 bytes} [Tue Jun 21 20:23:10 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:23:10.367040 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c33cd-a1f6-42c6-bf14-c9c72cf8a0ec None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:10.368284 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c33cd-a1f6-42c6-bf14-c9c72cf8a0ec None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:10.368821 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c33cd-a1f6-42c6-bf14-c9c72cf8a0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:10.402475 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1459e60d-16f5-49e8-a38f-d2a9594367ae None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:10.404606 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1459e60d-16f5-49e8-a38f-d2a9594367ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:23:10.417098 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-cb2c33cd-a1f6-42c6-bf14-c9c72cf8a0ec None None] MFA Rules not processed for user `a59294bff27c4b3f8aaeeab48ed35a0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:23:10.419638 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-cb2c33cd-a1f6-42c6-bf14-c9c72cf8a0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:23:10.525413 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1030/2059] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Jun 21 20:23:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:23:10.528063 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1459e60d-16f5-49e8-a38f-d2a9594367ae None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:10.540795 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c33cd-a1f6-42c6-bf14-c9c72cf8a0ec None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:10.542468 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-cb2c33cd-a1f6-42c6-bf14-c9c72cf8a0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:23:10.556174 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f40916d-4f95-4374-b150-87783188bbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:10.557434 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40916d-4f95-4374-b150-87783188bbca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:10.557790 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40916d-4f95-4374-b150-87783188bbca admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:10.558687 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40916d-4f95-4374-b150-87783188bbca admin admin] PATH_INFO: `/v3/users/3fd51eea10924c9eb901382510d485a7` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:10.559985 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c33cd-a1f6-42c6-bf14-c9c72cf8a0ec None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:10.560186 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f40916d-4f95-4374-b150-87783188bbca admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fd51eea10924c9eb901382510d485a7)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:10.562181 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f40916d-4f95-4374-b150-87783188bbca admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:10.571097 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5412f44-b1bd-4d0b-92f5-b42f75250d23 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59294bff27c4b3f8aaeeab48ed35a0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:10.571097 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5412f44-b1bd-4d0b-92f5-b42f75250d23 service placement] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:10.571496 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5412f44-b1bd-4d0b-92f5-b42f75250d23 service placement] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:10.571843 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5412f44-b1bd-4d0b-92f5-b42f75250d23 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:10.582105 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5412f44-b1bd-4d0b-92f5-b42f75250d23 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:10.583777 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5412f44-b1bd-4d0b-92f5-b42f75250d23 service placement] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:10.594892 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1031/2060] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:23:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:23:10.627167 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0f40916d-4f95-4374-b150-87783188bbca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fd51eea10924c9eb901382510d485a7'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:10.630170 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0f40916d-4f95-4374-b150-87783188bbca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fd51eea10924c9eb901382510d485a7'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:10.630929 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0f40916d-4f95-4374-b150-87783188bbca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fd51eea10924c9eb901382510d485a7'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:10.646708 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:23:10.650003 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0f40916d-4f95-4374-b150-87783188bbca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fd51eea10924c9eb901382510d485a7'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:10.665950 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0f40916d-4f95-4374-b150-87783188bbca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fd51eea10924c9eb901382510d485a7'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:10.692269 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1030/2061] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:23:10 2022] DELETE /identity/v3/users/3fd51eea10924c9eb901382510d485a7 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:23:10.894020 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5412f44-b1bd-4d0b-92f5-b42f75250d23 service placement] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:10.916033 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5412f44-b1bd-4d0b-92f5-b42f75250d23 service placement] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:10.964674 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:23:11.015838 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d9838-e1da-4f60-ad0b-e4c72db0eb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:11.016999 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d9838-e1da-4f60-ad0b-e4c72db0eb6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:11.017390 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d9838-e1da-4f60-ad0b-e4c72db0eb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:11.017754 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d9838-e1da-4f60-ad0b-e4c72db0eb6a admin admin] PATH_INFO: `/v3/projects/8f4f74cb25c94ad78be8c8217c83f1b3` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:11.019400 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497d9838-e1da-4f60-ad0b-e4c72db0eb6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f4f74cb25c94ad78be8c8217c83f1b3)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:11.022272 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497d9838-e1da-4f60-ad0b-e4c72db0eb6a admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:11.089764 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-497d9838-e1da-4f60-ad0b-e4c72db0eb6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f4f74cb25c94ad78be8c8217c83f1b3', 'request_id': 'req-497d9838-e1da-4f60-ad0b-e4c72db0eb6a'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:11.096612 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-497d9838-e1da-4f60-ad0b-e4c72db0eb6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f4f74cb25c94ad78be8c8217c83f1b3', 'request_id': 'req-497d9838-e1da-4f60-ad0b-e4c72db0eb6a'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:11.110138 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-497d9838-e1da-4f60-ad0b-e4c72db0eb6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f4f74cb25c94ad78be8c8217c83f1b3', 'request_id': 'req-497d9838-e1da-4f60-ad0b-e4c72db0eb6a'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:11.129391 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-497d9838-e1da-4f60-ad0b-e4c72db0eb6a admin admin] The token cache is being invalidate because project 8f4f74cb25c94ad78be8c8217c83f1b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:23:11.129687 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-497d9838-e1da-4f60-ad0b-e4c72db0eb6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:11.130338 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-497d9838-e1da-4f60-ad0b-e4c72db0eb6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:11.131890 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1032/2062] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:23:10 2022] DELETE /identity/v3/projects/8f4f74cb25c94ad78be8c8217c83f1b3 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:23:11.136920 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9f29c-43f3-4429-b42a-cd27dede9e49 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:11.137441 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9f29c-43f3-4429-b42a-cd27dede9e49 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:11.138123 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9f29c-43f3-4429-b42a-cd27dede9e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:11.165983 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-59b9f29c-43f3-4429-b42a-cd27dede9e49 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:23:11.167443 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-59b9f29c-43f3-4429-b42a-cd27dede9e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:23:11.186597 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed891e-a6c4-4a09-bc20-9eda13084ebf None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:11.187074 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed891e-a6c4-4a09-bc20-9eda13084ebf None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:11.187432 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed891e-a6c4-4a09-bc20-9eda13084ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:11.205238 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-24ed891e-a6c4-4a09-bc20-9eda13084ebf None None] MFA Rules not processed for user `621ea4d1aae040298ba8420d767b33b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:23:11.206448 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-24ed891e-a6c4-4a09-bc20-9eda13084ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:23:11.231993 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1031/2063] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:23:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:23:11.238576 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df30bd-0bd0-4ae3-8f2c-c28885a71ebf None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:11.238863 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df30bd-0bd0-4ae3-8f2c-c28885a71ebf None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:11.239123 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df30bd-0bd0-4ae3-8f2c-c28885a71ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:11.257632 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-57df30bd-0bd0-4ae3-8f2c-c28885a71ebf None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:23:11.258923 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-57df30bd-0bd0-4ae3-8f2c-c28885a71ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:23:11.266829 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1033/2064] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:23:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:23:11.267210 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1032/2065] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:23:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 20:23:11.271557 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed891e-a6c4-4a09-bc20-9eda13084ebf None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:11.283810 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed891e-a6c4-4a09-bc20-9eda13084ebf None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:11.294536 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ef757-3495-4e7a-8465-6b393fee14d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:11.295229 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ef757-3495-4e7a-8465-6b393fee14d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:11.295519 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ef757-3495-4e7a-8465-6b393fee14d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:11.295797 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ef757-3495-4e7a-8465-6b393fee14d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:11.296618 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ef757-3495-4e7a-8465-6b393fee14d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:23:11.296933 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ef757-3495-4e7a-8465-6b393fee14d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:11.298595 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ef757-3495-4e7a-8465-6b393fee14d5 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:11.312644 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1034/2066] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:23:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:23:11.317013 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df30bd-0bd0-4ae3-8f2c-c28885a71ebf None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:11.326634 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df30bd-0bd0-4ae3-8f2c-c28885a71ebf None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:11.331360 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b9b227-e1e3-48e8-9c8a-c9c2753965ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:11.332078 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9b227-e1e3-48e8-9c8a-c9c2753965ca admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:11.332630 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9b227-e1e3-48e8-9c8a-c9c2753965ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:11.332630 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9b227-e1e3-48e8-9c8a-c9c2753965ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:11.333330 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b9b227-e1e3-48e8-9c8a-c9c2753965ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:11.335244 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b9b227-e1e3-48e8-9c8a-c9c2753965ca admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:11.361648 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1033/2067] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:23:11 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:23:11.366009 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ef757-3495-4e7a-8465-6b393fee14d5 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:11.376594 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ef757-3495-4e7a-8465-6b393fee14d5 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:11.432679 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:23:11.441306 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5fc0fe-c0b4-454b-86ac-f9680955319e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:11.441980 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5fc0fe-c0b4-454b-86ac-f9680955319e admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:11.442271 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5fc0fe-c0b4-454b-86ac-f9680955319e admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:11.442555 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5fc0fe-c0b4-454b-86ac-f9680955319e admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:11.443268 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5fc0fe-c0b4-454b-86ac-f9680955319e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:11.445262 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5fc0fe-c0b4-454b-86ac-f9680955319e admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:11.466202 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1035/2068] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:23:11 2022] POST /identity/v3/users => generated 283 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:23:11.470279 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b9b227-e1e3-48e8-9c8a-c9c2753965ca admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:11.481199 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b9b227-e1e3-48e8-9c8a-c9c2753965ca admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:11.485829 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263dc807-a853-4680-8c35-5efb738e25a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:11.486489 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263dc807-a853-4680-8c35-5efb738e25a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:11.486776 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263dc807-a853-4680-8c35-5efb738e25a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:11.487058 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263dc807-a853-4680-8c35-5efb738e25a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:11.487790 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263dc807-a853-4680-8c35-5efb738e25a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:11.489418 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263dc807-a853-4680-8c35-5efb738e25a0 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:11.499754 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1034/2069] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:23:11.503638 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5fc0fe-c0b4-454b-86ac-f9680955319e admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:11.514068 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5fc0fe-c0b4-454b-86ac-f9680955319e admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:11.518878 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b579b91-e879-4644-b7c7-2d05a5241586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:11.519533 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b579b91-e879-4644-b7c7-2d05a5241586 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:11.519825 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b579b91-e879-4644-b7c7-2d05a5241586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:11.520140 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b579b91-e879-4644-b7c7-2d05a5241586 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:11.520878 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b579b91-e879-4644-b7c7-2d05a5241586 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:11.522464 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b579b91-e879-4644-b7c7-2d05a5241586 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:11.534159 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1036/2070] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:23:11.538706 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263dc807-a853-4680-8c35-5efb738e25a0 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:11.549306 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263dc807-a853-4680-8c35-5efb738e25a0 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:11.555132 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e3244-7385-4857-83b4-4e937f354117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:11.556057 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e3244-7385-4857-83b4-4e937f354117 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:11.556344 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e3244-7385-4857-83b4-4e937f354117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:11.556638 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e3244-7385-4857-83b4-4e937f354117 admin admin] PATH_INFO: `/v3/projects/97c9537e87ae4eefa31968822650d5b2/users/5e8bd675da194f71bf79673fb8388cf7/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:11.579136 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705e3244-7385-4857-83b4-4e937f354117 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97c9537e87ae4eefa31968822650d5b2, user_id=5e8bd675da194f71bf79673fb8388cf7, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:11.581820 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705e3244-7385-4857-83b4-4e937f354117 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:11.597247 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1035/2071] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:23:11 2022] PUT /identity/v3/projects/97c9537e87ae4eefa31968822650d5b2/users/5e8bd675da194f71bf79673fb8388cf7/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:23:11.607372 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a78f1e-757d-4be7-9dcf-6d03116a8269 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:11.607667 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a78f1e-757d-4be7-9dcf-6d03116a8269 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:11.607973 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a78f1e-757d-4be7-9dcf-6d03116a8269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:11.635194 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-19a78f1e-757d-4be7-9dcf-6d03116a8269 None None] MFA Rules not processed for user `5e8bd675da194f71bf79673fb8388cf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:23:11.637210 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-19a78f1e-757d-4be7-9dcf-6d03116a8269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:23:11.710599 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1037/2072] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:23:11 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:23:11.722221 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e3244-7385-4857-83b4-4e937f354117 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:11.724123 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-705e3244-7385-4857-83b4-4e937f354117 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:23:11.782673 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e3244-7385-4857-83b4-4e937f354117 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:11.786535 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a348096a-c581-4cea-afd9-2dff4f2e3ff1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:11.787191 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348096a-c581-4cea-afd9-2dff4f2e3ff1 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:11.787482 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348096a-c581-4cea-afd9-2dff4f2e3ff1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:11.787766 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348096a-c581-4cea-afd9-2dff4f2e3ff1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:11.797119 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a348096a-c581-4cea-afd9-2dff4f2e3ff1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:11.798848 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a348096a-c581-4cea-afd9-2dff4f2e3ff1 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:11.810536 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1036/2073] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:23:11 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:23:20.232962 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a78f1e-757d-4be7-9dcf-6d03116a8269 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:20.295265 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a78f1e-757d-4be7-9dcf-6d03116a8269 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:20.300448 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f5cec-2161-4b35-a795-9dfde6171b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:20.301412 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f5cec-2161-4b35-a795-9dfde6171b3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:20.301694 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f5cec-2161-4b35-a795-9dfde6171b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:20.301996 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f5cec-2161-4b35-a795-9dfde6171b3e admin admin] PATH_INFO: `/v3/users/5e8bd675da194f71bf79673fb8388cf7` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:20.303606 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4f5cec-2161-4b35-a795-9dfde6171b3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e8bd675da194f71bf79673fb8388cf7)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:20.305912 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4f5cec-2161-4b35-a795-9dfde6171b3e admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:20.351877 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-8d4f5cec-2161-4b35-a795-9dfde6171b3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e8bd675da194f71bf79673fb8388cf7'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:20.352556 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-8d4f5cec-2161-4b35-a795-9dfde6171b3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e8bd675da194f71bf79673fb8388cf7'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:20.360288 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-8d4f5cec-2161-4b35-a795-9dfde6171b3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e8bd675da194f71bf79673fb8388cf7'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:20.370431 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:23:20.375385 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-8d4f5cec-2161-4b35-a795-9dfde6171b3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e8bd675da194f71bf79673fb8388cf7'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:20.376285 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-8d4f5cec-2161-4b35-a795-9dfde6171b3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e8bd675da194f71bf79673fb8388cf7'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:20.390189 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1038/2074] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:23:20 2022] DELETE /identity/v3/users/5e8bd675da194f71bf79673fb8388cf7 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:23:20.394821 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117099f1-7995-48bb-a67a-bea8cebf9e5e None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:20.395384 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117099f1-7995-48bb-a67a-bea8cebf9e5e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:20.395556 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117099f1-7995-48bb-a67a-bea8cebf9e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:20.414991 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-117099f1-7995-48bb-a67a-bea8cebf9e5e None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:23:20.416341 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-117099f1-7995-48bb-a67a-bea8cebf9e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:23:20.430467 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:23:20.483530 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1037/2075] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:23:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:23:20.493067 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f5cec-2161-4b35-a795-9dfde6171b3e admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:20.494454 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-8d4f5cec-2161-4b35-a795-9dfde6171b3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:23:20.554746 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f5cec-2161-4b35-a795-9dfde6171b3e admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:20.558453 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ecc0c-bd46-455e-8b03-7be1411679a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:20.559106 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ecc0c-bd46-455e-8b03-7be1411679a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:20.559394 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ecc0c-bd46-455e-8b03-7be1411679a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:20.559678 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ecc0c-bd46-455e-8b03-7be1411679a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:20.569169 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ecc0c-bd46-455e-8b03-7be1411679a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:20.570675 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ecc0c-bd46-455e-8b03-7be1411679a2 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:20.581720 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1039/2076] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:23:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 20:23:20.863382 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117099f1-7995-48bb-a67a-bea8cebf9e5e None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:20.864839 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-117099f1-7995-48bb-a67a-bea8cebf9e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:23:20.877798 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117099f1-7995-48bb-a67a-bea8cebf9e5e None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:20.884617 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1a98d-fee8-4460-bd22-047d36d3ca6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:20.885548 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1a98d-fee8-4460-bd22-047d36d3ca6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:20.885908 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1a98d-fee8-4460-bd22-047d36d3ca6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:20.886125 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1a98d-fee8-4460-bd22-047d36d3ca6e admin admin] PATH_INFO: `/v3/projects/97c9537e87ae4eefa31968822650d5b2` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:20.887381 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e1a98d-fee8-4460-bd22-047d36d3ca6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=97c9537e87ae4eefa31968822650d5b2)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:20.890289 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e1a98d-fee8-4460-bd22-047d36d3ca6e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:20.942476 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-13e1a98d-fee8-4460-bd22-047d36d3ca6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97c9537e87ae4eefa31968822650d5b2', 'request_id': 'req-13e1a98d-fee8-4460-bd22-047d36d3ca6e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:20.949409 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-13e1a98d-fee8-4460-bd22-047d36d3ca6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97c9537e87ae4eefa31968822650d5b2', 'request_id': 'req-13e1a98d-fee8-4460-bd22-047d36d3ca6e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:20.955538 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-13e1a98d-fee8-4460-bd22-047d36d3ca6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97c9537e87ae4eefa31968822650d5b2', 'request_id': 'req-13e1a98d-fee8-4460-bd22-047d36d3ca6e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:20.966836 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-13e1a98d-fee8-4460-bd22-047d36d3ca6e admin admin] The token cache is being invalidate because project 97c9537e87ae4eefa31968822650d5b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:23:20.967158 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-13e1a98d-fee8-4460-bd22-047d36d3ca6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:20.967795 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-13e1a98d-fee8-4460-bd22-047d36d3ca6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:20.969381 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1038/2077] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:23:20 2022] DELETE /identity/v3/projects/97c9537e87ae4eefa31968822650d5b2 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:23:20.974254 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23184ee6-68eb-4c0a-8f51-7c751c9142a3 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:20.974580 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23184ee6-68eb-4c0a-8f51-7c751c9142a3 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:20.974865 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23184ee6-68eb-4c0a-8f51-7c751c9142a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:20.992101 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-23184ee6-68eb-4c0a-8f51-7c751c9142a3 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:23:20.993243 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-23184ee6-68eb-4c0a-8f51-7c751c9142a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:23:21.053369 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1040/2078] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:23:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:23:21.061082 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c828bfd5-7299-461d-b012-b8301f76a877 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:21.061377 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c828bfd5-7299-461d-b012-b8301f76a877 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:21.061658 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c828bfd5-7299-461d-b012-b8301f76a877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:21.081162 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c828bfd5-7299-461d-b012-b8301f76a877 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:23:21.082366 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c828bfd5-7299-461d-b012-b8301f76a877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:23:21.090661 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1039/2079] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:23:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:23:21.095171 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23184ee6-68eb-4c0a-8f51-7c751c9142a3 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:21.109811 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23184ee6-68eb-4c0a-8f51-7c751c9142a3 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:21.115060 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892fe07f-a5b1-4019-a361-f8ecd4586ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:21.115900 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fe07f-a5b1-4019-a361-f8ecd4586ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:21.116238 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fe07f-a5b1-4019-a361-f8ecd4586ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:21.116524 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fe07f-a5b1-4019-a361-f8ecd4586ed9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:21.117302 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892fe07f-a5b1-4019-a361-f8ecd4586ed9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:23:21.117639 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892fe07f-a5b1-4019-a361-f8ecd4586ed9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:21.119292 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892fe07f-a5b1-4019-a361-f8ecd4586ed9 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:21.135887 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1041/2080] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:23:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:23:21.137011 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c828bfd5-7299-461d-b012-b8301f76a877 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:21.146871 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c828bfd5-7299-461d-b012-b8301f76a877 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:21.151567 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10db0b7-259b-4cec-9cc4-1c680612d080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:21.152250 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10db0b7-259b-4cec-9cc4-1c680612d080 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:21.152545 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10db0b7-259b-4cec-9cc4-1c680612d080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:21.152829 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10db0b7-259b-4cec-9cc4-1c680612d080 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:21.153538 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10db0b7-259b-4cec-9cc4-1c680612d080 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:21.155436 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10db0b7-259b-4cec-9cc4-1c680612d080 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:21.183751 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1040/2081] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:23:21 2022] POST /identity/v3/projects => generated 405 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 20:23:21.188466 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892fe07f-a5b1-4019-a361-f8ecd4586ed9 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:21.199606 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892fe07f-a5b1-4019-a361-f8ecd4586ed9 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:21.267819 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f6a2f-17c0-448a-a44e-3efc863602e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:21.268748 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f6a2f-17c0-448a-a44e-3efc863602e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:21.269037 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f6a2f-17c0-448a-a44e-3efc863602e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:21.269312 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f6a2f-17c0-448a-a44e-3efc863602e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:21.270009 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682f6a2f-17c0-448a-a44e-3efc863602e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:21.272229 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682f6a2f-17c0-448a-a44e-3efc863602e2 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:21.291823 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1042/2082] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:23:21 2022] POST /identity/v3/users => generated 303 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:23:21.295943 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10db0b7-259b-4cec-9cc4-1c680612d080 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:21.306860 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10db0b7-259b-4cec-9cc4-1c680612d080 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:21.311528 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f3baf-15f2-4ceb-b091-f41555bf10d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:21.312920 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f3baf-15f2-4ceb-b091-f41555bf10d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:21.313228 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f3baf-15f2-4ceb-b091-f41555bf10d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:21.313505 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f3baf-15f2-4ceb-b091-f41555bf10d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:21.314237 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f3baf-15f2-4ceb-b091-f41555bf10d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:21.315837 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f3baf-15f2-4ceb-b091-f41555bf10d9 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:21.326641 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1041/2083] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:23:21.331122 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f6a2f-17c0-448a-a44e-3efc863602e2 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:21.336762 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:23:21.343369 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f6a2f-17c0-448a-a44e-3efc863602e2 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:21.349298 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d1d36-09e1-4719-ae01-694c32bf87b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:21.349974 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d1d36-09e1-4719-ae01-694c32bf87b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:21.350263 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d1d36-09e1-4719-ae01-694c32bf87b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:21.350545 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d1d36-09e1-4719-ae01-694c32bf87b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:21.351287 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49d1d36-09e1-4719-ae01-694c32bf87b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:21.352947 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49d1d36-09e1-4719-ae01-694c32bf87b1 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:21.364216 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1043/2084] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:23:21.368334 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f3baf-15f2-4ceb-b091-f41555bf10d9 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:21.378697 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f3baf-15f2-4ceb-b091-f41555bf10d9 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:21.383450 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6546732-6e9a-4188-a335-adba600cf190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:21.384363 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6546732-6e9a-4188-a335-adba600cf190 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:21.384650 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6546732-6e9a-4188-a335-adba600cf190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:21.384928 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6546732-6e9a-4188-a335-adba600cf190 admin admin] PATH_INFO: `/v3/projects/a5a86f67ae1246a3af4f4e3c0d16b69c/users/b48b399c6e1242f09f0a19c26746645a/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:21.399106 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6546732-6e9a-4188-a335-adba600cf190 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5a86f67ae1246a3af4f4e3c0d16b69c, user_id=b48b399c6e1242f09f0a19c26746645a, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:21.401775 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6546732-6e9a-4188-a335-adba600cf190 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:21.414168 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1042/2085] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:23:21 2022] PUT /identity/v3/projects/a5a86f67ae1246a3af4f4e3c0d16b69c/users/b48b399c6e1242f09f0a19c26746645a/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:23:21.419467 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e42d82-4769-457c-83ce-c7168218abe1 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:21.419763 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e42d82-4769-457c-83ce-c7168218abe1 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:21.420070 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e42d82-4769-457c-83ce-c7168218abe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:21.438303 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-04e42d82-4769-457c-83ce-c7168218abe1 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:23:21.439501 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-04e42d82-4769-457c-83ce-c7168218abe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:23:21.501330 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1044/2086] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:23:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 20:23:21.511429 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6546732-6e9a-4188-a335-adba600cf190 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:21.513253 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e6546732-6e9a-4188-a335-adba600cf190 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:23:21.557048 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:23:21.579299 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6546732-6e9a-4188-a335-adba600cf190 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:21.586284 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fbe37f-cc31-4a71-86b5-7adfe3bcdccc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:21.587311 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbe37f-cc31-4a71-86b5-7adfe3bcdccc service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:21.587775 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbe37f-cc31-4a71-86b5-7adfe3bcdccc service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:21.588262 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbe37f-cc31-4a71-86b5-7adfe3bcdccc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:21.601006 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fbe37f-cc31-4a71-86b5-7adfe3bcdccc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:21.602896 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fbe37f-cc31-4a71-86b5-7adfe3bcdccc service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:21.614525 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1043/2087] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:23:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:23:22.226931 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e785f-91ce-4bb8-b424-52f278995e54 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:22.227221 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e785f-91ce-4bb8-b424-52f278995e54 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:22.227529 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e785f-91ce-4bb8-b424-52f278995e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:22.266426 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-134e785f-91ce-4bb8-b424-52f278995e54 None None] MFA Rules not processed for user `b48b399c6e1242f09f0a19c26746645a`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:23:22.267800 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-134e785f-91ce-4bb8-b424-52f278995e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:23:22.351810 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1045/2088] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:23:22 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:23:22.358062 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fbe37f-cc31-4a71-86b5-7adfe3bcdccc service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:22.366830 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fbe37f-cc31-4a71-86b5-7adfe3bcdccc service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:22.371503 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d38ec05-ef84-4025-9fde-e87ffdf37320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:22.372188 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38ec05-ef84-4025-9fde-e87ffdf37320 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:22.372477 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38ec05-ef84-4025-9fde-e87ffdf37320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:22.372754 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38ec05-ef84-4025-9fde-e87ffdf37320 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:22.373446 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d38ec05-ef84-4025-9fde-e87ffdf37320 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:22.375983 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d38ec05-ef84-4025-9fde-e87ffdf37320 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:22.412514 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1044/2089] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:23:22 2022] POST /identity/v3/projects => generated 405 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:23:22.414325 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134e785f-91ce-4bb8-b424-52f278995e54 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:22.425506 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134e785f-91ce-4bb8-b424-52f278995e54 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:22.485727 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20351367-d684-44f9-a1dd-d47786101a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:22.486407 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20351367-d684-44f9-a1dd-d47786101a07 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:22.486698 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20351367-d684-44f9-a1dd-d47786101a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:22.486977 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20351367-d684-44f9-a1dd-d47786101a07 admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:22.487677 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20351367-d684-44f9-a1dd-d47786101a07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:22.489633 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20351367-d684-44f9-a1dd-d47786101a07 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:22.512844 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1046/2090] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:23:22 2022] POST /identity/v3/users => generated 309 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:23:22.516172 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d38ec05-ef84-4025-9fde-e87ffdf37320 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:22.526278 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d38ec05-ef84-4025-9fde-e87ffdf37320 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:22.531055 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933219c-5234-4ba5-8fa9-56be212fa3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:22.531754 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933219c-5234-4ba5-8fa9-56be212fa3b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:22.532094 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933219c-5234-4ba5-8fa9-56be212fa3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:22.532694 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933219c-5234-4ba5-8fa9-56be212fa3b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:22.533229 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5933219c-5234-4ba5-8fa9-56be212fa3b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:22.535028 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5933219c-5234-4ba5-8fa9-56be212fa3b3 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:22.546487 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1045/2091] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:23:22.550975 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20351367-d684-44f9-a1dd-d47786101a07 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:22.561693 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20351367-d684-44f9-a1dd-d47786101a07 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:22.566974 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33744d46-d44f-4481-b3e3-122eb77cf5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:22.567843 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33744d46-d44f-4481-b3e3-122eb77cf5a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:22.568167 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33744d46-d44f-4481-b3e3-122eb77cf5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:22.568447 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33744d46-d44f-4481-b3e3-122eb77cf5a8 admin admin] PATH_INFO: `/v3/projects/e8380d6a84f544d8b5cd7c120b978b51/users/3072caccf6eb4926879bee2d6b24a3b0/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:22.576886 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:23:22.586146 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33744d46-d44f-4481-b3e3-122eb77cf5a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8380d6a84f544d8b5cd7c120b978b51, user_id=3072caccf6eb4926879bee2d6b24a3b0, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:22.589967 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33744d46-d44f-4481-b3e3-122eb77cf5a8 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:22.604726 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1047/2092] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:23:22 2022] PUT /identity/v3/projects/e8380d6a84f544d8b5cd7c120b978b51/users/3072caccf6eb4926879bee2d6b24a3b0/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:23:22.608781 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933219c-5234-4ba5-8fa9-56be212fa3b3 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:22.618877 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933219c-5234-4ba5-8fa9-56be212fa3b3 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:22.676628 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e7bb9-ed23-425c-a8cb-c21b04fb8b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:22.677409 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e7bb9-ed23-425c-a8cb-c21b04fb8b06 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:22.677695 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e7bb9-ed23-425c-a8cb-c21b04fb8b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:22.677975 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e7bb9-ed23-425c-a8cb-c21b04fb8b06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:22.678787 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543e7bb9-ed23-425c-a8cb-c21b04fb8b06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:22.680469 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543e7bb9-ed23-425c-a8cb-c21b04fb8b06 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:22.691452 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1046/2093] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:23:22.695710 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33744d46-d44f-4481-b3e3-122eb77cf5a8 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:22.706709 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33744d46-d44f-4481-b3e3-122eb77cf5a8 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:22.711619 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86f1fc-ff17-4e9b-a1ee-eaf7df8e679a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:22.712565 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86f1fc-ff17-4e9b-a1ee-eaf7df8e679a admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:22.712852 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86f1fc-ff17-4e9b-a1ee-eaf7df8e679a admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:22.713137 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86f1fc-ff17-4e9b-a1ee-eaf7df8e679a admin admin] PATH_INFO: `/v3/projects/e8380d6a84f544d8b5cd7c120b978b51/users/3072caccf6eb4926879bee2d6b24a3b0/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:22.715095 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c86f1fc-ff17-4e9b-a1ee-eaf7df8e679a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8380d6a84f544d8b5cd7c120b978b51, user_id=3072caccf6eb4926879bee2d6b24a3b0, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:22.718111 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c86f1fc-ff17-4e9b-a1ee-eaf7df8e679a admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:22.728900 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1048/2094] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:23:22 2022] PUT /identity/v3/projects/e8380d6a84f544d8b5cd7c120b978b51/users/3072caccf6eb4926879bee2d6b24a3b0/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:23:23.341467 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b160c6b-d534-48a2-ac55-075489b33cbf None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:23.341759 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b160c6b-d534-48a2-ac55-075489b33cbf None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:23.342037 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b160c6b-d534-48a2-ac55-075489b33cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:23.367500 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-3b160c6b-d534-48a2-ac55-075489b33cbf None None] MFA Rules not processed for user `3072caccf6eb4926879bee2d6b24a3b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:23:23.368671 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3b160c6b-d534-48a2-ac55-075489b33cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:23:23.450670 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1047/2095] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:23:23 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:23:24.061508 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711ea3e-d3e2-432e-a6b4-7d59faee5e81 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:24.062010 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711ea3e-d3e2-432e-a6b4-7d59faee5e81 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:24.062205 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711ea3e-d3e2-432e-a6b4-7d59faee5e81 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:24.063812 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1049/2096] 10.222.0.15 () {54 vars in 921 bytes} [Tue Jun 21 20:23:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 20:23:24.073792 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105cd8de-66c6-4a48-94c2-d5db8b5c7291 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:24.074152 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105cd8de-66c6-4a48-94c2-d5db8b5c7291 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:24.074511 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105cd8de-66c6-4a48-94c2-d5db8b5c7291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:24.098335 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-105cd8de-66c6-4a48-94c2-d5db8b5c7291 None None] MFA Rules not processed for user `a59294bff27c4b3f8aaeeab48ed35a0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:23:24.099569 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-105cd8de-66c6-4a48-94c2-d5db8b5c7291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:23:24.139793 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:23:24.184130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1048/2097] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Jun 21 20:23:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:23:24.194690 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2711ea3e-d3e2-432e-a6b4-7d59faee5e81 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:24.196504 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-2711ea3e-d3e2-432e-a6b4-7d59faee5e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:23:24.215021 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2711ea3e-d3e2-432e-a6b4-7d59faee5e81 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:24.221019 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def8188-9b94-4362-bf74-85a2923cb19b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59294bff27c4b3f8aaeeab48ed35a0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:24.221851 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def8188-9b94-4362-bf74-85a2923cb19b service placement] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:24.222226 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def8188-9b94-4362-bf74-85a2923cb19b service placement] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:24.222575 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def8188-9b94-4362-bf74-85a2923cb19b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:24.234947 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def8188-9b94-4362-bf74-85a2923cb19b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:24.236643 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def8188-9b94-4362-bf74-85a2923cb19b service placement] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:24.247887 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1050/2098] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:23:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:23:24.661480 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105cd8de-66c6-4a48-94c2-d5db8b5c7291 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:24.731640 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105cd8de-66c6-4a48-94c2-d5db8b5c7291 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:24.738665 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28c7473-b341-4a9c-a39c-936c15154128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:24.739570 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c7473-b341-4a9c-a39c-936c15154128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:24.739856 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c7473-b341-4a9c-a39c-936c15154128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:24.740160 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c7473-b341-4a9c-a39c-936c15154128 admin admin] PATH_INFO: `/v3/users/b48b399c6e1242f09f0a19c26746645a` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:24.741528 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28c7473-b341-4a9c-a39c-936c15154128 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b48b399c6e1242f09f0a19c26746645a)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:24.743474 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28c7473-b341-4a9c-a39c-936c15154128 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:24.806985 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d28c7473-b341-4a9c-a39c-936c15154128 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b48b399c6e1242f09f0a19c26746645a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:24.807812 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d28c7473-b341-4a9c-a39c-936c15154128 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b48b399c6e1242f09f0a19c26746645a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:24.808323 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d28c7473-b341-4a9c-a39c-936c15154128 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b48b399c6e1242f09f0a19c26746645a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:24.825302 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d28c7473-b341-4a9c-a39c-936c15154128 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b48b399c6e1242f09f0a19c26746645a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:24.833309 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d28c7473-b341-4a9c-a39c-936c15154128 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b48b399c6e1242f09f0a19c26746645a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:24.847396 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1049/2099] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:23:24 2022] DELETE /identity/v3/users/b48b399c6e1242f09f0a19c26746645a => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:23:25.026722 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def8188-9b94-4362-bf74-85a2923cb19b service placement] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:25.038272 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def8188-9b94-4362-bf74-85a2923cb19b service placement] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:25.096772 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c33db8-35c8-453c-ba21-51dfb286caf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:25.097664 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c33db8-35c8-453c-ba21-51dfb286caf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:25.097949 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c33db8-35c8-453c-ba21-51dfb286caf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:25.098227 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c33db8-35c8-453c-ba21-51dfb286caf5 admin admin] PATH_INFO: `/v3/projects/a5a86f67ae1246a3af4f4e3c0d16b69c` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:25.099433 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c33db8-35c8-453c-ba21-51dfb286caf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5a86f67ae1246a3af4f4e3c0d16b69c)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:25.101395 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c33db8-35c8-453c-ba21-51dfb286caf5 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:25.149193 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-54c33db8-35c8-453c-ba21-51dfb286caf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5a86f67ae1246a3af4f4e3c0d16b69c', 'request_id': 'req-54c33db8-35c8-453c-ba21-51dfb286caf5'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:25.154645 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-54c33db8-35c8-453c-ba21-51dfb286caf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5a86f67ae1246a3af4f4e3c0d16b69c', 'request_id': 'req-54c33db8-35c8-453c-ba21-51dfb286caf5'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:25.162111 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-54c33db8-35c8-453c-ba21-51dfb286caf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5a86f67ae1246a3af4f4e3c0d16b69c', 'request_id': 'req-54c33db8-35c8-453c-ba21-51dfb286caf5'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:25.174394 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-54c33db8-35c8-453c-ba21-51dfb286caf5 admin admin] The token cache is being invalidate because project a5a86f67ae1246a3af4f4e3c0d16b69c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:23:25.174714 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-54c33db8-35c8-453c-ba21-51dfb286caf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:25.175386 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-54c33db8-35c8-453c-ba21-51dfb286caf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:25.176982 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1051/2100] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:23:25 2022] DELETE /identity/v3/projects/a5a86f67ae1246a3af4f4e3c0d16b69c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:23:25.180932 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28c7473-b341-4a9c-a39c-936c15154128 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:25.182320 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d28c7473-b341-4a9c-a39c-936c15154128 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:23:25.195681 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28c7473-b341-4a9c-a39c-936c15154128 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:25.237758 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:23:25.254759 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f859b-faf7-4b00-953d-9345e42f2978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:25.255667 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f859b-faf7-4b00-953d-9345e42f2978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:25.256077 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f859b-faf7-4b00-953d-9345e42f2978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:25.256404 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f859b-faf7-4b00-953d-9345e42f2978 admin admin] PATH_INFO: `/v3/users/3072caccf6eb4926879bee2d6b24a3b0` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:25.257669 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8f859b-faf7-4b00-953d-9345e42f2978 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3072caccf6eb4926879bee2d6b24a3b0)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:25.259661 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8f859b-faf7-4b00-953d-9345e42f2978 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:25.306066 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ad8f859b-faf7-4b00-953d-9345e42f2978 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3072caccf6eb4926879bee2d6b24a3b0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:25.306803 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ad8f859b-faf7-4b00-953d-9345e42f2978 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3072caccf6eb4926879bee2d6b24a3b0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:25.307562 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ad8f859b-faf7-4b00-953d-9345e42f2978 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3072caccf6eb4926879bee2d6b24a3b0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:25.319176 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ad8f859b-faf7-4b00-953d-9345e42f2978 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3072caccf6eb4926879bee2d6b24a3b0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:25.326900 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ad8f859b-faf7-4b00-953d-9345e42f2978 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3072caccf6eb4926879bee2d6b24a3b0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:25.341040 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1050/2101] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:23:25 2022] DELETE /identity/v3/users/3072caccf6eb4926879bee2d6b24a3b0 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:23:25.519587 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c33db8-35c8-453c-ba21-51dfb286caf5 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:25.521333 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-54c33db8-35c8-453c-ba21-51dfb286caf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:23:25.534893 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c33db8-35c8-453c-ba21-51dfb286caf5 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:25.584237 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:23:25.596363 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e976a-1458-460d-b2e4-4d41e0526ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:25.597264 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e976a-1458-460d-b2e4-4d41e0526ab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:25.597547 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e976a-1458-460d-b2e4-4d41e0526ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:25.597825 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e976a-1458-460d-b2e4-4d41e0526ab7 admin admin] PATH_INFO: `/v3/projects/e8380d6a84f544d8b5cd7c120b978b51` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:25.599009 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859e976a-1458-460d-b2e4-4d41e0526ab7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8380d6a84f544d8b5cd7c120b978b51)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:25.600982 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859e976a-1458-460d-b2e4-4d41e0526ab7 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:25.649555 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-859e976a-1458-460d-b2e4-4d41e0526ab7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8380d6a84f544d8b5cd7c120b978b51', 'request_id': 'req-859e976a-1458-460d-b2e4-4d41e0526ab7'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:25.655051 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-859e976a-1458-460d-b2e4-4d41e0526ab7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8380d6a84f544d8b5cd7c120b978b51', 'request_id': 'req-859e976a-1458-460d-b2e4-4d41e0526ab7'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:25.662952 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-859e976a-1458-460d-b2e4-4d41e0526ab7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8380d6a84f544d8b5cd7c120b978b51', 'request_id': 'req-859e976a-1458-460d-b2e4-4d41e0526ab7'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:25.675435 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-859e976a-1458-460d-b2e4-4d41e0526ab7 admin admin] The token cache is being invalidate because project e8380d6a84f544d8b5cd7c120b978b51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:23:25.675735 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-859e976a-1458-460d-b2e4-4d41e0526ab7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:25.676414 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-859e976a-1458-460d-b2e4-4d41e0526ab7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:25.681235 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1052/2102] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:23:25 2022] DELETE /identity/v3/projects/e8380d6a84f544d8b5cd7c120b978b51 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:23:25.683124 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6d194-e869-47cf-8b5a-afdfd77e44da None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:25.683591 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6d194-e869-47cf-8b5a-afdfd77e44da None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:25.683685 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6d194-e869-47cf-8b5a-afdfd77e44da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:25.711820 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-a9b6d194-e869-47cf-8b5a-afdfd77e44da None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:23:25.713533 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a9b6d194-e869-47cf-8b5a-afdfd77e44da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:23:25.783202 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1051/2103] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:23:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:23:25.786000 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ed971-d280-49e9-a109-f743e70a393f None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:25.786346 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ed971-d280-49e9-a109-f743e70a393f None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:25.786633 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ed971-d280-49e9-a109-f743e70a393f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:25.809763 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-c45ed971-d280-49e9-a109-f743e70a393f None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:23:25.811018 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-c45ed971-d280-49e9-a109-f743e70a393f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:23:25.825736 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1053/2104] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:23:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:23:25.830199 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6d194-e869-47cf-8b5a-afdfd77e44da None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:25.841791 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6d194-e869-47cf-8b5a-afdfd77e44da None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:25.847450 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0bc378-11b7-434c-9cc2-c3b79aa9ef93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:25.848168 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0bc378-11b7-434c-9cc2-c3b79aa9ef93 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:25.848461 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0bc378-11b7-434c-9cc2-c3b79aa9ef93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:25.848734 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0bc378-11b7-434c-9cc2-c3b79aa9ef93 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:25.849467 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0bc378-11b7-434c-9cc2-c3b79aa9ef93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:23:25.849939 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0bc378-11b7-434c-9cc2-c3b79aa9ef93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:25.851558 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0bc378-11b7-434c-9cc2-c3b79aa9ef93 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:25.868101 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1052/2105] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:23:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:23:25.870881 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ed971-d280-49e9-a109-f743e70a393f None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:25.883106 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ed971-d280-49e9-a109-f743e70a393f None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:25.888319 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543782d6-6c00-4112-b95b-3f3ac30a8a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:25.889112 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543782d6-6c00-4112-b95b-3f3ac30a8a39 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:25.889576 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543782d6-6c00-4112-b95b-3f3ac30a8a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:25.889923 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543782d6-6c00-4112-b95b-3f3ac30a8a39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:25.891476 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543782d6-6c00-4112-b95b-3f3ac30a8a39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:25.893494 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543782d6-6c00-4112-b95b-3f3ac30a8a39 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:25.922926 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1054/2106] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:23:25 2022] POST /identity/v3/projects => generated 367 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:23:25.927012 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0bc378-11b7-434c-9cc2-c3b79aa9ef93 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:25.938097 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0bc378-11b7-434c-9cc2-c3b79aa9ef93 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:25.990332 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:23:26.003663 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65c5f2-7623-4bea-a242-694d35eebacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:26.004379 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65c5f2-7623-4bea-a242-694d35eebacd admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:26.004694 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65c5f2-7623-4bea-a242-694d35eebacd admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:26.004973 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65c5f2-7623-4bea-a242-694d35eebacd admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:26.005996 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec65c5f2-7623-4bea-a242-694d35eebacd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:26.008117 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec65c5f2-7623-4bea-a242-694d35eebacd admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:26.032855 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1053/2107] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:23:25 2022] POST /identity/v3/users => generated 284 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:23:26.034133 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543782d6-6c00-4112-b95b-3f3ac30a8a39 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:26.045067 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543782d6-6c00-4112-b95b-3f3ac30a8a39 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:26.051196 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca6189-a363-4333-846e-61b74fe5d011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:26.051908 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca6189-a363-4333-846e-61b74fe5d011 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:26.052222 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca6189-a363-4333-846e-61b74fe5d011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:26.052503 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca6189-a363-4333-846e-61b74fe5d011 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:26.053249 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca6189-a363-4333-846e-61b74fe5d011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:26.054908 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca6189-a363-4333-846e-61b74fe5d011 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:26.068033 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1055/2108] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 20:23:26.072036 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65c5f2-7623-4bea-a242-694d35eebacd admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:26.082408 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65c5f2-7623-4bea-a242-694d35eebacd admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:26.087455 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff84eb3-bc16-4b5d-9e19-849f3ca31f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:26.088249 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff84eb3-bc16-4b5d-9e19-849f3ca31f19 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:26.088539 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff84eb3-bc16-4b5d-9e19-849f3ca31f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:26.088825 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff84eb3-bc16-4b5d-9e19-849f3ca31f19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:26.089573 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff84eb3-bc16-4b5d-9e19-849f3ca31f19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:26.091184 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff84eb3-bc16-4b5d-9e19-849f3ca31f19 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:26.103452 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1054/2109] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 20:23:26.107792 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca6189-a363-4333-846e-61b74fe5d011 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:26.120139 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca6189-a363-4333-846e-61b74fe5d011 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:26.125135 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167ae5b-b666-462f-8ed2-353c01607fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:26.126177 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167ae5b-b666-462f-8ed2-353c01607fa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:26.126459 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167ae5b-b666-462f-8ed2-353c01607fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:26.126735 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167ae5b-b666-462f-8ed2-353c01607fa1 admin admin] PATH_INFO: `/v3/projects/3d0b0c3acd2240219a5c1cb22fdd4d49/users/0ceb3ce9db524499a181ef86be7d30fc/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:26.142108 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f167ae5b-b666-462f-8ed2-353c01607fa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d0b0c3acd2240219a5c1cb22fdd4d49, user_id=0ceb3ce9db524499a181ef86be7d30fc, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:26.144806 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f167ae5b-b666-462f-8ed2-353c01607fa1 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:26.158626 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1056/2110] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:23:26 2022] PUT /identity/v3/projects/3d0b0c3acd2240219a5c1cb22fdd4d49/users/0ceb3ce9db524499a181ef86be7d30fc/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:23:26.169219 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61796904-8ea6-48e1-bf0e-a774fd93f506 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:26.169590 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61796904-8ea6-48e1-bf0e-a774fd93f506 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:26.169933 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61796904-8ea6-48e1-bf0e-a774fd93f506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:26.198012 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-61796904-8ea6-48e1-bf0e-a774fd93f506 None None] MFA Rules not processed for user `0ceb3ce9db524499a181ef86be7d30fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:23:26.199286 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-61796904-8ea6-48e1-bf0e-a774fd93f506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:23:26.290241 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1055/2111] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:23:26 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:23:26.294593 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167ae5b-b666-462f-8ed2-353c01607fa1 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:26.370224 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167ae5b-b666-462f-8ed2-353c01607fa1 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:26.374902 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba51f0-3d58-47d1-b8ad-e167694eb46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:26.375587 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba51f0-3d58-47d1-b8ad-e167694eb46c admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:26.375879 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba51f0-3d58-47d1-b8ad-e167694eb46c admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:26.376195 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba51f0-3d58-47d1-b8ad-e167694eb46c admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:26.376899 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ba51f0-3d58-47d1-b8ad-e167694eb46c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:26.378823 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ba51f0-3d58-47d1-b8ad-e167694eb46c admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:26.404242 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1057/2112] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:23:26 2022] POST /identity/v3/projects => generated 369 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 20:23:26.408753 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61796904-8ea6-48e1-bf0e-a774fd93f506 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:26.419944 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61796904-8ea6-48e1-bf0e-a774fd93f506 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:26.481089 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e30a5-6355-4ac6-84fa-85d732223fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:26.481772 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e30a5-6355-4ac6-84fa-85d732223fa6 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:26.482061 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e30a5-6355-4ac6-84fa-85d732223fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:26.482343 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e30a5-6355-4ac6-84fa-85d732223fa6 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:26.483049 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359e30a5-6355-4ac6-84fa-85d732223fa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:26.485043 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359e30a5-6355-4ac6-84fa-85d732223fa6 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:26.511250 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1056/2113] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:23:26 2022] POST /identity/v3/users => generated 291 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:23:26.513044 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba51f0-3d58-47d1-b8ad-e167694eb46c admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:26.519326 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:23:26.526143 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba51f0-3d58-47d1-b8ad-e167694eb46c admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:26.532633 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b861e0-e7e5-4ea9-b2db-3172b3aa49e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:26.533264 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b861e0-e7e5-4ea9-b2db-3172b3aa49e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:26.533554 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b861e0-e7e5-4ea9-b2db-3172b3aa49e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:26.533962 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b861e0-e7e5-4ea9-b2db-3172b3aa49e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:26.534680 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b861e0-e7e5-4ea9-b2db-3172b3aa49e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:26.536818 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b861e0-e7e5-4ea9-b2db-3172b3aa49e7 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:26.553221 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1058/2114] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:23:26.554296 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e30a5-6355-4ac6-84fa-85d732223fa6 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:26.565147 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e30a5-6355-4ac6-84fa-85d732223fa6 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:26.573653 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f318b6-f706-41ad-aef5-67a9945be398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:26.574789 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f318b6-f706-41ad-aef5-67a9945be398 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:26.575126 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f318b6-f706-41ad-aef5-67a9945be398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:26.575412 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f318b6-f706-41ad-aef5-67a9945be398 admin admin] PATH_INFO: `/v3/projects/4ba1f1fdfffc406abe5126ef2ab9e6f1/users/a55e763baea342c9ab787cd17b056a83/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:26.592805 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f318b6-f706-41ad-aef5-67a9945be398 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ba1f1fdfffc406abe5126ef2ab9e6f1, user_id=a55e763baea342c9ab787cd17b056a83, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:26.596340 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f318b6-f706-41ad-aef5-67a9945be398 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:26.610231 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1057/2115] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:23:26 2022] PUT /identity/v3/projects/4ba1f1fdfffc406abe5126ef2ab9e6f1/users/a55e763baea342c9ab787cd17b056a83/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:23:26.615799 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b861e0-e7e5-4ea9-b2db-3172b3aa49e7 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:26.625956 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b861e0-e7e5-4ea9-b2db-3172b3aa49e7 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:26.695146 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c791f2b7-ac10-4c98-9b3a-1c8f6504c55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:26.695897 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791f2b7-ac10-4c98-9b3a-1c8f6504c55e admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:26.696280 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791f2b7-ac10-4c98-9b3a-1c8f6504c55e admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:26.696632 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791f2b7-ac10-4c98-9b3a-1c8f6504c55e admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:26.697468 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c791f2b7-ac10-4c98-9b3a-1c8f6504c55e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:26.699147 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c791f2b7-ac10-4c98-9b3a-1c8f6504c55e admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:26.711937 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1059/2116] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 20:23:26.717095 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f318b6-f706-41ad-aef5-67a9945be398 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:26.737395 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f318b6-f706-41ad-aef5-67a9945be398 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:26.742186 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab54a91c-14af-4674-98a6-ab2454a63cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:26.743192 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54a91c-14af-4674-98a6-ab2454a63cb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:26.743482 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54a91c-14af-4674-98a6-ab2454a63cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:26.743759 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54a91c-14af-4674-98a6-ab2454a63cb9 admin admin] PATH_INFO: `/v3/projects/4ba1f1fdfffc406abe5126ef2ab9e6f1/users/a55e763baea342c9ab787cd17b056a83/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:26.745794 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab54a91c-14af-4674-98a6-ab2454a63cb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ba1f1fdfffc406abe5126ef2ab9e6f1, user_id=a55e763baea342c9ab787cd17b056a83, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:26.748450 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab54a91c-14af-4674-98a6-ab2454a63cb9 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:26.760403 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1058/2117] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:23:26 2022] PUT /identity/v3/projects/4ba1f1fdfffc406abe5126ef2ab9e6f1/users/a55e763baea342c9ab787cd17b056a83/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:23:26.772395 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a3d0a6-da27-4ad7-99c8-9467c6e03107 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:26.772694 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a3d0a6-da27-4ad7-99c8-9467c6e03107 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:26.772977 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a3d0a6-da27-4ad7-99c8-9467c6e03107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:26.804721 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-55a3d0a6-da27-4ad7-99c8-9467c6e03107 None None] MFA Rules not processed for user `a55e763baea342c9ab787cd17b056a83`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:23:26.806066 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-55a3d0a6-da27-4ad7-99c8-9467c6e03107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:23:26.902151 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1060/2118] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:23:26 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:23:26.913749 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab54a91c-14af-4674-98a6-ab2454a63cb9 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:26.915698 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ab54a91c-14af-4674-98a6-ab2454a63cb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:23:26.930511 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:23:26.987685 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab54a91c-14af-4674-98a6-ab2454a63cb9 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:26.991426 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea4380-948e-40ba-8d4b-552ad7bd4aec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:26.992187 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea4380-948e-40ba-8d4b-552ad7bd4aec service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:26.992574 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea4380-948e-40ba-8d4b-552ad7bd4aec service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:26.992836 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea4380-948e-40ba-8d4b-552ad7bd4aec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:27.003704 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea4380-948e-40ba-8d4b-552ad7bd4aec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:27.005211 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea4380-948e-40ba-8d4b-552ad7bd4aec service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:27.014855 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1059/2119] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:23:26 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:23:28.506667 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a3d0a6-da27-4ad7-99c8-9467c6e03107 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:28.603060 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a3d0a6-da27-4ad7-99c8-9467c6e03107 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:28.608258 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466187a-6ad4-4d6f-98ab-2208abfccc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:28.609916 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466187a-6ad4-4d6f-98ab-2208abfccc20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:28.610349 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466187a-6ad4-4d6f-98ab-2208abfccc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:28.610775 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466187a-6ad4-4d6f-98ab-2208abfccc20 admin admin] PATH_INFO: `/v3/users/0ceb3ce9db524499a181ef86be7d30fc` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:28.612136 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3466187a-6ad4-4d6f-98ab-2208abfccc20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ceb3ce9db524499a181ef86be7d30fc)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:28.614195 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3466187a-6ad4-4d6f-98ab-2208abfccc20 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:28.632230 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:23:28.677189 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-3466187a-6ad4-4d6f-98ab-2208abfccc20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ceb3ce9db524499a181ef86be7d30fc'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:28.677965 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-3466187a-6ad4-4d6f-98ab-2208abfccc20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ceb3ce9db524499a181ef86be7d30fc'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:28.688343 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-3466187a-6ad4-4d6f-98ab-2208abfccc20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ceb3ce9db524499a181ef86be7d30fc'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:28.708181 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-3466187a-6ad4-4d6f-98ab-2208abfccc20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ceb3ce9db524499a181ef86be7d30fc'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:28.709352 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-3466187a-6ad4-4d6f-98ab-2208abfccc20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ceb3ce9db524499a181ef86be7d30fc'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:28.724978 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1061/2120] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:23:28 2022] DELETE /identity/v3/users/0ceb3ce9db524499a181ef86be7d30fc => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:23:28.729380 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a653fb-659c-4739-bc7f-a4ce44652f95 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:28.729783 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a653fb-659c-4739-bc7f-a4ce44652f95 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:28.729973 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a653fb-659c-4739-bc7f-a4ce44652f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:28.751857 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-70a653fb-659c-4739-bc7f-a4ce44652f95 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:23:28.753412 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-70a653fb-659c-4739-bc7f-a4ce44652f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:23:28.841380 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1060/2121] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:23:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:23:28.849041 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466187a-6ad4-4d6f-98ab-2208abfccc20 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:28.850575 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-3466187a-6ad4-4d6f-98ab-2208abfccc20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:23:28.913809 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466187a-6ad4-4d6f-98ab-2208abfccc20 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:28.917605 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f623e76-89ab-445f-8759-b20e0cc14868 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:28.918259 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f623e76-89ab-445f-8759-b20e0cc14868 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:28.918545 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f623e76-89ab-445f-8759-b20e0cc14868 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:28.918820 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f623e76-89ab-445f-8759-b20e0cc14868 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:28.928308 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f623e76-89ab-445f-8759-b20e0cc14868 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:28.929857 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f623e76-89ab-445f-8759-b20e0cc14868 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:28.939536 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1062/2122] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:23:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:23:29.244553 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a653fb-659c-4739-bc7f-a4ce44652f95 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:29.246083 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-70a653fb-659c-4739-bc7f-a4ce44652f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:23:29.258693 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a653fb-659c-4739-bc7f-a4ce44652f95 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:29.263453 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd097ba-2e1b-4cff-bec9-5add86f8d6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:29.264361 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd097ba-2e1b-4cff-bec9-5add86f8d6af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:29.264650 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd097ba-2e1b-4cff-bec9-5add86f8d6af admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:29.265089 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd097ba-2e1b-4cff-bec9-5add86f8d6af admin admin] PATH_INFO: `/v3/projects/3d0b0c3acd2240219a5c1cb22fdd4d49` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:29.266288 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd097ba-2e1b-4cff-bec9-5add86f8d6af admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d0b0c3acd2240219a5c1cb22fdd4d49)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:29.268277 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd097ba-2e1b-4cff-bec9-5add86f8d6af admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:29.316028 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ddd097ba-2e1b-4cff-bec9-5add86f8d6af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d0b0c3acd2240219a5c1cb22fdd4d49', 'request_id': 'req-ddd097ba-2e1b-4cff-bec9-5add86f8d6af'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:29.323643 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ddd097ba-2e1b-4cff-bec9-5add86f8d6af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d0b0c3acd2240219a5c1cb22fdd4d49', 'request_id': 'req-ddd097ba-2e1b-4cff-bec9-5add86f8d6af'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:29.329863 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ddd097ba-2e1b-4cff-bec9-5add86f8d6af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d0b0c3acd2240219a5c1cb22fdd4d49', 'request_id': 'req-ddd097ba-2e1b-4cff-bec9-5add86f8d6af'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:29.340757 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ddd097ba-2e1b-4cff-bec9-5add86f8d6af admin admin] The token cache is being invalidate because project 3d0b0c3acd2240219a5c1cb22fdd4d49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:23:29.341067 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ddd097ba-2e1b-4cff-bec9-5add86f8d6af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:29.341694 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ddd097ba-2e1b-4cff-bec9-5add86f8d6af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:29.343203 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1061/2123] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:23:29 2022] DELETE /identity/v3/projects/3d0b0c3acd2240219a5c1cb22fdd4d49 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:23:29.347131 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f623e76-89ab-445f-8759-b20e0cc14868 service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:29.356696 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f623e76-89ab-445f-8759-b20e0cc14868 service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:29.411569 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7af5d5-509b-49d8-b0f4-5da8b56ec85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:29.412397 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7af5d5-509b-49d8-b0f4-5da8b56ec85e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:29.412679 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7af5d5-509b-49d8-b0f4-5da8b56ec85e admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:29.412952 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7af5d5-509b-49d8-b0f4-5da8b56ec85e admin admin] PATH_INFO: `/v3/users/a55e763baea342c9ab787cd17b056a83` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:29.414123 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7af5d5-509b-49d8-b0f4-5da8b56ec85e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a55e763baea342c9ab787cd17b056a83)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:29.416104 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7af5d5-509b-49d8-b0f4-5da8b56ec85e admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:29.457342 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:23:29.467803 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-3e7af5d5-509b-49d8-b0f4-5da8b56ec85e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a55e763baea342c9ab787cd17b056a83'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:29.468498 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-3e7af5d5-509b-49d8-b0f4-5da8b56ec85e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a55e763baea342c9ab787cd17b056a83'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:29.475487 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-3e7af5d5-509b-49d8-b0f4-5da8b56ec85e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a55e763baea342c9ab787cd17b056a83'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:29.487808 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-3e7af5d5-509b-49d8-b0f4-5da8b56ec85e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a55e763baea342c9ab787cd17b056a83'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:29.488537 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-3e7af5d5-509b-49d8-b0f4-5da8b56ec85e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a55e763baea342c9ab787cd17b056a83'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:29.501138 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1063/2124] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:23:29 2022] DELETE /identity/v3/users/a55e763baea342c9ab787cd17b056a83 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:23:29.770378 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd097ba-2e1b-4cff-bec9-5add86f8d6af admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:29.771874 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ddd097ba-2e1b-4cff-bec9-5add86f8d6af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:23:29.787986 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd097ba-2e1b-4cff-bec9-5add86f8d6af admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:29.825937 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:23:29.852899 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fa32d0-9528-4fa7-b499-ca3b6079a71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:29.853775 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa32d0-9528-4fa7-b499-ca3b6079a71f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:29.854072 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa32d0-9528-4fa7-b499-ca3b6079a71f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:29.854334 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa32d0-9528-4fa7-b499-ca3b6079a71f admin admin] PATH_INFO: `/v3/projects/4ba1f1fdfffc406abe5126ef2ab9e6f1` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:29.855674 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fa32d0-9528-4fa7-b499-ca3b6079a71f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ba1f1fdfffc406abe5126ef2ab9e6f1)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:29.857720 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fa32d0-9528-4fa7-b499-ca3b6079a71f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:29.914582 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-99fa32d0-9528-4fa7-b499-ca3b6079a71f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ba1f1fdfffc406abe5126ef2ab9e6f1', 'request_id': 'req-99fa32d0-9528-4fa7-b499-ca3b6079a71f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:29.923640 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-99fa32d0-9528-4fa7-b499-ca3b6079a71f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ba1f1fdfffc406abe5126ef2ab9e6f1', 'request_id': 'req-99fa32d0-9528-4fa7-b499-ca3b6079a71f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:29.934982 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-99fa32d0-9528-4fa7-b499-ca3b6079a71f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ba1f1fdfffc406abe5126ef2ab9e6f1', 'request_id': 'req-99fa32d0-9528-4fa7-b499-ca3b6079a71f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:29.947074 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-99fa32d0-9528-4fa7-b499-ca3b6079a71f admin admin] The token cache is being invalidate because project 4ba1f1fdfffc406abe5126ef2ab9e6f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:23:29.947351 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-99fa32d0-9528-4fa7-b499-ca3b6079a71f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:29.947985 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-99fa32d0-9528-4fa7-b499-ca3b6079a71f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:23:29.950159 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1062/2125] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:23:29 2022] DELETE /identity/v3/projects/4ba1f1fdfffc406abe5126ef2ab9e6f1 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:23:29.954963 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02bb98-6ce7-4db1-97e5-813a78dffd9e None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:29.955447 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02bb98-6ce7-4db1-97e5-813a78dffd9e None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:29.955558 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02bb98-6ce7-4db1-97e5-813a78dffd9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:29.976599 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-af02bb98-6ce7-4db1-97e5-813a78dffd9e None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:23:29.977849 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-af02bb98-6ce7-4db1-97e5-813a78dffd9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:23:30.071580 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1064/2126] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:23:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:23:30.079656 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce748e-9bfa-4d70-a4aa-5bf7fad07325 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:30.080030 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce748e-9bfa-4d70-a4aa-5bf7fad07325 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:30.080357 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce748e-9bfa-4d70-a4aa-5bf7fad07325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:30.100046 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-89ce748e-9bfa-4d70-a4aa-5bf7fad07325 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:23:30.101253 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-89ce748e-9bfa-4d70-a4aa-5bf7fad07325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:23:30.110381 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1063/2127] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:23:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:23:30.115243 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af02bb98-6ce7-4db1-97e5-813a78dffd9e None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:30.125912 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af02bb98-6ce7-4db1-97e5-813a78dffd9e None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:30.131456 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8905af4-81d4-466b-a904-3194b43c3fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:30.132183 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8905af4-81d4-466b-a904-3194b43c3fff admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:30.132475 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8905af4-81d4-466b-a904-3194b43c3fff admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:30.132763 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8905af4-81d4-466b-a904-3194b43c3fff admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:30.133506 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8905af4-81d4-466b-a904-3194b43c3fff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:23:30.133820 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8905af4-81d4-466b-a904-3194b43c3fff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:30.135463 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8905af4-81d4-466b-a904-3194b43c3fff admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:30.152652 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce748e-9bfa-4d70-a4aa-5bf7fad07325 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:30.163519 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce748e-9bfa-4d70-a4aa-5bf7fad07325 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:30.164538 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1065/2128] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:23:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:23:30.168853 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd33f41f-bc79-4548-8868-2f1676154add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:30.169532 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33f41f-bc79-4548-8868-2f1676154add admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:30.169818 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33f41f-bc79-4548-8868-2f1676154add admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:30.170099 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33f41f-bc79-4548-8868-2f1676154add admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:30.170811 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd33f41f-bc79-4548-8868-2f1676154add admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:30.173391 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd33f41f-bc79-4548-8868-2f1676154add admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:30.207958 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1064/2129] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:23:30 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 20:23:30.212423 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8905af4-81d4-466b-a904-3194b43c3fff admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:30.226028 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8905af4-81d4-466b-a904-3194b43c3fff admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:30.300735 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e682e163-0dca-4f6d-a5fe-cfebd532a714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:30.301376 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e682e163-0dca-4f6d-a5fe-cfebd532a714 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:30.301699 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e682e163-0dca-4f6d-a5fe-cfebd532a714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:30.301988 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e682e163-0dca-4f6d-a5fe-cfebd532a714 admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:30.303321 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e682e163-0dca-4f6d-a5fe-cfebd532a714 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:30.305460 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e682e163-0dca-4f6d-a5fe-cfebd532a714 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:30.330913 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1066/2130] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:23:30 2022] POST /identity/v3/users => generated 289 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:23:30.335017 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd33f41f-bc79-4548-8868-2f1676154add admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:30.347158 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd33f41f-bc79-4548-8868-2f1676154add admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:30.351848 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c48a7-165d-4595-895d-a691875d3c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:30.352612 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c48a7-165d-4595-895d-a691875d3c66 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:30.352904 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c48a7-165d-4595-895d-a691875d3c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:30.353294 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c48a7-165d-4595-895d-a691875d3c66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:30.354067 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c48a7-165d-4595-895d-a691875d3c66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:30.355659 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c48a7-165d-4595-895d-a691875d3c66 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:30.366360 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1065/2131] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:23:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:23:30.370495 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e682e163-0dca-4f6d-a5fe-cfebd532a714 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:30.381222 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e682e163-0dca-4f6d-a5fe-cfebd532a714 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:30.385864 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a0f90d-6210-49db-8a22-b213fb78a7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:30.386632 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0f90d-6210-49db-8a22-b213fb78a7d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:30.386925 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0f90d-6210-49db-8a22-b213fb78a7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:30.387208 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0f90d-6210-49db-8a22-b213fb78a7d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:30.387971 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a0f90d-6210-49db-8a22-b213fb78a7d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:30.389566 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a0f90d-6210-49db-8a22-b213fb78a7d1 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:30.403176 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1067/2132] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:23:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:23:30.404400 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c48a7-165d-4595-895d-a691875d3c66 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:30.414933 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c48a7-165d-4595-895d-a691875d3c66 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:30.420042 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645e046-fc33-48b2-ab94-feee0c4a8adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:30.420922 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645e046-fc33-48b2-ab94-feee0c4a8adc admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:30.421227 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645e046-fc33-48b2-ab94-feee0c4a8adc admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:30.421499 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645e046-fc33-48b2-ab94-feee0c4a8adc admin admin] PATH_INFO: `/v3/projects/8c9ddc41b65a4228a432647bf6547bed/users/d9b8010b3a3f479e8350b34180d33f30/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:30.436289 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b645e046-fc33-48b2-ab94-feee0c4a8adc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c9ddc41b65a4228a432647bf6547bed, user_id=d9b8010b3a3f479e8350b34180d33f30, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:30.438980 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b645e046-fc33-48b2-ab94-feee0c4a8adc admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:30.453820 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1066/2133] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:23:30 2022] PUT /identity/v3/projects/8c9ddc41b65a4228a432647bf6547bed/users/d9b8010b3a3f479e8350b34180d33f30/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:23:30.465190 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42a23d-5961-40a2-8299-840e311da100 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:30.465998 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42a23d-5961-40a2-8299-840e311da100 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:30.466357 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42a23d-5961-40a2-8299-840e311da100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:30.496503 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-ef42a23d-5961-40a2-8299-840e311da100 None None] MFA Rules not processed for user `d9b8010b3a3f479e8350b34180d33f30`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:23:30.497824 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-ef42a23d-5961-40a2-8299-840e311da100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:23:30.510168 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:23:30.557334 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e87fe4-88c3-45b2-ae12-8ea65db6f6d4 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:30.558233 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e87fe4-88c3-45b2-ae12-8ea65db6f6d4 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:30.558527 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e87fe4-88c3-45b2-ae12-8ea65db6f6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:30.588777 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-09e87fe4-88c3-45b2-ae12-8ea65db6f6d4 None None] MFA Rules not processed for user `5cf067b8833f4596a1b91073a66768f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:23:30.590475 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-09e87fe4-88c3-45b2-ae12-8ea65db6f6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:23:30.617418 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1068/2134] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:23:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:23:30.621714 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef42a23d-5961-40a2-8299-840e311da100 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:30.673666 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1067/2135] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jun 21 20:23:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 20:23:30.686526 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e87fe4-88c3-45b2-ae12-8ea65db6f6d4 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:30.688536 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-09e87fe4-88c3-45b2-ae12-8ea65db6f6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:23:30.689764 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef42a23d-5961-40a2-8299-840e311da100 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:30.696022 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839a95d-c093-4daf-b7ce-3f79c1d8d9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:30.696698 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839a95d-c093-4daf-b7ce-3f79c1d8d9b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:30.696982 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839a95d-c093-4daf-b7ce-3f79c1d8d9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:30.697261 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839a95d-c093-4daf-b7ce-3f79c1d8d9b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:30.698587 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2839a95d-c093-4daf-b7ce-3f79c1d8d9b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:30.698770 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:23:30.714338 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2839a95d-c093-4daf-b7ce-3f79c1d8d9b5 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:30.744087 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1069/2136] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:23:30 2022] POST /identity/v3/projects => generated 377 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:23:30.748351 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839a95d-c093-4daf-b7ce-3f79c1d8d9b5 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:30.781842 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e87fe4-88c3-45b2-ae12-8ea65db6f6d4 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:30.819715 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839a95d-c093-4daf-b7ce-3f79c1d8d9b5 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:30.825665 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72307a8-1d4b-4e4b-876a-64e1fbc2c076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:30.826392 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72307a8-1d4b-4e4b-876a-64e1fbc2c076 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:30.826685 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72307a8-1d4b-4e4b-876a-64e1fbc2c076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:30.827448 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72307a8-1d4b-4e4b-876a-64e1fbc2c076 admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:30.828705 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72307a8-1d4b-4e4b-876a-64e1fbc2c076 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:30.831052 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72307a8-1d4b-4e4b-876a-64e1fbc2c076 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:30.858546 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29cad7-7d28-4983-836f-3786775db72f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '038537bd12174154ba259e097b97b8bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:30.859461 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29cad7-7d28-4983-836f-3786775db72f service swift] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:30.859769 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29cad7-7d28-4983-836f-3786775db72f service swift] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:30.860096 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29cad7-7d28-4983-836f-3786775db72f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:30.864509 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1070/2137] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:23:30 2022] POST /identity/v3/users => generated 295 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 20:23:30.868657 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72307a8-1d4b-4e4b-876a-64e1fbc2c076 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:30.886376 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72307a8-1d4b-4e4b-876a-64e1fbc2c076 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:30.892224 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58502e-0d43-4d13-a225-ebc3f18e3d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:30.893030 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58502e-0d43-4d13-a225-ebc3f18e3d67 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:30.893839 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58502e-0d43-4d13-a225-ebc3f18e3d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:30.893839 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58502e-0d43-4d13-a225-ebc3f18e3d67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:30.894569 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f58502e-0d43-4d13-a225-ebc3f18e3d67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:30.896314 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f58502e-0d43-4d13-a225-ebc3f18e3d67 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:30.910162 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1071/2138] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:23:30 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 20:23:30.914815 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58502e-0d43-4d13-a225-ebc3f18e3d67 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:30.926698 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58502e-0d43-4d13-a225-ebc3f18e3d67 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:30.932074 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd98191-9907-4f24-bf08-15f810dad992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:30.933277 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd98191-9907-4f24-bf08-15f810dad992 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:30.933671 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd98191-9907-4f24-bf08-15f810dad992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:30.933954 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd98191-9907-4f24-bf08-15f810dad992 admin admin] PATH_INFO: `/v3/projects/57c12693fd62477e92cff3e2246beb06/users/8cfe8c3f148f468db8354efbb2166205/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:30.949861 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc29cad7-7d28-4983-836f-3786775db72f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:30.951589 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc29cad7-7d28-4983-836f-3786775db72f service swift] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:30.952632 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:23:30.961955 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd98191-9907-4f24-bf08-15f810dad992 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57c12693fd62477e92cff3e2246beb06, user_id=8cfe8c3f148f468db8354efbb2166205, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:30.962691 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1068/2139] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jun 21 20:23:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 21 20:23:30.968100 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd98191-9907-4f24-bf08-15f810dad992 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:30.993985 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1072/2140] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:23:30 2022] PUT /identity/v3/projects/57c12693fd62477e92cff3e2246beb06/users/8cfe8c3f148f468db8354efbb2166205/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:23:30.998857 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29cad7-7d28-4983-836f-3786775db72f service swift] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:31.019884 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29cad7-7d28-4983-836f-3786775db72f service swift] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:31.120274 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:23:31.143610 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e498a5d5-d1f6-451e-81c5-2250743be418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:31.144667 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498a5d5-d1f6-451e-81c5-2250743be418 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:31.146488 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498a5d5-d1f6-451e-81c5-2250743be418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:31.146881 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498a5d5-d1f6-451e-81c5-2250743be418 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:31.149003 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e498a5d5-d1f6-451e-81c5-2250743be418 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:31.154054 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e498a5d5-d1f6-451e-81c5-2250743be418 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:31.191176 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd98191-9907-4f24-bf08-15f810dad992 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:31.192322 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1069/2141] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:23:30 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:23:31.207561 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd98191-9907-4f24-bf08-15f810dad992 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:31.233175 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4bc07-33e7-40ad-986b-ae134b1c9893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:31.235980 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4bc07-33e7-40ad-986b-ae134b1c9893 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:31.236283 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4bc07-33e7-40ad-986b-ae134b1c9893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:31.236568 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4bc07-33e7-40ad-986b-ae134b1c9893 admin admin] PATH_INFO: `/v3/projects/57c12693fd62477e92cff3e2246beb06/users/8cfe8c3f148f468db8354efbb2166205/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:31.243336 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b4bc07-33e7-40ad-986b-ae134b1c9893 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57c12693fd62477e92cff3e2246beb06, user_id=8cfe8c3f148f468db8354efbb2166205, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:31.253216 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b4bc07-33e7-40ad-986b-ae134b1c9893 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:31.286276 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1073/2142] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:23:31 2022] PUT /identity/v3/projects/57c12693fd62477e92cff3e2246beb06/users/8cfe8c3f148f468db8354efbb2166205/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:23:31.300588 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f708e7-e7f5-4207-87dc-c130a5ad7673 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:31.301148 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f708e7-e7f5-4207-87dc-c130a5ad7673 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:31.301658 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f708e7-e7f5-4207-87dc-c130a5ad7673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:31.384362 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e7f708e7-e7f5-4207-87dc-c130a5ad7673 None None] MFA Rules not processed for user `8cfe8c3f148f468db8354efbb2166205`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:23:31.385901 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e7f708e7-e7f5-4207-87dc-c130a5ad7673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:23:31.594720 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1070/2143] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:23:31 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:23:31.595437 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4bc07-33e7-40ad-986b-ae134b1c9893 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:31.597237 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-41b4bc07-33e7-40ad-986b-ae134b1c9893 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:23:31.725583 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4bc07-33e7-40ad-986b-ae134b1c9893 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:31.731175 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db3eab1-7400-4f17-bdd8-c6f987e55e5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:31.732859 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3eab1-7400-4f17-bdd8-c6f987e55e5e service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:31.733373 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3eab1-7400-4f17-bdd8-c6f987e55e5e service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:31.734393 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3eab1-7400-4f17-bdd8-c6f987e55e5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:31.809636 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db3eab1-7400-4f17-bdd8-c6f987e55e5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:31.811434 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db3eab1-7400-4f17-bdd8-c6f987e55e5e service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:31.845191 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1074/2144] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:23:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 20:23:41.577823 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=39 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:23:41.826288 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=57,keystone:INSERT=2 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:23:49.175021 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f708e7-e7f5-4207-87dc-c130a5ad7673 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:23:49.196055 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f708e7-e7f5-4207-87dc-c130a5ad7673 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:23:49.200040 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea80b8-13c1-4453-b106-59c8ac5a0d9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:23:49.200694 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea80b8-13c1-4453-b106-59c8ac5a0d9b service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:23:49.200975 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea80b8-13c1-4453-b106-59c8ac5a0d9b service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:23:49.201379 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea80b8-13c1-4453-b106-59c8ac5a0d9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:23:49.236983 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ea80b8-13c1-4453-b106-59c8ac5a0d9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:23:49.238433 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ea80b8-13c1-4453-b106-59c8ac5a0d9b service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:23:49.248615 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1071/2145] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:23:49 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:23:59.244513 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=20 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:24:12.565116 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db3eab1-7400-4f17-bdd8-c6f987e55e5e service cinder] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:24:12.566536 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-5db3eab1-7400-4f17-bdd8-c6f987e55e5e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:24:12.696279 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db3eab1-7400-4f17-bdd8-c6f987e55e5e service cinder] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:24:12.701032 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599fd08-2bbb-49ed-af86-1d6c86e6ea7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:24:12.701913 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599fd08-2bbb-49ed-af86-1d6c86e6ea7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:24:12.702200 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599fd08-2bbb-49ed-af86-1d6c86e6ea7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:24:12.702479 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599fd08-2bbb-49ed-af86-1d6c86e6ea7b admin admin] PATH_INFO: `/v3/users/7d5e51ecffdc44199dc32cd5be701853` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:24:12.703911 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3599fd08-2bbb-49ed-af86-1d6c86e6ea7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d5e51ecffdc44199dc32cd5be701853)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:24:12.706199 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3599fd08-2bbb-49ed-af86-1d6c86e6ea7b admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:24:12.752299 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-3599fd08-2bbb-49ed-af86-1d6c86e6ea7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d5e51ecffdc44199dc32cd5be701853'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:24:12.752944 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-3599fd08-2bbb-49ed-af86-1d6c86e6ea7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d5e51ecffdc44199dc32cd5be701853'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:24:12.760125 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-3599fd08-2bbb-49ed-af86-1d6c86e6ea7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d5e51ecffdc44199dc32cd5be701853'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:24:12.772226 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-3599fd08-2bbb-49ed-af86-1d6c86e6ea7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d5e51ecffdc44199dc32cd5be701853'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:24:12.772885 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-3599fd08-2bbb-49ed-af86-1d6c86e6ea7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d5e51ecffdc44199dc32cd5be701853'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:24:12.785208 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1075/2146] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:24:12 2022] DELETE /identity/v3/users/7d5e51ecffdc44199dc32cd5be701853 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:24:12.789743 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650aa308-0aed-4c33-bce6-89ca9228eaa3 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:24:12.790279 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650aa308-0aed-4c33-bce6-89ca9228eaa3 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:24:12.790279 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650aa308-0aed-4c33-bce6-89ca9228eaa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:24:12.815825 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-650aa308-0aed-4c33-bce6-89ca9228eaa3 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:24:12.817055 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-650aa308-0aed-4c33-bce6-89ca9228eaa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:24:12.874835 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1072/2147] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:24:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:24:12.884631 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599fd08-2bbb-49ed-af86-1d6c86e6ea7b admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:24:12.886026 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-3599fd08-2bbb-49ed-af86-1d6c86e6ea7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:24:12.915947 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:24:12.981236 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599fd08-2bbb-49ed-af86-1d6c86e6ea7b admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:24:12.987618 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc21529e-23e9-44d4-9a36-a91148303a68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:24:12.988303 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21529e-23e9-44d4-9a36-a91148303a68 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:24:12.988590 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21529e-23e9-44d4-9a36-a91148303a68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:24:12.988869 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21529e-23e9-44d4-9a36-a91148303a68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:24:12.998212 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc21529e-23e9-44d4-9a36-a91148303a68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:24:12.999630 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc21529e-23e9-44d4-9a36-a91148303a68 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:24:13.009290 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1076/2148] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:24:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:24:13.291693 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650aa308-0aed-4c33-bce6-89ca9228eaa3 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:24:13.293183 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-650aa308-0aed-4c33-bce6-89ca9228eaa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:24:13.305000 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650aa308-0aed-4c33-bce6-89ca9228eaa3 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:24:13.309623 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086217ae-c7c8-4209-804e-4b3f77f49910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:24:13.310497 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086217ae-c7c8-4209-804e-4b3f77f49910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:24:13.310780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086217ae-c7c8-4209-804e-4b3f77f49910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:24:13.311059 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086217ae-c7c8-4209-804e-4b3f77f49910 admin admin] PATH_INFO: `/v3/projects/9cf9f7c619a54669a5e9c70f491115d0` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:24:13.313162 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086217ae-c7c8-4209-804e-4b3f77f49910 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cf9f7c619a54669a5e9c70f491115d0)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:24:13.314701 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086217ae-c7c8-4209-804e-4b3f77f49910 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:24:13.359755 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-086217ae-c7c8-4209-804e-4b3f77f49910 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cf9f7c619a54669a5e9c70f491115d0', 'request_id': 'req-086217ae-c7c8-4209-804e-4b3f77f49910'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:24:13.366017 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-086217ae-c7c8-4209-804e-4b3f77f49910 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cf9f7c619a54669a5e9c70f491115d0', 'request_id': 'req-086217ae-c7c8-4209-804e-4b3f77f49910'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:24:13.371446 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-086217ae-c7c8-4209-804e-4b3f77f49910 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cf9f7c619a54669a5e9c70f491115d0', 'request_id': 'req-086217ae-c7c8-4209-804e-4b3f77f49910'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:24:13.382595 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-086217ae-c7c8-4209-804e-4b3f77f49910 admin admin] The token cache is being invalidate because project 9cf9f7c619a54669a5e9c70f491115d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:24:13.382885 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-086217ae-c7c8-4209-804e-4b3f77f49910 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:24:13.383500 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-086217ae-c7c8-4209-804e-4b3f77f49910 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:24:13.385032 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1073/2149] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:24:13 2022] DELETE /identity/v3/projects/9cf9f7c619a54669a5e9c70f491115d0 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:24:13.390273 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35ab25-f8ea-4b64-b109-fb83e9e94891 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:24:13.390610 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35ab25-f8ea-4b64-b109-fb83e9e94891 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:24:13.391400 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35ab25-f8ea-4b64-b109-fb83e9e94891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:24:13.435565 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-3c35ab25-f8ea-4b64-b109-fb83e9e94891 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:24:13.436791 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-3c35ab25-f8ea-4b64-b109-fb83e9e94891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:24:13.497644 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1077/2150] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:24:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:24:13.505331 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e9e46-82b2-4be2-ab60-bfec8b79d3b5 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:24:13.505623 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e9e46-82b2-4be2-ab60-bfec8b79d3b5 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:24:13.505904 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e9e46-82b2-4be2-ab60-bfec8b79d3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:24:13.524213 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-7b2e9e46-82b2-4be2-ab60-bfec8b79d3b5 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:24:13.525338 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7b2e9e46-82b2-4be2-ab60-bfec8b79d3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:24:13.533102 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1074/2151] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:24:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:24:13.537218 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c35ab25-f8ea-4b64-b109-fb83e9e94891 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:24:13.546747 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c35ab25-f8ea-4b64-b109-fb83e9e94891 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:24:13.551216 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce76c698-a029-43c5-891d-9cf2afa2cda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:24:13.551863 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76c698-a029-43c5-891d-9cf2afa2cda2 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:24:13.552176 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76c698-a029-43c5-891d-9cf2afa2cda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:24:13.552461 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76c698-a029-43c5-891d-9cf2afa2cda2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:24:13.553189 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce76c698-a029-43c5-891d-9cf2afa2cda2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:24:13.553498 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce76c698-a029-43c5-891d-9cf2afa2cda2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:24:13.555078 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce76c698-a029-43c5-891d-9cf2afa2cda2 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:24:13.571359 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1078/2152] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:24:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:24:13.572471 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e9e46-82b2-4be2-ab60-bfec8b79d3b5 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:24:13.582665 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e9e46-82b2-4be2-ab60-bfec8b79d3b5 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:24:13.588169 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a1bdb-6367-493d-81ed-4a1a183a3222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:24:13.588828 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a1bdb-6367-493d-81ed-4a1a183a3222 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:24:13.589196 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a1bdb-6367-493d-81ed-4a1a183a3222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:24:13.589766 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a1bdb-6367-493d-81ed-4a1a183a3222 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:24:13.590307 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a1bdb-6367-493d-81ed-4a1a183a3222 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:24:13.592352 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a1bdb-6367-493d-81ed-4a1a183a3222 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:24:13.618708 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1075/2153] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:24:13 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:24:13.622906 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce76c698-a029-43c5-891d-9cf2afa2cda2 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:24:13.633433 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce76c698-a029-43c5-891d-9cf2afa2cda2 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:24:13.688468 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fb0e89-bec8-4499-912d-bb1839e60551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:24:13.689131 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb0e89-bec8-4499-912d-bb1839e60551 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:24:13.689413 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb0e89-bec8-4499-912d-bb1839e60551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:24:13.689689 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb0e89-bec8-4499-912d-bb1839e60551 admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:24:13.690380 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fb0e89-bec8-4499-912d-bb1839e60551 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:24:13.692318 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fb0e89-bec8-4499-912d-bb1839e60551 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:24:13.699582 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:24:13.714624 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1079/2154] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:24:13 2022] POST /identity/v3/users => generated 285 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:24:13.718785 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a1bdb-6367-493d-81ed-4a1a183a3222 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:24:13.728857 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a1bdb-6367-493d-81ed-4a1a183a3222 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:24:13.735067 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01c60f-b147-482e-bc81-14f33f4ac70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:24:13.735067 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01c60f-b147-482e-bc81-14f33f4ac70d admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:24:13.735067 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01c60f-b147-482e-bc81-14f33f4ac70d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:24:13.735427 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01c60f-b147-482e-bc81-14f33f4ac70d admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:24:13.735906 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f01c60f-b147-482e-bc81-14f33f4ac70d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:24:13.737513 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f01c60f-b147-482e-bc81-14f33f4ac70d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:24:13.748456 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1076/2155] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:24:13.753033 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fb0e89-bec8-4499-912d-bb1839e60551 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:24:13.763047 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fb0e89-bec8-4499-912d-bb1839e60551 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:24:13.767741 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f160520a-5377-4ed6-bf95-41a73384780b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:24:13.768431 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160520a-5377-4ed6-bf95-41a73384780b admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:24:13.768715 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160520a-5377-4ed6-bf95-41a73384780b admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:24:13.768991 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160520a-5377-4ed6-bf95-41a73384780b admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:24:13.769722 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f160520a-5377-4ed6-bf95-41a73384780b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:24:13.771306 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f160520a-5377-4ed6-bf95-41a73384780b admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:24:13.781684 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1080/2156] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:24:13.785768 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01c60f-b147-482e-bc81-14f33f4ac70d admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:24:13.796032 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01c60f-b147-482e-bc81-14f33f4ac70d admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:24:13.801542 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c32872-391a-43d3-afb9-950041cf796d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:24:13.802426 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c32872-391a-43d3-afb9-950041cf796d admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:24:13.802708 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c32872-391a-43d3-afb9-950041cf796d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:24:13.802982 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c32872-391a-43d3-afb9-950041cf796d admin admin] PATH_INFO: `/v3/projects/f001165888c644ef84087f3c666e3960/users/aa4c918e9f8a4b75b6cf910346ecf85f/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:24:13.818487 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c32872-391a-43d3-afb9-950041cf796d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f001165888c644ef84087f3c666e3960, user_id=aa4c918e9f8a4b75b6cf910346ecf85f, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:24:13.821248 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c32872-391a-43d3-afb9-950041cf796d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:24:13.847310 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1077/2157] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:24:13 2022] PUT /identity/v3/projects/f001165888c644ef84087f3c666e3960/users/aa4c918e9f8a4b75b6cf910346ecf85f/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:24:13.857702 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e40230-de5f-4871-b63b-b77b6321c651 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:24:13.857997 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e40230-de5f-4871-b63b-b77b6321c651 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:24:13.858285 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e40230-de5f-4871-b63b-b77b6321c651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:24:13.896521 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-74e40230-de5f-4871-b63b-b77b6321c651 None None] MFA Rules not processed for user `aa4c918e9f8a4b75b6cf910346ecf85f`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:24:13.897742 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-74e40230-de5f-4871-b63b-b77b6321c651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:24:13.965459 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1081/2158] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:24:13 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:24:13.977861 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c32872-391a-43d3-afb9-950041cf796d admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:24:13.979536 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-46c32872-391a-43d3-afb9-950041cf796d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:24:14.012172 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:24:14.070534 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c32872-391a-43d3-afb9-950041cf796d admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:24:14.074223 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cfefd4-2b43-4e47-9e66-4cf079f0cf5a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30400df887ee433086d1810331785891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:24:14.074896 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cfefd4-2b43-4e47-9e66-4cf079f0cf5a service glance] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:24:14.075192 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cfefd4-2b43-4e47-9e66-4cf079f0cf5a service glance] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:24:14.075473 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cfefd4-2b43-4e47-9e66-4cf079f0cf5a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:24:14.084327 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cfefd4-2b43-4e47-9e66-4cf079f0cf5a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:24:14.086015 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cfefd4-2b43-4e47-9e66-4cf079f0cf5a service glance] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:24:14.096266 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1078/2159] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:24:13 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:24:23.962410 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:INSERT=2,keystone:SELECT=39 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:24:24.091157 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=20 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:24:31.671284 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e40230-de5f-4871-b63b-b77b6321c651 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:24:31.674023 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-74e40230-de5f-4871-b63b-b77b6321c651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:24:31.746268 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e40230-de5f-4871-b63b-b77b6321c651 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:24:31.751434 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4b55d1-5ac3-48b0-90f8-e50537e682a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:24:31.752399 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b55d1-5ac3-48b0-90f8-e50537e682a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:24:31.752680 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b55d1-5ac3-48b0-90f8-e50537e682a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:24:31.752958 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b55d1-5ac3-48b0-90f8-e50537e682a8 admin admin] PATH_INFO: `/v3/users/d9b8010b3a3f479e8350b34180d33f30` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:24:31.754131 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4b55d1-5ac3-48b0-90f8-e50537e682a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9b8010b3a3f479e8350b34180d33f30)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:24:31.756072 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4b55d1-5ac3-48b0-90f8-e50537e682a8 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:24:31.810125 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-1e4b55d1-5ac3-48b0-90f8-e50537e682a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9b8010b3a3f479e8350b34180d33f30'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:24:31.811369 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-1e4b55d1-5ac3-48b0-90f8-e50537e682a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9b8010b3a3f479e8350b34180d33f30'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:24:31.825380 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-1e4b55d1-5ac3-48b0-90f8-e50537e682a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9b8010b3a3f479e8350b34180d33f30'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:24:31.841230 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-1e4b55d1-5ac3-48b0-90f8-e50537e682a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9b8010b3a3f479e8350b34180d33f30'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:24:31.842619 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-1e4b55d1-5ac3-48b0-90f8-e50537e682a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9b8010b3a3f479e8350b34180d33f30'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:24:31.867214 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1082/2160] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:24:31 2022] DELETE /identity/v3/users/d9b8010b3a3f479e8350b34180d33f30 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:24:31.869027 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd67c6-02c1-4b1f-8052-067b66d3eb14 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:24:31.869493 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd67c6-02c1-4b1f-8052-067b66d3eb14 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:24:31.869635 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd67c6-02c1-4b1f-8052-067b66d3eb14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:24:31.887680 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-edcd67c6-02c1-4b1f-8052-067b66d3eb14 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:24:31.888927 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-edcd67c6-02c1-4b1f-8052-067b66d3eb14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:24:31.963367 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1079/2161] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:24:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:24:31.974067 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4b55d1-5ac3-48b0-90f8-e50537e682a8 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:24:31.975747 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-1e4b55d1-5ac3-48b0-90f8-e50537e682a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:24:32.035769 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4b55d1-5ac3-48b0-90f8-e50537e682a8 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:24:32.039335 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca37cd95-fb05-4789-95c0-5b76b00752b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:24:32.040082 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca37cd95-fb05-4789-95c0-5b76b00752b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:24:32.040373 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca37cd95-fb05-4789-95c0-5b76b00752b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:24:32.040655 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca37cd95-fb05-4789-95c0-5b76b00752b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:24:32.050194 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca37cd95-fb05-4789-95c0-5b76b00752b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:24:32.051574 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca37cd95-fb05-4789-95c0-5b76b00752b9 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:24:32.060966 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1083/2162] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:24:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:24:32.342872 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd67c6-02c1-4b1f-8052-067b66d3eb14 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:24:32.345139 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-edcd67c6-02c1-4b1f-8052-067b66d3eb14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:24:32.358645 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd67c6-02c1-4b1f-8052-067b66d3eb14 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:24:32.364163 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2af772-d1c6-4b8d-8fa5-663c4bd57102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:24:32.365158 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2af772-d1c6-4b8d-8fa5-663c4bd57102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:24:32.365430 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2af772-d1c6-4b8d-8fa5-663c4bd57102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:24:32.365649 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2af772-d1c6-4b8d-8fa5-663c4bd57102 admin admin] PATH_INFO: `/v3/projects/8c9ddc41b65a4228a432647bf6547bed` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:24:32.368208 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2af772-d1c6-4b8d-8fa5-663c4bd57102 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c9ddc41b65a4228a432647bf6547bed)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:24:32.370325 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2af772-d1c6-4b8d-8fa5-663c4bd57102 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:24:32.429134 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2e2af772-d1c6-4b8d-8fa5-663c4bd57102 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c9ddc41b65a4228a432647bf6547bed', 'request_id': 'req-2e2af772-d1c6-4b8d-8fa5-663c4bd57102'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:24:32.436535 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2e2af772-d1c6-4b8d-8fa5-663c4bd57102 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c9ddc41b65a4228a432647bf6547bed', 'request_id': 'req-2e2af772-d1c6-4b8d-8fa5-663c4bd57102'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:24:32.443018 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2e2af772-d1c6-4b8d-8fa5-663c4bd57102 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c9ddc41b65a4228a432647bf6547bed', 'request_id': 'req-2e2af772-d1c6-4b8d-8fa5-663c4bd57102'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:24:32.455042 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2e2af772-d1c6-4b8d-8fa5-663c4bd57102 admin admin] The token cache is being invalidate because project 8c9ddc41b65a4228a432647bf6547bed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:24:32.455356 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2e2af772-d1c6-4b8d-8fa5-663c4bd57102 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:24:32.456069 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2e2af772-d1c6-4b8d-8fa5-663c4bd57102 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:24:32.457615 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1080/2163] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:24:32 2022] DELETE /identity/v3/projects/8c9ddc41b65a4228a432647bf6547bed => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:24:32.461814 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca37cd95-fb05-4789-95c0-5b76b00752b9 service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:24:32.472148 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca37cd95-fb05-4789-95c0-5b76b00752b9 service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:24:32.490482 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:24:32.532386 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3c8e1d-2ad2-40ca-a2d1-c99922bcc2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:24:32.533269 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c8e1d-2ad2-40ca-a2d1-c99922bcc2b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:24:32.533556 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c8e1d-2ad2-40ca-a2d1-c99922bcc2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:24:32.533835 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c8e1d-2ad2-40ca-a2d1-c99922bcc2b8 admin admin] PATH_INFO: `/v3/users/8cfe8c3f148f468db8354efbb2166205` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:24:32.535027 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3c8e1d-2ad2-40ca-a2d1-c99922bcc2b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cfe8c3f148f468db8354efbb2166205)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:24:32.536985 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3c8e1d-2ad2-40ca-a2d1-c99922bcc2b8 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:24:32.581934 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-0a3c8e1d-2ad2-40ca-a2d1-c99922bcc2b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cfe8c3f148f468db8354efbb2166205'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:24:32.582528 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-0a3c8e1d-2ad2-40ca-a2d1-c99922bcc2b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cfe8c3f148f468db8354efbb2166205'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:24:32.590875 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-0a3c8e1d-2ad2-40ca-a2d1-c99922bcc2b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cfe8c3f148f468db8354efbb2166205'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:24:32.604780 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-0a3c8e1d-2ad2-40ca-a2d1-c99922bcc2b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cfe8c3f148f468db8354efbb2166205'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:24:32.605519 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-0a3c8e1d-2ad2-40ca-a2d1-c99922bcc2b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cfe8c3f148f468db8354efbb2166205'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:24:32.617670 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1084/2164] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:24:32 2022] DELETE /identity/v3/users/8cfe8c3f148f468db8354efbb2166205 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:24:32.891446 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2af772-d1c6-4b8d-8fa5-663c4bd57102 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:24:32.892976 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2e2af772-d1c6-4b8d-8fa5-663c4bd57102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:24:32.915134 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2af772-d1c6-4b8d-8fa5-663c4bd57102 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:24:32.975047 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59d52f3-3b3f-4313-8470-320341336250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:24:32.975940 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d52f3-3b3f-4313-8470-320341336250 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:24:32.976230 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d52f3-3b3f-4313-8470-320341336250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:24:32.976507 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d52f3-3b3f-4313-8470-320341336250 admin admin] PATH_INFO: `/v3/projects/57c12693fd62477e92cff3e2246beb06` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:24:32.977692 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59d52f3-3b3f-4313-8470-320341336250 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57c12693fd62477e92cff3e2246beb06)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:24:32.979581 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59d52f3-3b3f-4313-8470-320341336250 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:24:33.010432 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:24:33.033910 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b59d52f3-3b3f-4313-8470-320341336250 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57c12693fd62477e92cff3e2246beb06', 'request_id': 'req-b59d52f3-3b3f-4313-8470-320341336250'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:24:33.041568 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b59d52f3-3b3f-4313-8470-320341336250 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57c12693fd62477e92cff3e2246beb06', 'request_id': 'req-b59d52f3-3b3f-4313-8470-320341336250'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:24:33.047910 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b59d52f3-3b3f-4313-8470-320341336250 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57c12693fd62477e92cff3e2246beb06', 'request_id': 'req-b59d52f3-3b3f-4313-8470-320341336250'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:24:33.059074 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b59d52f3-3b3f-4313-8470-320341336250 admin admin] The token cache is being invalidate because project 57c12693fd62477e92cff3e2246beb06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:24:33.059359 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b59d52f3-3b3f-4313-8470-320341336250 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:24:33.060094 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b59d52f3-3b3f-4313-8470-320341336250 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:24:33.061645 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1081/2165] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:24:32 2022] DELETE /identity/v3/projects/57c12693fd62477e92cff3e2246beb06 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:24:33.067954 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a1f8f-b084-46c7-9963-85c335748b5d None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:24:33.068439 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a1f8f-b084-46c7-9963-85c335748b5d None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:24:33.068689 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a1f8f-b084-46c7-9963-85c335748b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:24:33.090304 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-519a1f8f-b084-46c7-9963-85c335748b5d None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:24:33.091446 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-519a1f8f-b084-46c7-9963-85c335748b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:24:33.156022 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1085/2166] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:24:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:24:33.163859 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7accd-71b9-4686-afbb-8b7ee1b70f32 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:24:33.164268 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7accd-71b9-4686-afbb-8b7ee1b70f32 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:24:33.164616 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7accd-71b9-4686-afbb-8b7ee1b70f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:24:33.183588 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-09a7accd-71b9-4686-afbb-8b7ee1b70f32 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:24:33.184816 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-09a7accd-71b9-4686-afbb-8b7ee1b70f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:24:33.193928 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1082/2167] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:24:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:24:33.198089 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a1f8f-b084-46c7-9963-85c335748b5d None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:24:33.207858 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a1f8f-b084-46c7-9963-85c335748b5d None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:24:33.212810 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c49aa-058c-4731-9f31-650d43ec5e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:24:33.213465 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c49aa-058c-4731-9f31-650d43ec5e6a admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:24:33.213750 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c49aa-058c-4731-9f31-650d43ec5e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:24:33.214057 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c49aa-058c-4731-9f31-650d43ec5e6a admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:24:33.214788 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2c49aa-058c-4731-9f31-650d43ec5e6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:24:33.215095 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2c49aa-058c-4731-9f31-650d43ec5e6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:24:33.216737 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2c49aa-058c-4731-9f31-650d43ec5e6a admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:24:33.228487 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1086/2168] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:24:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:24:33.232733 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a7accd-71b9-4686-afbb-8b7ee1b70f32 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:24:33.242548 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a7accd-71b9-4686-afbb-8b7ee1b70f32 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:24:33.247196 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45cffb-d566-4b25-9e6b-b93a84632a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:24:33.247858 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45cffb-d566-4b25-9e6b-b93a84632a2f admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:24:33.248174 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45cffb-d566-4b25-9e6b-b93a84632a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:24:33.248455 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45cffb-d566-4b25-9e6b-b93a84632a2f admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:24:33.249174 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a45cffb-d566-4b25-9e6b-b93a84632a2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:24:33.251614 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a45cffb-d566-4b25-9e6b-b93a84632a2f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:24:33.276821 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1083/2169] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:24:33 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:24:33.282002 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c49aa-058c-4731-9f31-650d43ec5e6a admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:24:33.292655 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c49aa-058c-4731-9f31-650d43ec5e6a admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:24:33.318878 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:24:33.350803 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af164b51-5470-467b-ae98-a6c1dfa010f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:24:33.351404 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af164b51-5470-467b-ae98-a6c1dfa010f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:24:33.351692 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af164b51-5470-467b-ae98-a6c1dfa010f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:24:33.352008 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af164b51-5470-467b-ae98-a6c1dfa010f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:24:33.352714 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af164b51-5470-467b-ae98-a6c1dfa010f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:24:33.354634 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af164b51-5470-467b-ae98-a6c1dfa010f3 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:24:33.374321 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1087/2170] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:24:33 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:24:33.379054 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45cffb-d566-4b25-9e6b-b93a84632a2f admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:24:33.389230 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45cffb-d566-4b25-9e6b-b93a84632a2f admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:24:33.394109 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c7c8f-aec0-4f18-adf7-22dc0d5a5415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:24:33.394773 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c7c8f-aec0-4f18-adf7-22dc0d5a5415 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:24:33.395055 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c7c8f-aec0-4f18-adf7-22dc0d5a5415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:24:33.395330 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c7c8f-aec0-4f18-adf7-22dc0d5a5415 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:24:33.396095 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c7c8f-aec0-4f18-adf7-22dc0d5a5415 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:24:33.397681 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c7c8f-aec0-4f18-adf7-22dc0d5a5415 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:24:33.408004 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1084/2171] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 20:24:33.411854 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af164b51-5470-467b-ae98-a6c1dfa010f3 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:24:33.422295 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af164b51-5470-467b-ae98-a6c1dfa010f3 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:24:33.427114 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f6110-7c60-4c35-be93-42f1e758c968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:24:33.427787 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f6110-7c60-4c35-be93-42f1e758c968 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:24:33.428115 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f6110-7c60-4c35-be93-42f1e758c968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:24:33.428400 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f6110-7c60-4c35-be93-42f1e758c968 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:24:33.429161 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5f6110-7c60-4c35-be93-42f1e758c968 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:24:33.430749 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5f6110-7c60-4c35-be93-42f1e758c968 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:24:33.441874 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1088/2172] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:24:33.445953 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c7c8f-aec0-4f18-adf7-22dc0d5a5415 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:24:33.456012 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c7c8f-aec0-4f18-adf7-22dc0d5a5415 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:24:33.460909 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72ed718-86c0-4000-9ff3-62e0b816c6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:24:33.461792 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ed718-86c0-4000-9ff3-62e0b816c6a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:24:33.462077 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ed718-86c0-4000-9ff3-62e0b816c6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:24:33.462356 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ed718-86c0-4000-9ff3-62e0b816c6a4 admin admin] PATH_INFO: `/v3/projects/76835c9b99cb4557b98b757d9d079a45/users/4c85aca0169a41c69bec323fb8bdf607/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:24:33.477254 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72ed718-86c0-4000-9ff3-62e0b816c6a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76835c9b99cb4557b98b757d9d079a45, user_id=4c85aca0169a41c69bec323fb8bdf607, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:24:33.479894 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72ed718-86c0-4000-9ff3-62e0b816c6a4 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:24:33.493730 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1085/2173] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:24:33 2022] PUT /identity/v3/projects/76835c9b99cb4557b98b757d9d079a45/users/4c85aca0169a41c69bec323fb8bdf607/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:24:33.503844 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9af7cb-6380-4166-835e-6354c5193234 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:24:33.504169 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9af7cb-6380-4166-835e-6354c5193234 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:24:33.504454 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9af7cb-6380-4166-835e-6354c5193234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:24:33.530301 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-4a9af7cb-6380-4166-835e-6354c5193234 None None] MFA Rules not processed for user `4c85aca0169a41c69bec323fb8bdf607`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:24:33.532075 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-4a9af7cb-6380-4166-835e-6354c5193234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:24:33.595143 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1089/2174] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:24:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:24:33.605867 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72ed718-86c0-4000-9ff3-62e0b816c6a4 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:24:33.607458 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d72ed718-86c0-4000-9ff3-62e0b816c6a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:24:33.687426 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72ed718-86c0-4000-9ff3-62e0b816c6a4 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:24:33.691155 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9500ea5-ffc1-406b-8196-68fa12de0519 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:24:33.691804 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9500ea5-ffc1-406b-8196-68fa12de0519 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:24:33.692123 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9500ea5-ffc1-406b-8196-68fa12de0519 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:24:33.692413 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9500ea5-ffc1-406b-8196-68fa12de0519 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:24:33.700720 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9500ea5-ffc1-406b-8196-68fa12de0519 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:24:33.702192 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9500ea5-ffc1-406b-8196-68fa12de0519 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:24:33.713515 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1086/2175] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:24:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:24:38.429551 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9af7cb-6380-4166-835e-6354c5193234 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:24:38.430398 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-4a9af7cb-6380-4166-835e-6354c5193234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:24:38.526026 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9af7cb-6380-4166-835e-6354c5193234 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:24:38.531210 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e74f2-21db-48a4-a8e9-f6cb12275039 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59294bff27c4b3f8aaeeab48ed35a0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:24:38.531867 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e74f2-21db-48a4-a8e9-f6cb12275039 service placement] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:24:38.532186 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e74f2-21db-48a4-a8e9-f6cb12275039 service placement] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:24:38.532468 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e74f2-21db-48a4-a8e9-f6cb12275039 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:24:38.534253 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-0f6e74f2-21db-48a4-a8e9-f6cb12275039 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:24:38.545708 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6e74f2-21db-48a4-a8e9-f6cb12275039 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:24:38.547821 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6e74f2-21db-48a4-a8e9-f6cb12275039 service placement] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:24:38.557788 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1090/2176] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:24:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:24:43.708794 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:DELETE=6,keystone:SELECT=76,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:24:48.553532 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=94,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:24:53.560229 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9500ea5-ffc1-406b-8196-68fa12de0519 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:24:53.622764 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9500ea5-ffc1-406b-8196-68fa12de0519 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:24:53.628151 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b20096-c71b-4214-ba6b-113bd36a1cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:24:53.629026 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b20096-c71b-4214-ba6b-113bd36a1cc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:24:53.629313 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b20096-c71b-4214-ba6b-113bd36a1cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:24:53.629601 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b20096-c71b-4214-ba6b-113bd36a1cc9 admin admin] PATH_INFO: `/v3/users/4c85aca0169a41c69bec323fb8bdf607` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:24:53.631090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b20096-c71b-4214-ba6b-113bd36a1cc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c85aca0169a41c69bec323fb8bdf607)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:24:53.633301 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b20096-c71b-4214-ba6b-113bd36a1cc9 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:24:53.678560 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c6b20096-c71b-4214-ba6b-113bd36a1cc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c85aca0169a41c69bec323fb8bdf607'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:24:53.679218 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c6b20096-c71b-4214-ba6b-113bd36a1cc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c85aca0169a41c69bec323fb8bdf607'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:24:53.679831 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c6b20096-c71b-4214-ba6b-113bd36a1cc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c85aca0169a41c69bec323fb8bdf607'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:24:53.691841 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c6b20096-c71b-4214-ba6b-113bd36a1cc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c85aca0169a41c69bec323fb8bdf607'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:24:53.699131 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c6b20096-c71b-4214-ba6b-113bd36a1cc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c85aca0169a41c69bec323fb8bdf607'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:24:53.712245 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1087/2177] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:24:53 2022] DELETE /identity/v3/users/4c85aca0169a41c69bec323fb8bdf607 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:24:53.716771 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658afca9-76f3-4051-ba47-f6f2c372135f None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:24:53.717269 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658afca9-76f3-4051-ba47-f6f2c372135f None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:24:53.717373 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658afca9-76f3-4051-ba47-f6f2c372135f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:24:53.735964 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-658afca9-76f3-4051-ba47-f6f2c372135f None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:24:53.737149 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-658afca9-76f3-4051-ba47-f6f2c372135f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:24:53.795238 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1091/2178] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:24:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:24:53.805530 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b20096-c71b-4214-ba6b-113bd36a1cc9 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:24:53.806919 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c6b20096-c71b-4214-ba6b-113bd36a1cc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:24:53.864269 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b20096-c71b-4214-ba6b-113bd36a1cc9 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:24:53.867842 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8296fb82-023a-4100-9626-1561e3718e8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:24:53.868515 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8296fb82-023a-4100-9626-1561e3718e8d service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:24:53.868796 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8296fb82-023a-4100-9626-1561e3718e8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:24:53.869071 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8296fb82-023a-4100-9626-1561e3718e8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:24:53.878014 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8296fb82-023a-4100-9626-1561e3718e8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:24:53.879373 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8296fb82-023a-4100-9626-1561e3718e8d service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:24:53.888675 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1088/2179] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:24:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:24:54.160389 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658afca9-76f3-4051-ba47-f6f2c372135f None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:24:54.162138 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-658afca9-76f3-4051-ba47-f6f2c372135f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:24:54.179334 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658afca9-76f3-4051-ba47-f6f2c372135f None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:24:54.186366 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b7fb4-31e3-4d33-ab73-da18028f99f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:24:54.187408 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b7fb4-31e3-4d33-ab73-da18028f99f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:24:54.187824 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b7fb4-31e3-4d33-ab73-da18028f99f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:24:54.188172 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b7fb4-31e3-4d33-ab73-da18028f99f1 admin admin] PATH_INFO: `/v3/projects/76835c9b99cb4557b98b757d9d079a45` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:24:54.189390 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144b7fb4-31e3-4d33-ab73-da18028f99f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76835c9b99cb4557b98b757d9d079a45)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:24:54.191248 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144b7fb4-31e3-4d33-ab73-da18028f99f1 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:24:54.254728 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-144b7fb4-31e3-4d33-ab73-da18028f99f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76835c9b99cb4557b98b757d9d079a45', 'request_id': 'req-144b7fb4-31e3-4d33-ab73-da18028f99f1'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:24:54.262011 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-144b7fb4-31e3-4d33-ab73-da18028f99f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76835c9b99cb4557b98b757d9d079a45', 'request_id': 'req-144b7fb4-31e3-4d33-ab73-da18028f99f1'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:24:54.270434 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-144b7fb4-31e3-4d33-ab73-da18028f99f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76835c9b99cb4557b98b757d9d079a45', 'request_id': 'req-144b7fb4-31e3-4d33-ab73-da18028f99f1'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:24:54.284437 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-144b7fb4-31e3-4d33-ab73-da18028f99f1 admin admin] The token cache is being invalidate because project 76835c9b99cb4557b98b757d9d079a45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:24:54.284587 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-144b7fb4-31e3-4d33-ab73-da18028f99f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:24:54.285176 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-144b7fb4-31e3-4d33-ab73-da18028f99f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:24:54.286960 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1092/2180] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:24:54 2022] DELETE /identity/v3/projects/76835c9b99cb4557b98b757d9d079a45 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:24:54.291902 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45f297-e1c1-4deb-9e34-bd4579c58af8 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:24:54.292435 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45f297-e1c1-4deb-9e34-bd4579c58af8 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:24:54.292792 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45f297-e1c1-4deb-9e34-bd4579c58af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:24:54.314163 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-aa45f297-e1c1-4deb-9e34-bd4579c58af8 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:24:54.315661 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-aa45f297-e1c1-4deb-9e34-bd4579c58af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:24:54.334012 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:24:54.379106 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1089/2181] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:24:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:24:54.386772 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48edf1-be80-44f0-a63d-f1ff6afd8d48 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:24:54.387004 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48edf1-be80-44f0-a63d-f1ff6afd8d48 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:24:54.387289 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48edf1-be80-44f0-a63d-f1ff6afd8d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:24:54.405736 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-aa48edf1-be80-44f0-a63d-f1ff6afd8d48 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:24:54.407002 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-aa48edf1-be80-44f0-a63d-f1ff6afd8d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:24:54.414963 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1093/2182] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:24:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:24:54.419104 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa45f297-e1c1-4deb-9e34-bd4579c58af8 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:24:54.429345 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa45f297-e1c1-4deb-9e34-bd4579c58af8 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:24:54.433778 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee1fe8-f684-471e-b40f-e6047ccb9d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:24:54.434453 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee1fe8-f684-471e-b40f-e6047ccb9d1d admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:24:54.434735 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee1fe8-f684-471e-b40f-e6047ccb9d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:24:54.435017 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee1fe8-f684-471e-b40f-e6047ccb9d1d admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:24:54.435740 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ee1fe8-f684-471e-b40f-e6047ccb9d1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:24:54.436079 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ee1fe8-f684-471e-b40f-e6047ccb9d1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:24:54.438316 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ee1fe8-f684-471e-b40f-e6047ccb9d1d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:24:54.449542 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1090/2183] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:24:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:24:54.453860 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa48edf1-be80-44f0-a63d-f1ff6afd8d48 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:24:54.463259 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa48edf1-be80-44f0-a63d-f1ff6afd8d48 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:24:54.467854 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589e1f0-204c-4db9-b71e-73110d3d55c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:24:54.469047 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589e1f0-204c-4db9-b71e-73110d3d55c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:24:54.469331 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589e1f0-204c-4db9-b71e-73110d3d55c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:24:54.469606 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589e1f0-204c-4db9-b71e-73110d3d55c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:24:54.470329 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7589e1f0-204c-4db9-b71e-73110d3d55c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:24:54.472314 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7589e1f0-204c-4db9-b71e-73110d3d55c8 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:24:54.501253 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1094/2184] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:24:54 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:24:54.502396 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee1fe8-f684-471e-b40f-e6047ccb9d1d admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:24:54.512352 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee1fe8-f684-471e-b40f-e6047ccb9d1d admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:24:54.570418 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d621795e-c4cf-4e71-b5ae-b39808fd054b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:24:54.571113 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621795e-c4cf-4e71-b5ae-b39808fd054b admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:24:54.571402 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621795e-c4cf-4e71-b5ae-b39808fd054b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:24:54.571685 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621795e-c4cf-4e71-b5ae-b39808fd054b admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:24:54.572426 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d621795e-c4cf-4e71-b5ae-b39808fd054b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:24:54.574691 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d621795e-c4cf-4e71-b5ae-b39808fd054b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:24:54.595659 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1091/2185] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:24:54 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:24:54.599788 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589e1f0-204c-4db9-b71e-73110d3d55c8 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:24:54.610668 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589e1f0-204c-4db9-b71e-73110d3d55c8 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:24:54.615323 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592af2d9-993e-425b-97be-3bd60ae4b3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:24:54.616006 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592af2d9-993e-425b-97be-3bd60ae4b3aa admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:24:54.616309 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592af2d9-993e-425b-97be-3bd60ae4b3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:24:54.616579 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592af2d9-993e-425b-97be-3bd60ae4b3aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:24:54.617308 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592af2d9-993e-425b-97be-3bd60ae4b3aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:24:54.618895 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592af2d9-993e-425b-97be-3bd60ae4b3aa admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:24:54.629378 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1095/2186] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:24:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:24:54.633176 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d621795e-c4cf-4e71-b5ae-b39808fd054b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:24:54.642823 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d621795e-c4cf-4e71-b5ae-b39808fd054b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:24:54.647255 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb88612-d244-43da-8f58-e56bc4ea80a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:24:54.647901 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb88612-d244-43da-8f58-e56bc4ea80a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:24:54.648214 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb88612-d244-43da-8f58-e56bc4ea80a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:24:54.648492 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb88612-d244-43da-8f58-e56bc4ea80a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:24:54.649220 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb88612-d244-43da-8f58-e56bc4ea80a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:24:54.650776 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb88612-d244-43da-8f58-e56bc4ea80a1 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:24:54.660796 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1092/2187] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:24:54 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:24:54.664593 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592af2d9-993e-425b-97be-3bd60ae4b3aa admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:24:54.674822 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592af2d9-993e-425b-97be-3bd60ae4b3aa admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:24:54.679421 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea748007-e295-4742-a91a-72d0270f17b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:24:54.680319 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea748007-e295-4742-a91a-72d0270f17b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:24:54.680602 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea748007-e295-4742-a91a-72d0270f17b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:24:54.680877 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea748007-e295-4742-a91a-72d0270f17b5 admin admin] PATH_INFO: `/v3/projects/50113e0e49444e76ba58b95f356544e7/users/188cbb44220d4b9ca3580eec17247233/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:24:54.694970 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea748007-e295-4742-a91a-72d0270f17b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50113e0e49444e76ba58b95f356544e7, user_id=188cbb44220d4b9ca3580eec17247233, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:24:54.697635 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea748007-e295-4742-a91a-72d0270f17b5 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:24:54.712345 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1096/2188] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:24:54 2022] PUT /identity/v3/projects/50113e0e49444e76ba58b95f356544e7/users/188cbb44220d4b9ca3580eec17247233/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:24:54.717475 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a5b0a-890a-45b0-be67-d788c477ac88 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:24:54.717766 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a5b0a-890a-45b0-be67-d788c477ac88 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:24:54.718048 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a5b0a-890a-45b0-be67-d788c477ac88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:24:54.736418 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-5a9a5b0a-890a-45b0-be67-d788c477ac88 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:24:54.737610 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5a9a5b0a-890a-45b0-be67-d788c477ac88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:24:54.795459 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1093/2189] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:24:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:24:54.805967 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea748007-e295-4742-a91a-72d0270f17b5 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:24:54.807650 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-ea748007-e295-4742-a91a-72d0270f17b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:24:54.829513 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:24:54.867362 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea748007-e295-4742-a91a-72d0270f17b5 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:24:54.870945 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5575edd8-b7b3-4070-849b-7f01787dd4fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:24:54.871614 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575edd8-b7b3-4070-849b-7f01787dd4fd service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:24:54.871897 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575edd8-b7b3-4070-849b-7f01787dd4fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:24:54.872206 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575edd8-b7b3-4070-849b-7f01787dd4fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:24:54.881329 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5575edd8-b7b3-4070-849b-7f01787dd4fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:24:54.882774 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5575edd8-b7b3-4070-849b-7f01787dd4fd service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:24:54.892731 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1097/2190] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:24:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 20:24:55.491358 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7397e8-ee5e-4b06-b74c-10a4633d8bf6 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:24:55.491678 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7397e8-ee5e-4b06-b74c-10a4633d8bf6 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:24:55.491984 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7397e8-ee5e-4b06-b74c-10a4633d8bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:24:55.519608 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ce7397e8-ee5e-4b06-b74c-10a4633d8bf6 None None] MFA Rules not processed for user `188cbb44220d4b9ca3580eec17247233`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:24:55.520887 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ce7397e8-ee5e-4b06-b74c-10a4633d8bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:24:55.538687 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:24:55.590721 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1094/2191] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:24:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:24:55.602007 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5575edd8-b7b3-4070-849b-7f01787dd4fd service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:24:55.603527 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-5575edd8-b7b3-4070-849b-7f01787dd4fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:24:55.675685 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5575edd8-b7b3-4070-849b-7f01787dd4fd service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:24:55.679479 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9ca198-4d2b-4b5a-8dbc-4241b30741a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:24:55.680159 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ca198-4d2b-4b5a-8dbc-4241b30741a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:24:55.680445 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ca198-4d2b-4b5a-8dbc-4241b30741a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:24:55.680889 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ca198-4d2b-4b5a-8dbc-4241b30741a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:24:55.693542 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9ca198-4d2b-4b5a-8dbc-4241b30741a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:24:55.693542 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9ca198-4d2b-4b5a-8dbc-4241b30741a5 service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:24:55.701250 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1098/2192] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:24:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:24:56.894565 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be79e4-6e80-4ca9-b37e-d3c027a206eb None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:24:56.895056 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be79e4-6e80-4ca9-b37e-d3c027a206eb None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:24:56.895173 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be79e4-6e80-4ca9-b37e-d3c027a206eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:24:56.912186 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-45be79e4-6e80-4ca9-b37e-d3c027a206eb None None] MFA Rules not processed for user `e41fb552c794495fa27a1ff74768b9d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:24:56.913437 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-45be79e4-6e80-4ca9-b37e-d3c027a206eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:24:56.967030 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1095/2193] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:24:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:24:58.163665 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66872ba3-1ab7-46f6-a467-1b864886aff7 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:24:58.164152 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66872ba3-1ab7-46f6-a467-1b864886aff7 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:24:58.164351 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66872ba3-1ab7-46f6-a467-1b864886aff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:24:58.180984 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-66872ba3-1ab7-46f6-a467-1b864886aff7 None None] MFA Rules not processed for user `188cbb44220d4b9ca3580eec17247233`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:24:58.182219 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-66872ba3-1ab7-46f6-a467-1b864886aff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:24:58.189710 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1099/2194] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:24:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:24:58.923051 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be79e4-6e80-4ca9-b37e-d3c027a206eb None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:24:58.934002 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be79e4-6e80-4ca9-b37e-d3c027a206eb None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:24:58.939164 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb196b7-70c3-4d71-85d0-bd67002a010f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:24:58.940214 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb196b7-70c3-4d71-85d0-bd67002a010f service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:24:58.940567 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb196b7-70c3-4d71-85d0-bd67002a010f service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:24:58.940909 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb196b7-70c3-4d71-85d0-bd67002a010f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:24:58.943165 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8eb196b7-70c3-4d71-85d0-bd67002a010f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:24:59.026755 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb196b7-70c3-4d71-85d0-bd67002a010f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:24:59.028344 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb196b7-70c3-4d71-85d0-bd67002a010f service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:24:59.042181 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1096/2195] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:24:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 20:25:08.176411 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=46 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:25:09.034743 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=74 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:25:24.185142 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa102a5-6075-40b8-9fb4-600e75b743a8 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:25:24.185615 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa102a5-6075-40b8-9fb4-600e75b743a8 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:25:24.185715 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa102a5-6075-40b8-9fb4-600e75b743a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:25:24.203437 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-faa102a5-6075-40b8-9fb4-600e75b743a8 None None] MFA Rules not processed for user `6aa799462c6a4339ab0ab3fc1601534d`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:25:24.204642 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-faa102a5-6075-40b8-9fb4-600e75b743a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:25:24.258971 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1100/2196] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:25:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:25:34.252553 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=25 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:25:34.989110 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb196b7-70c3-4d71-85d0-bd67002a010f service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:25:34.990562 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8eb196b7-70c3-4d71-85d0-bd67002a010f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:25:35.003902 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb196b7-70c3-4d71-85d0-bd67002a010f service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:25:35.008419 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70823f60-cfb9-4c96-af02-8a8de835820b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:25:35.009308 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70823f60-cfb9-4c96-af02-8a8de835820b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:25:35.009594 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70823f60-cfb9-4c96-af02-8a8de835820b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:25:35.009873 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70823f60-cfb9-4c96-af02-8a8de835820b admin admin] PATH_INFO: `/v3/users/aa4c918e9f8a4b75b6cf910346ecf85f` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:25:35.011069 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70823f60-cfb9-4c96-af02-8a8de835820b admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa4c918e9f8a4b75b6cf910346ecf85f)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:25:35.013022 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70823f60-cfb9-4c96-af02-8a8de835820b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:25:35.061297 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-70823f60-cfb9-4c96-af02-8a8de835820b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa4c918e9f8a4b75b6cf910346ecf85f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:25:35.061994 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-70823f60-cfb9-4c96-af02-8a8de835820b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa4c918e9f8a4b75b6cf910346ecf85f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:25:35.062627 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-70823f60-cfb9-4c96-af02-8a8de835820b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa4c918e9f8a4b75b6cf910346ecf85f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:25:35.074924 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-70823f60-cfb9-4c96-af02-8a8de835820b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa4c918e9f8a4b75b6cf910346ecf85f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:25:35.082766 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-70823f60-cfb9-4c96-af02-8a8de835820b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa4c918e9f8a4b75b6cf910346ecf85f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:25:35.096127 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1097/2197] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:25:34 2022] DELETE /identity/v3/users/aa4c918e9f8a4b75b6cf910346ecf85f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:25:35.101168 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552e753-0a21-41e4-9b10-a38c8b3af933 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:25:35.101529 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552e753-0a21-41e4-9b10-a38c8b3af933 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:25:35.101942 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552e753-0a21-41e4-9b10-a38c8b3af933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:25:35.121879 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-0552e753-0a21-41e4-9b10-a38c8b3af933 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:25:35.123113 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-0552e753-0a21-41e4-9b10-a38c8b3af933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:25:35.191574 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1101/2198] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:25:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:25:35.201138 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70823f60-cfb9-4c96-af02-8a8de835820b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:25:35.202625 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-70823f60-cfb9-4c96-af02-8a8de835820b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:25:35.264515 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70823f60-cfb9-4c96-af02-8a8de835820b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:25:35.268895 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d57581c-acbe-4a63-b516-7d140213c166 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:25:35.269561 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57581c-acbe-4a63-b516-7d140213c166 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:25:35.269955 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57581c-acbe-4a63-b516-7d140213c166 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:25:35.270122 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57581c-acbe-4a63-b516-7d140213c166 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:25:35.281799 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d57581c-acbe-4a63-b516-7d140213c166 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:25:35.283513 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d57581c-acbe-4a63-b516-7d140213c166 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:25:35.293815 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1098/2199] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:25:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:25:35.585681 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552e753-0a21-41e4-9b10-a38c8b3af933 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:25:35.587160 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-0552e753-0a21-41e4-9b10-a38c8b3af933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:25:35.599849 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552e753-0a21-41e4-9b10-a38c8b3af933 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:25:35.604796 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d21623-cff7-48da-aff1-5bcbc061eb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:25:35.605593 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d21623-cff7-48da-aff1-5bcbc061eb5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:25:35.605877 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d21623-cff7-48da-aff1-5bcbc061eb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:25:35.606156 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d21623-cff7-48da-aff1-5bcbc061eb5f admin admin] PATH_INFO: `/v3/projects/f001165888c644ef84087f3c666e3960` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:25:35.607371 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d21623-cff7-48da-aff1-5bcbc061eb5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f001165888c644ef84087f3c666e3960)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:25:35.610049 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d21623-cff7-48da-aff1-5bcbc061eb5f admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:25:35.676107 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-a7d21623-cff7-48da-aff1-5bcbc061eb5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f001165888c644ef84087f3c666e3960', 'request_id': 'req-a7d21623-cff7-48da-aff1-5bcbc061eb5f'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:25:35.681536 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-a7d21623-cff7-48da-aff1-5bcbc061eb5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f001165888c644ef84087f3c666e3960', 'request_id': 'req-a7d21623-cff7-48da-aff1-5bcbc061eb5f'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:25:35.691477 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-a7d21623-cff7-48da-aff1-5bcbc061eb5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f001165888c644ef84087f3c666e3960', 'request_id': 'req-a7d21623-cff7-48da-aff1-5bcbc061eb5f'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:25:35.704523 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-a7d21623-cff7-48da-aff1-5bcbc061eb5f admin admin] The token cache is being invalidate because project f001165888c644ef84087f3c666e3960 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:25:35.704886 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-a7d21623-cff7-48da-aff1-5bcbc061eb5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:25:35.705747 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-a7d21623-cff7-48da-aff1-5bcbc061eb5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:25:35.707844 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1102/2200] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:25:35 2022] DELETE /identity/v3/projects/f001165888c644ef84087f3c666e3960 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:25:44.687462 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c8a8a-0310-4c83-aff0-f461bc4ecaf9 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:25:44.688009 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c8a8a-0310-4c83-aff0-f461bc4ecaf9 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:25:44.688114 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c8a8a-0310-4c83-aff0-f461bc4ecaf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:25:44.707184 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-cf3c8a8a-0310-4c83-aff0-f461bc4ecaf9 None None] MFA Rules not processed for user `188cbb44220d4b9ca3580eec17247233`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:25:44.708424 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-cf3c8a8a-0310-4c83-aff0-f461bc4ecaf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:25:44.762328 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1099/2201] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:25:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:25:45.700534 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:25:54.755839 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=80,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:26:30.243443 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d21623-cff7-48da-aff1-5bcbc061eb5f admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:26:30.244924 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-a7d21623-cff7-48da-aff1-5bcbc061eb5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:26:30.303095 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d21623-cff7-48da-aff1-5bcbc061eb5f admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:26:30.306667 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e766f-3dee-420c-aeed-bd3a02b039eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:26:30.307312 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e766f-3dee-420c-aeed-bd3a02b039eb service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:26:30.307600 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e766f-3dee-420c-aeed-bd3a02b039eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:26:30.307882 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e766f-3dee-420c-aeed-bd3a02b039eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:26:30.310016 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-b81e766f-3dee-420c-aeed-bd3a02b039eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:26:30.368501 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81e766f-3dee-420c-aeed-bd3a02b039eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:26:30.369933 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81e766f-3dee-420c-aeed-bd3a02b039eb service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:26:30.379396 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1103/2202] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:26:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:26:32.511900 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c8a8a-0310-4c83-aff0-f461bc4ecaf9 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:26:32.521306 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c8a8a-0310-4c83-aff0-f461bc4ecaf9 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:26:32.524764 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2fee27-0ad9-4cc6-97c2-b3d3852e54a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:26:32.525399 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fee27-0ad9-4cc6-97c2-b3d3852e54a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:26:32.525683 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fee27-0ad9-4cc6-97c2-b3d3852e54a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:26:32.525963 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fee27-0ad9-4cc6-97c2-b3d3852e54a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:26:32.527760 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9b2fee27-0ad9-4cc6-97c2-b3d3852e54a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:26:32.585107 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2fee27-0ad9-4cc6-97c2-b3d3852e54a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:26:32.586467 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2fee27-0ad9-4cc6-97c2-b3d3852e54a0 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:26:32.595957 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1100/2203] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:26:32 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:26:35.446271 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e766f-3dee-420c-aeed-bd3a02b039eb service cinder] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:26:35.455718 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e766f-3dee-420c-aeed-bd3a02b039eb service cinder] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:26:35.459271 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8488787d-acd1-4ce0-a37a-e2e00739ce32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:26:35.459958 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488787d-acd1-4ce0-a37a-e2e00739ce32 service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:26:35.460248 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488787d-acd1-4ce0-a37a-e2e00739ce32 service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:26:35.460527 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488787d-acd1-4ce0-a37a-e2e00739ce32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:26:35.462262 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-8488787d-acd1-4ce0-a37a-e2e00739ce32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:26:35.519975 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8488787d-acd1-4ce0-a37a-e2e00739ce32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:26:35.521395 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8488787d-acd1-4ce0-a37a-e2e00739ce32 service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:26:35.530244 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1104/2204] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:26:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:26:42.591352 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=28 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:26:45.034022 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2fee27-0ad9-4cc6-97c2-b3d3852e54a0 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:26:45.035444 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9b2fee27-0ad9-4cc6-97c2-b3d3852e54a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:26:45.095410 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2fee27-0ad9-4cc6-97c2-b3d3852e54a0 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:26:45.099008 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb927408-4504-4194-af9d-e4439f47aefb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:26:45.099662 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb927408-4504-4194-af9d-e4439f47aefb service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:26:45.099988 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb927408-4504-4194-af9d-e4439f47aefb service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:26:45.100350 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb927408-4504-4194-af9d-e4439f47aefb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:26:45.102168 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-eb927408-4504-4194-af9d-e4439f47aefb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:26:45.192574 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb927408-4504-4194-af9d-e4439f47aefb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:26:45.194007 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb927408-4504-4194-af9d-e4439f47aefb service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:26:45.214140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1101/2205] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:26:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:26:45.526168 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=76 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:26:46.397549 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8488787d-acd1-4ce0-a37a-e2e00739ce32 service cinder] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:26:46.406790 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8488787d-acd1-4ce0-a37a-e2e00739ce32 service cinder] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:26:46.410430 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150e8fa4-7936-4a5f-b7b1-c73ffc95c961 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:26:46.411074 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e8fa4-7936-4a5f-b7b1-c73ffc95c961 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:26:46.411360 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e8fa4-7936-4a5f-b7b1-c73ffc95c961 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:26:46.411643 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e8fa4-7936-4a5f-b7b1-c73ffc95c961 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:26:46.413438 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-150e8fa4-7936-4a5f-b7b1-c73ffc95c961 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:26:46.427024 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150e8fa4-7936-4a5f-b7b1-c73ffc95c961 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:26:46.428489 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150e8fa4-7936-4a5f-b7b1-c73ffc95c961 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:26:46.439885 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1105/2206] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:26:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:26:53.791575 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb927408-4504-4194-af9d-e4439f47aefb service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:26:53.798596 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150e8fa4-7936-4a5f-b7b1-c73ffc95c961 service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:26:53.801003 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-150e8fa4-7936-4a5f-b7b1-c73ffc95c961 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:26:53.802795 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb927408-4504-4194-af9d-e4439f47aefb service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:26:53.807364 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f6974-9270-4584-8fed-2bcd97946deb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:26:53.808044 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f6974-9270-4584-8fed-2bcd97946deb service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:26:53.808328 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f6974-9270-4584-8fed-2bcd97946deb service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:26:53.808607 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f6974-9270-4584-8fed-2bcd97946deb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:26:53.810410 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2c1f6974-9270-4584-8fed-2bcd97946deb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:26:53.813717 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150e8fa4-7936-4a5f-b7b1-c73ffc95c961 service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:26:53.817592 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b49698-fb85-4571-98d2-b2d7d7491886 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:26:53.818316 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b49698-fb85-4571-98d2-b2d7d7491886 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:26:53.818674 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b49698-fb85-4571-98d2-b2d7d7491886 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:26:53.819023 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b49698-fb85-4571-98d2-b2d7d7491886 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:26:53.822072 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f6974-9270-4584-8fed-2bcd97946deb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:26:53.824353 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f6974-9270-4584-8fed-2bcd97946deb service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:26:53.826954 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b49698-fb85-4571-98d2-b2d7d7491886 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:26:53.828530 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b49698-fb85-4571-98d2-b2d7d7491886 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:26:53.833755 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1102/2207] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:26:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:26:53.840435 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1106/2208] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:26:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 20:26:56.431379 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24670f2d-56a2-4346-9b99-2d7ede328c99 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:26:56.431879 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24670f2d-56a2-4346-9b99-2d7ede328c99 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:26:56.432021 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24670f2d-56a2-4346-9b99-2d7ede328c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:26:56.449193 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-24670f2d-56a2-4346-9b99-2d7ede328c99 None None] MFA Rules not processed for user `fc95af68a6d640699f788d5438cae607`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:26:56.450387 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-24670f2d-56a2-4346-9b99-2d7ede328c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:26:56.457886 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1103/2209] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:26:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:26:56.754576 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b49698-fb85-4571-98d2-b2d7d7491886 service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:26:56.763262 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b49698-fb85-4571-98d2-b2d7d7491886 service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:26:56.767527 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6839e41c-82f8-46c6-bfe4-b804038744df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:26:56.768203 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839e41c-82f8-46c6-bfe4-b804038744df service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:26:56.768488 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839e41c-82f8-46c6-bfe4-b804038744df service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:26:56.768776 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839e41c-82f8-46c6-bfe4-b804038744df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:26:56.770527 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-6839e41c-82f8-46c6-bfe4-b804038744df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:26:56.780190 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6839e41c-82f8-46c6-bfe4-b804038744df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:26:56.782272 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6839e41c-82f8-46c6-bfe4-b804038744df service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:26:56.790407 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1107/2210] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:26:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:26:57.094484 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24670f2d-56a2-4346-9b99-2d7ede328c99 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:26:57.095998 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-24670f2d-56a2-4346-9b99-2d7ede328c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:26:57.152101 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:26:57.166909 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24670f2d-56a2-4346-9b99-2d7ede328c99 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:26:57.171800 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5cfdc-e445-4e7e-afe7-e5a37d919076 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59294bff27c4b3f8aaeeab48ed35a0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:26:57.172510 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5cfdc-e445-4e7e-afe7-e5a37d919076 service placement] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:26:57.172794 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5cfdc-e445-4e7e-afe7-e5a37d919076 service placement] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:26:57.173073 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5cfdc-e445-4e7e-afe7-e5a37d919076 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:26:57.174828 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-00f5cfdc-e445-4e7e-afe7-e5a37d919076 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:26:57.185720 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f5cfdc-e445-4e7e-afe7-e5a37d919076 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:26:57.187303 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f5cfdc-e445-4e7e-afe7-e5a37d919076 service placement] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:26:57.197348 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1104/2211] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:26:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:27:06.786916 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=18 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:27:07.193360 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=7 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:27:11.361146 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6839e41c-82f8-46c6-bfe4-b804038744df service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:27:11.362568 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-6839e41c-82f8-46c6-bfe4-b804038744df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:27:11.379133 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6839e41c-82f8-46c6-bfe4-b804038744df service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:27:11.385220 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e1b97-2a68-4498-a67b-97763316175f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3918fe05c8634bc39f3e295374701465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:27:11.385899 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e1b97-2a68-4498-a67b-97763316175f service nova] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:27:11.386313 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e1b97-2a68-4498-a67b-97763316175f service nova] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:27:11.387092 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e1b97-2a68-4498-a67b-97763316175f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:27:11.388478 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-818e1b97-2a68-4498-a67b-97763316175f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:27:11.401803 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818e1b97-2a68-4498-a67b-97763316175f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:27:11.403392 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818e1b97-2a68-4498-a67b-97763316175f service nova] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:27:11.414200 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1108/2212] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:27:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:27:21.410048 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=6 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:27:33.017571 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5cfdc-e445-4e7e-afe7-e5a37d919076 service placement] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:27:33.019185 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-00f5cfdc-e445-4e7e-afe7-e5a37d919076 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:27:33.034497 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5cfdc-e445-4e7e-afe7-e5a37d919076 service placement] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:27:33.039898 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341935d6-2128-40f5-927d-5e17502264eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3918fe05c8634bc39f3e295374701465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:27:33.040573 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341935d6-2128-40f5-927d-5e17502264eb service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:27:33.040864 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341935d6-2128-40f5-927d-5e17502264eb service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:27:33.041149 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341935d6-2128-40f5-927d-5e17502264eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:27:33.042859 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-341935d6-2128-40f5-927d-5e17502264eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:27:33.100543 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341935d6-2128-40f5-927d-5e17502264eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:27:33.102116 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341935d6-2128-40f5-927d-5e17502264eb service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:27:33.111706 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1105/2213] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:27:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:27:43.106919 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=28 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:27:59.885960 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e1b97-2a68-4498-a67b-97763316175f service nova] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:27:59.887350 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-818e1b97-2a68-4498-a67b-97763316175f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:27:59.898495 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e1b97-2a68-4498-a67b-97763316175f service nova] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:27:59.902039 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1743f1-b152-4449-bc02-b88451447d30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:27:59.902680 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1743f1-b152-4449-bc02-b88451447d30 service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:27:59.902965 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1743f1-b152-4449-bc02-b88451447d30 service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:27:59.903237 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1743f1-b152-4449-bc02-b88451447d30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:27:59.904957 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-4f1743f1-b152-4449-bc02-b88451447d30 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:27:59.962884 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1743f1-b152-4449-bc02-b88451447d30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:27:59.964381 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1743f1-b152-4449-bc02-b88451447d30 service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:27:59.973743 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1109/2214] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:27:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:28:09.969670 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=28 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:28:43.238600 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341935d6-2128-40f5-927d-5e17502264eb service nova] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:28:43.249973 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341935d6-2128-40f5-927d-5e17502264eb service nova] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:28:43.255588 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef0ea0-1e8c-4032-b412-df04ce62e494 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3918fe05c8634bc39f3e295374701465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:28:43.256303 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef0ea0-1e8c-4032-b412-df04ce62e494 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:28:43.256639 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef0ea0-1e8c-4032-b412-df04ce62e494 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:28:43.256931 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef0ea0-1e8c-4032-b412-df04ce62e494 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:28:43.258716 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c9ef0ea0-1e8c-4032-b412-df04ce62e494 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:28:43.317824 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef0ea0-1e8c-4032-b412-df04ce62e494 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:28:43.319397 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef0ea0-1e8c-4032-b412-df04ce62e494 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:28:43.329056 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1106/2215] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:28:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:28:45.132360 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1743f1-b152-4449-bc02-b88451447d30 service cinder] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:28:45.149140 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1743f1-b152-4449-bc02-b88451447d30 service cinder] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:28:45.159326 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f221ab88-d88a-44dd-8c98-3237aec9683d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3918fe05c8634bc39f3e295374701465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:28:45.160356 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f221ab88-d88a-44dd-8c98-3237aec9683d service nova] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:28:45.160856 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f221ab88-d88a-44dd-8c98-3237aec9683d service nova] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:28:45.161451 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f221ab88-d88a-44dd-8c98-3237aec9683d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:28:45.163697 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-f221ab88-d88a-44dd-8c98-3237aec9683d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:28:45.178595 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f221ab88-d88a-44dd-8c98-3237aec9683d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:28:45.180332 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f221ab88-d88a-44dd-8c98-3237aec9683d service nova] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:28:45.204275 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1110/2216] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:28:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:28:53.324142 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=28 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:28:55.197652 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=6 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:29:55.582431 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef0ea0-1e8c-4032-b412-df04ce62e494 service nova] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:29:55.591551 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef0ea0-1e8c-4032-b412-df04ce62e494 service nova] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:29:55.595016 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ebe42-795f-49a5-a1d4-e32d642c9d54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:29:55.595647 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ebe42-795f-49a5-a1d4-e32d642c9d54 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:29:55.595946 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ebe42-795f-49a5-a1d4-e32d642c9d54 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:29:55.596239 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ebe42-795f-49a5-a1d4-e32d642c9d54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:29:55.598002 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-357ebe42-795f-49a5-a1d4-e32d642c9d54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:29:55.608489 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ebe42-795f-49a5-a1d4-e32d642c9d54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:29:55.609892 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ebe42-795f-49a5-a1d4-e32d642c9d54 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:29:55.618611 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1107/2217] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:29:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:30:05.614710 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=6 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:30:32.755460 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f221ab88-d88a-44dd-8c98-3237aec9683d service nova] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:30:32.767199 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f221ab88-d88a-44dd-8c98-3237aec9683d service nova] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:30:32.773301 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d904fe4-45de-4d5c-9b37-2edef4167678 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59294bff27c4b3f8aaeeab48ed35a0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:30:32.773957 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d904fe4-45de-4d5c-9b37-2edef4167678 service placement] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:30:32.774249 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d904fe4-45de-4d5c-9b37-2edef4167678 service placement] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:30:32.774528 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d904fe4-45de-4d5c-9b37-2edef4167678 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:30:32.776464 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-5d904fe4-45de-4d5c-9b37-2edef4167678 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:30:32.789539 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d904fe4-45de-4d5c-9b37-2edef4167678 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:30:32.791165 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d904fe4-45de-4d5c-9b37-2edef4167678 service placement] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:30:32.801577 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1111/2218] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:30:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:30:42.797041 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=6 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:31:31.406819 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ebe42-795f-49a5-a1d4-e32d642c9d54 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:31:31.415412 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ebe42-795f-49a5-a1d4-e32d642c9d54 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:31:31.418887 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd31cbb-343a-46ed-a3ea-9aa75b0e9463 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:31:31.419519 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd31cbb-343a-46ed-a3ea-9aa75b0e9463 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:31:31.419800 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd31cbb-343a-46ed-a3ea-9aa75b0e9463 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:31:31.420113 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd31cbb-343a-46ed-a3ea-9aa75b0e9463 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:31:31.428859 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd31cbb-343a-46ed-a3ea-9aa75b0e9463 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:31:31.430261 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd31cbb-343a-46ed-a3ea-9aa75b0e9463 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:31:31.457531 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1108/2219] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:31:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:31:32.567873 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d904fe4-45de-4d5c-9b37-2edef4167678 service placement] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:31:32.577026 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d904fe4-45de-4d5c-9b37-2edef4167678 service placement] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:31:32.580560 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c10c3-1784-4f54-a034-690e8de22e19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:31:32.581222 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c10c3-1784-4f54-a034-690e8de22e19 service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:31:32.582171 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c10c3-1784-4f54-a034-690e8de22e19 service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:31:32.582448 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c10c3-1784-4f54-a034-690e8de22e19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:31:32.591305 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431c10c3-1784-4f54-a034-690e8de22e19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:31:32.592753 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431c10c3-1784-4f54-a034-690e8de22e19 service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:31:32.619587 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1112/2220] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:31:32 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:31:36.303009 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd31cbb-343a-46ed-a3ea-9aa75b0e9463 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:31:36.315626 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd31cbb-343a-46ed-a3ea-9aa75b0e9463 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:31:36.321677 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740effe3-3869-4d61-a16f-9eb420138ba2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3918fe05c8634bc39f3e295374701465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:31:36.322320 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740effe3-3869-4d61-a16f-9eb420138ba2 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:31:36.322864 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740effe3-3869-4d61-a16f-9eb420138ba2 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:31:36.323147 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740effe3-3869-4d61-a16f-9eb420138ba2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:31:36.331515 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740effe3-3869-4d61-a16f-9eb420138ba2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:31:36.333131 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740effe3-3869-4d61-a16f-9eb420138ba2 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:31:36.361031 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1109/2221] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:31:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:31:42.617309 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=13 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:31:46.358239 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=26 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:31:54.653891 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c10c3-1784-4f54-a034-690e8de22e19 service cinder] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:31:54.662461 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c10c3-1784-4f54-a034-690e8de22e19 service cinder] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:31:54.666111 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de92f3b6-6630-4563-a39f-d894d47bb1b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:31:54.666750 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92f3b6-6630-4563-a39f-d894d47bb1b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:31:54.667034 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92f3b6-6630-4563-a39f-d894d47bb1b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:31:54.667310 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92f3b6-6630-4563-a39f-d894d47bb1b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:31:54.677222 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de92f3b6-6630-4563-a39f-d894d47bb1b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:31:54.678633 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de92f3b6-6630-4563-a39f-d894d47bb1b8 service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:31:54.689908 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1113/2222] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:31:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:32:01.062571 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740effe3-3869-4d61-a16f-9eb420138ba2 service nova] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:32:01.071763 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740effe3-3869-4d61-a16f-9eb420138ba2 service nova] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:32:01.075514 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2973c-08b3-4d60-a078-fe555b58d4b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:32:01.076179 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2973c-08b3-4d60-a078-fe555b58d4b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:32:01.076465 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2973c-08b3-4d60-a078-fe555b58d4b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:32:01.076743 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2973c-08b3-4d60-a078-fe555b58d4b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:32:01.087577 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad2973c-08b3-4d60-a078-fe555b58d4b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:32:01.089234 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad2973c-08b3-4d60-a078-fe555b58d4b5 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:32:01.102922 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1110/2223] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:32:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:32:04.685149 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=6 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:32:05.426843 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d03271-9b62-44d4-8715-9d62680377b3 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:32:05.427139 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d03271-9b62-44d4-8715-9d62680377b3 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:32:05.427421 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d03271-9b62-44d4-8715-9d62680377b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:32:05.467225 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-28d03271-9b62-44d4-8715-9d62680377b3 None None] MFA Rules not processed for user `4f3b5970d9534441a2d208633b2e9942`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:32:05.468471 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-28d03271-9b62-44d4-8715-9d62680377b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:32:05.475308 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1114/2224] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:32:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 20:32:05.774370 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2973c-08b3-4d60-a078-fe555b58d4b5 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:32:05.782841 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2973c-08b3-4d60-a078-fe555b58d4b5 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:32:05.786470 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102752e6-5943-4395-96f7-1d98a1cee6b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:32:05.787109 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102752e6-5943-4395-96f7-1d98a1cee6b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:32:05.787395 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102752e6-5943-4395-96f7-1d98a1cee6b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:32:05.787676 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102752e6-5943-4395-96f7-1d98a1cee6b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:32:05.795934 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102752e6-5943-4395-96f7-1d98a1cee6b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:32:05.797366 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102752e6-5943-4395-96f7-1d98a1cee6b7 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:32:05.805726 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1111/2225] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:32:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 20:32:06.408494 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d03271-9b62-44d4-8715-9d62680377b3 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:32:06.412937 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-28d03271-9b62-44d4-8715-9d62680377b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:32:06.428207 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d03271-9b62-44d4-8715-9d62680377b3 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:32:06.434031 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02bc62a-cfba-49b9-8c5f-9be562664688 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59294bff27c4b3f8aaeeab48ed35a0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:32:06.434691 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02bc62a-cfba-49b9-8c5f-9be562664688 service placement] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:32:06.435019 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02bc62a-cfba-49b9-8c5f-9be562664688 service placement] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:32:06.435263 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02bc62a-cfba-49b9-8c5f-9be562664688 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:32:06.447076 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02bc62a-cfba-49b9-8c5f-9be562664688 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:32:06.448944 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02bc62a-cfba-49b9-8c5f-9be562664688 service placement] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:32:06.459074 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1115/2226] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:32:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:32:08.159163 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102752e6-5943-4395-96f7-1d98a1cee6b7 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:32:08.168384 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102752e6-5943-4395-96f7-1d98a1cee6b7 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:32:08.172152 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fada8a-a4d7-4a70-8ddb-e88b42b1a4dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:32:08.172808 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fada8a-a4d7-4a70-8ddb-e88b42b1a4dd service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:32:08.173097 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fada8a-a4d7-4a70-8ddb-e88b42b1a4dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:32:08.173382 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fada8a-a4d7-4a70-8ddb-e88b42b1a4dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:32:08.182261 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fada8a-a4d7-4a70-8ddb-e88b42b1a4dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:32:08.183707 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fada8a-a4d7-4a70-8ddb-e88b42b1a4dd service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:32:08.192827 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1112/2227] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:32:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:32:13.391993 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02bc62a-cfba-49b9-8c5f-9be562664688 service placement] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:32:13.406712 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02bc62a-cfba-49b9-8c5f-9be562664688 service placement] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:32:13.413759 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b45653-e524-4495-8eee-e0f7ecf00471 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3918fe05c8634bc39f3e295374701465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:32:13.414724 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b45653-e524-4495-8eee-e0f7ecf00471 service nova] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:32:13.415262 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b45653-e524-4495-8eee-e0f7ecf00471 service nova] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:32:13.415788 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b45653-e524-4495-8eee-e0f7ecf00471 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:32:13.433858 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b45653-e524-4495-8eee-e0f7ecf00471 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:32:13.435839 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b45653-e524-4495-8eee-e0f7ecf00471 service nova] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:32:13.452950 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1116/2228] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:32:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:32:15.751222 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fada8a-a4d7-4a70-8ddb-e88b42b1a4dd service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:32:15.772427 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fada8a-a4d7-4a70-8ddb-e88b42b1a4dd service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:32:15.786677 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12e4e8-a7cc-4cb8-afe6-9c0875f6e710 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3918fe05c8634bc39f3e295374701465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:32:15.787846 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12e4e8-a7cc-4cb8-afe6-9c0875f6e710 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:32:15.788566 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12e4e8-a7cc-4cb8-afe6-9c0875f6e710 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:32:15.789681 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12e4e8-a7cc-4cb8-afe6-9c0875f6e710 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:32:15.792016 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6b12e4e8-a7cc-4cb8-afe6-9c0875f6e710 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:32:15.809215 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b12e4e8-a7cc-4cb8-afe6-9c0875f6e710 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:32:15.811251 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b12e4e8-a7cc-4cb8-afe6-9c0875f6e710 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:32:15.824820 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1113/2229] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:32:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 20:32:16.680960 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea532263-a4ac-49c7-95d5-cc9a4c9a08e5 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:32:16.681394 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea532263-a4ac-49c7-95d5-cc9a4c9a08e5 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:32:16.681523 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea532263-a4ac-49c7-95d5-cc9a4c9a08e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:32:16.729547 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-ea532263-a4ac-49c7-95d5-cc9a4c9a08e5 None None] MFA Rules not processed for user `4080825b9e154e808a9418fa8d6db987`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:32:16.730750 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-ea532263-a4ac-49c7-95d5-cc9a4c9a08e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:32:16.737725 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1117/2230] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:32:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:32:17.329880 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12e4e8-a7cc-4cb8-afe6-9c0875f6e710 service nova] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:32:17.345510 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12e4e8-a7cc-4cb8-afe6-9c0875f6e710 service nova] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:32:17.351021 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7be8d0-709d-4e89-8ba6-648d44f0e4aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:32:17.351688 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7be8d0-709d-4e89-8ba6-648d44f0e4aa service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:32:17.352036 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7be8d0-709d-4e89-8ba6-648d44f0e4aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:32:17.352323 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7be8d0-709d-4e89-8ba6-648d44f0e4aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:32:17.354328 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-bc7be8d0-709d-4e89-8ba6-648d44f0e4aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:32:17.365490 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7be8d0-709d-4e89-8ba6-648d44f0e4aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:32:17.366943 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7be8d0-709d-4e89-8ba6-648d44f0e4aa service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:32:17.376577 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1114/2231] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:32:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:32:26.721227 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=34 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:32:27.372568 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=30 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:32:32.658618 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea532263-a4ac-49c7-95d5-cc9a4c9a08e5 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:32:32.668150 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea532263-a4ac-49c7-95d5-cc9a4c9a08e5 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:32:32.671643 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe28a4d-9bf7-4fe0-8553-386eb2e48d8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:32:32.672322 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe28a4d-9bf7-4fe0-8553-386eb2e48d8d service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:32:32.672613 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe28a4d-9bf7-4fe0-8553-386eb2e48d8d service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:32:32.672901 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe28a4d-9bf7-4fe0-8553-386eb2e48d8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:32:32.681248 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe28a4d-9bf7-4fe0-8553-386eb2e48d8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:32:32.682669 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe28a4d-9bf7-4fe0-8553-386eb2e48d8d service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:32:32.712129 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1118/2232] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:32:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:32:42.707967 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=13 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:33:00.121650 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7be8d0-709d-4e89-8ba6-648d44f0e4aa service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:33:00.131541 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7be8d0-709d-4e89-8ba6-648d44f0e4aa service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:33:00.135181 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ab700a-180f-4e5e-bf61-326683a9d0cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:33:00.135830 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ab700a-180f-4e5e-bf61-326683a9d0cc service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:33:00.136152 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ab700a-180f-4e5e-bf61-326683a9d0cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:33:00.136558 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ab700a-180f-4e5e-bf61-326683a9d0cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:33:00.145649 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ab700a-180f-4e5e-bf61-326683a9d0cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:33:00.147092 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ab700a-180f-4e5e-bf61-326683a9d0cc service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:33:00.173901 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1115/2233] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:33:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:33:02.807108 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe28a4d-9bf7-4fe0-8553-386eb2e48d8d service cinder] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:33:02.816951 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe28a4d-9bf7-4fe0-8553-386eb2e48d8d service cinder] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:33:02.820480 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea406ce-cafb-4c66-96e3-e0097c6d6e82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:33:02.821120 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea406ce-cafb-4c66-96e3-e0097c6d6e82 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:33:02.821408 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea406ce-cafb-4c66-96e3-e0097c6d6e82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:33:02.821700 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea406ce-cafb-4c66-96e3-e0097c6d6e82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:33:02.823721 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-aea406ce-cafb-4c66-96e3-e0097c6d6e82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:33:02.886090 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea406ce-cafb-4c66-96e3-e0097c6d6e82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:33:02.887525 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea406ce-cafb-4c66-96e3-e0097c6d6e82 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:33:02.897090 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1119/2234] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:33:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 20:33:03.338425 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ab700a-180f-4e5e-bf61-326683a9d0cc service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:33:03.350556 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ab700a-180f-4e5e-bf61-326683a9d0cc service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:33:03.355770 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54faad-bfb7-480c-b631-914e75cfc753 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59294bff27c4b3f8aaeeab48ed35a0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:33:03.356521 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54faad-bfb7-480c-b631-914e75cfc753 service placement] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:33:03.356813 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54faad-bfb7-480c-b631-914e75cfc753 service placement] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:33:03.357093 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54faad-bfb7-480c-b631-914e75cfc753 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:33:03.358907 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9c54faad-bfb7-480c-b631-914e75cfc753 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:33:03.371875 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c54faad-bfb7-480c-b631-914e75cfc753 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:33:03.373490 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c54faad-bfb7-480c-b631-914e75cfc753 service placement] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:33:03.383866 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1116/2235] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:33:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:33:03.413955 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea406ce-cafb-4c66-96e3-e0097c6d6e82 service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:33:03.415715 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-aea406ce-cafb-4c66-96e3-e0097c6d6e82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:33:03.428790 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea406ce-cafb-4c66-96e3-e0097c6d6e82 service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:33:03.433557 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d6d2e3-8e8f-4b86-a149-6345d3721a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:33:03.434436 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d6d2e3-8e8f-4b86-a149-6345d3721a38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:33:03.434726 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d6d2e3-8e8f-4b86-a149-6345d3721a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:33:03.435011 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d6d2e3-8e8f-4b86-a149-6345d3721a38 admin admin] PATH_INFO: `/v3/users/188cbb44220d4b9ca3580eec17247233` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:33:03.436234 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d6d2e3-8e8f-4b86-a149-6345d3721a38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=188cbb44220d4b9ca3580eec17247233)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:33:03.438155 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d6d2e3-8e8f-4b86-a149-6345d3721a38 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:33:03.483536 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-68d6d2e3-8e8f-4b86-a149-6345d3721a38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '188cbb44220d4b9ca3580eec17247233'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:33:03.484218 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-68d6d2e3-8e8f-4b86-a149-6345d3721a38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '188cbb44220d4b9ca3580eec17247233'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:33:03.492078 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-68d6d2e3-8e8f-4b86-a149-6345d3721a38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '188cbb44220d4b9ca3580eec17247233'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:33:03.503943 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-68d6d2e3-8e8f-4b86-a149-6345d3721a38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '188cbb44220d4b9ca3580eec17247233'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:33:03.504594 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-68d6d2e3-8e8f-4b86-a149-6345d3721a38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '188cbb44220d4b9ca3580eec17247233'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:33:03.516661 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1120/2236] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:33:03 2022] DELETE /identity/v3/users/188cbb44220d4b9ca3580eec17247233 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:33:03.707040 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54faad-bfb7-480c-b631-914e75cfc753 service placement] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:33:03.721622 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54faad-bfb7-480c-b631-914e75cfc753 service placement] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:33:03.785412 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e137e7-8ffd-4430-862f-2648af6baee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:33:03.786310 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e137e7-8ffd-4430-862f-2648af6baee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:33:03.786592 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e137e7-8ffd-4430-862f-2648af6baee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:33:03.786870 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e137e7-8ffd-4430-862f-2648af6baee6 admin admin] PATH_INFO: `/v3/projects/50113e0e49444e76ba58b95f356544e7` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:33:03.788093 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e137e7-8ffd-4430-862f-2648af6baee6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50113e0e49444e76ba58b95f356544e7)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:33:03.790549 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e137e7-8ffd-4430-862f-2648af6baee6 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:33:03.838268 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-27e137e7-8ffd-4430-862f-2648af6baee6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50113e0e49444e76ba58b95f356544e7', 'request_id': 'req-27e137e7-8ffd-4430-862f-2648af6baee6'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:33:03.846272 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-27e137e7-8ffd-4430-862f-2648af6baee6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50113e0e49444e76ba58b95f356544e7', 'request_id': 'req-27e137e7-8ffd-4430-862f-2648af6baee6'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:33:03.852120 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-27e137e7-8ffd-4430-862f-2648af6baee6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50113e0e49444e76ba58b95f356544e7', 'request_id': 'req-27e137e7-8ffd-4430-862f-2648af6baee6'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:33:03.863247 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-27e137e7-8ffd-4430-862f-2648af6baee6 admin admin] The token cache is being invalidate because project 50113e0e49444e76ba58b95f356544e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:33:03.863564 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-27e137e7-8ffd-4430-862f-2648af6baee6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:33:03.864243 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-27e137e7-8ffd-4430-862f-2648af6baee6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:33:03.865791 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1117/2237] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:33:03 2022] DELETE /identity/v3/projects/50113e0e49444e76ba58b95f356544e7 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:33:13.513142 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=59,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:33:13.860207 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=70,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:33:43.192188 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d6d2e3-8e8f-4b86-a149-6345d3721a38 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:33:43.194240 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-68d6d2e3-8e8f-4b86-a149-6345d3721a38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:33:43.268225 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d6d2e3-8e8f-4b86-a149-6345d3721a38 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:33:43.329683 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a489e-de0e-4c1c-b310-7b69bc6b7d40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3918fe05c8634bc39f3e295374701465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:33:43.330343 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a489e-de0e-4c1c-b310-7b69bc6b7d40 service nova] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:33:43.330631 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a489e-de0e-4c1c-b310-7b69bc6b7d40 service nova] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:33:43.330913 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a489e-de0e-4c1c-b310-7b69bc6b7d40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:33:43.332774 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-524a489e-de0e-4c1c-b310-7b69bc6b7d40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:33:43.412642 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524a489e-de0e-4c1c-b310-7b69bc6b7d40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:33:43.414240 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524a489e-de0e-4c1c-b310-7b69bc6b7d40 service nova] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:33:43.432696 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1121/2238] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:33:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:33:53.430116 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=97 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:35:38.759015 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e137e7-8ffd-4430-862f-2648af6baee6 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:35:38.760442 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-27e137e7-8ffd-4430-862f-2648af6baee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:35:38.897673 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e137e7-8ffd-4430-862f-2648af6baee6 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:35:38.902768 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eeaf77-3120-4d9a-a442-065b9462dc51 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59294bff27c4b3f8aaeeab48ed35a0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:35:38.903417 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eeaf77-3120-4d9a-a442-065b9462dc51 service placement] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:35:38.903711 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eeaf77-3120-4d9a-a442-065b9462dc51 service placement] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:35:38.904022 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eeaf77-3120-4d9a-a442-065b9462dc51 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:35:38.905802 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a4eeaf77-3120-4d9a-a442-065b9462dc51 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:35:38.917160 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eeaf77-3120-4d9a-a442-065b9462dc51 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:35:38.918732 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eeaf77-3120-4d9a-a442-065b9462dc51 service placement] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:35:38.928950 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1118/2239] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:35:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:35:48.924286 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=63 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:36:30.957285 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a489e-de0e-4c1c-b310-7b69bc6b7d40 service nova] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:36:30.959325 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-524a489e-de0e-4c1c-b310-7b69bc6b7d40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:36:31.067116 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a489e-de0e-4c1c-b310-7b69bc6b7d40 service nova] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:36:31.071247 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8d5dc-eba9-4c84-887e-7d31a724e97a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:36:31.071891 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8d5dc-eba9-4c84-887e-7d31a724e97a service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:36:31.072205 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8d5dc-eba9-4c84-887e-7d31a724e97a service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:36:31.072728 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8d5dc-eba9-4c84-887e-7d31a724e97a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:36:31.074488 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-acf8d5dc-eba9-4c84-887e-7d31a724e97a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:36:31.132377 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8d5dc-eba9-4c84-887e-7d31a724e97a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:36:31.133816 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8d5dc-eba9-4c84-887e-7d31a724e97a service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:36:31.142757 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1122/2240] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:36:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:36:32.605811 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eeaf77-3120-4d9a-a442-065b9462dc51 service placement] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:36:32.615745 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eeaf77-3120-4d9a-a442-065b9462dc51 service placement] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:36:32.619352 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f5cdd-1ac1-4a28-827a-dc7deb6ebcb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:36:32.620009 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f5cdd-1ac1-4a28-827a-dc7deb6ebcb7 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:36:32.620292 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f5cdd-1ac1-4a28-827a-dc7deb6ebcb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:36:32.620569 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f5cdd-1ac1-4a28-827a-dc7deb6ebcb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:36:32.622291 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8b7f5cdd-1ac1-4a28-827a-dc7deb6ebcb7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:36:32.680700 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7f5cdd-1ac1-4a28-827a-dc7deb6ebcb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:36:32.682120 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7f5cdd-1ac1-4a28-827a-dc7deb6ebcb7 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:36:32.690817 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1119/2241] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:36:32 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:36:35.049607 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8d5dc-eba9-4c84-887e-7d31a724e97a service cinder] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:36:35.058310 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8d5dc-eba9-4c84-887e-7d31a724e97a service cinder] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:36:35.061921 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b83b7-a860-4e4a-8457-c237db739ec0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:36:35.062837 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b83b7-a860-4e4a-8457-c237db739ec0 service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:36:35.063125 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b83b7-a860-4e4a-8457-c237db739ec0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:36:35.063404 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b83b7-a860-4e4a-8457-c237db739ec0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:36:35.065164 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-7e7b83b7-a860-4e4a-8457-c237db739ec0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:36:35.131850 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:36:35.136264 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7b83b7-a860-4e4a-8457-c237db739ec0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:36:35.137699 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7b83b7-a860-4e4a-8457-c237db739ec0 service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:36:35.147218 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1123/2242] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:36:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:36:42.686763 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=28 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:36:45.142462 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:37:33.211089 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f5cdd-1ac1-4a28-827a-dc7deb6ebcb7 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:37:33.219353 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f5cdd-1ac1-4a28-827a-dc7deb6ebcb7 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:37:33.222916 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669da14-ece0-4451-8384-fcd8ef7297f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:37:33.223548 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669da14-ece0-4451-8384-fcd8ef7297f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:37:33.223832 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669da14-ece0-4451-8384-fcd8ef7297f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:37:33.224139 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669da14-ece0-4451-8384-fcd8ef7297f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:37:33.226386 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6669da14-ece0-4451-8384-fcd8ef7297f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:37:33.298008 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6669da14-ece0-4451-8384-fcd8ef7297f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:37:33.299443 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6669da14-ece0-4451-8384-fcd8ef7297f7 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:37:33.308988 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1120/2243] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:37:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:37:42.442939 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b83b7-a860-4e4a-8457-c237db739ec0 service cinder] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:37:42.444410 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-7e7b83b7-a860-4e4a-8457-c237db739ec0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:37:42.521814 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b83b7-a860-4e4a-8457-c237db739ec0 service cinder] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:37:42.525386 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38595f-c52e-4ff8-b429-8aa317c3b257 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:37:42.526025 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38595f-c52e-4ff8-b429-8aa317c3b257 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:37:42.526317 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38595f-c52e-4ff8-b429-8aa317c3b257 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:37:42.526591 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38595f-c52e-4ff8-b429-8aa317c3b257 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:37:42.528352 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-1d38595f-c52e-4ff8-b429-8aa317c3b257 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:37:42.538594 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38595f-c52e-4ff8-b429-8aa317c3b257 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:37:42.540038 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38595f-c52e-4ff8-b429-8aa317c3b257 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:37:42.547699 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1124/2244] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:37:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:37:43.304934 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=33 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:37:52.544265 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=35 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:37:55.847238 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669da14-ece0-4451-8384-fcd8ef7297f7 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:37:55.856806 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669da14-ece0-4451-8384-fcd8ef7297f7 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:37:55.860342 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909156b-2cb4-485e-9aad-83542043b976 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:37:55.860985 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909156b-2cb4-485e-9aad-83542043b976 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:37:55.861266 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909156b-2cb4-485e-9aad-83542043b976 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:37:55.861541 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909156b-2cb4-485e-9aad-83542043b976 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:37:55.863401 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6909156b-2cb4-485e-9aad-83542043b976 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:37:55.895655 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6909156b-2cb4-485e-9aad-83542043b976 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:37:55.897624 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6909156b-2cb4-485e-9aad-83542043b976 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:37:55.919554 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1121/2245] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:37:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:37:57.091188 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38595f-c52e-4ff8-b429-8aa317c3b257 service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:37:57.100527 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38595f-c52e-4ff8-b429-8aa317c3b257 service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:37:57.104116 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592ab75-2283-4ad5-9e8f-6a725105950f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:37:57.104747 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592ab75-2283-4ad5-9e8f-6a725105950f service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:37:57.105033 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592ab75-2283-4ad5-9e8f-6a725105950f service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:37:57.105317 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592ab75-2283-4ad5-9e8f-6a725105950f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:37:57.107091 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-2592ab75-2283-4ad5-9e8f-6a725105950f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:37:57.120879 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2592ab75-2283-4ad5-9e8f-6a725105950f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:37:57.122305 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2592ab75-2283-4ad5-9e8f-6a725105950f service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:37:57.133120 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1125/2246] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:37:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:38:00.586596 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909156b-2cb4-485e-9aad-83542043b976 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:38:00.588063 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6909156b-2cb4-485e-9aad-83542043b976 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:38:00.602660 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909156b-2cb4-485e-9aad-83542043b976 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:38:00.608593 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a948a3-a3d4-4c3a-a5ab-b99759348235 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3918fe05c8634bc39f3e295374701465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:38:00.609586 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a948a3-a3d4-4c3a-a5ab-b99759348235 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:38:00.610077 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a948a3-a3d4-4c3a-a5ab-b99759348235 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:38:00.610589 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a948a3-a3d4-4c3a-a5ab-b99759348235 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:38:00.613577 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-12a948a3-a3d4-4c3a-a5ab-b99759348235 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:38:00.683063 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a948a3-a3d4-4c3a-a5ab-b99759348235 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:38:00.684702 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a948a3-a3d4-4c3a-a5ab-b99759348235 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:38:00.694028 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1122/2247] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:38:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:38:07.128293 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=6 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:38:10.689415 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=51 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:38:43.615875 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592ab75-2283-4ad5-9e8f-6a725105950f service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:38:43.617322 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-2592ab75-2283-4ad5-9e8f-6a725105950f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:38:43.628531 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592ab75-2283-4ad5-9e8f-6a725105950f service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:38:43.632770 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c70b4-e851-4ee5-842c-ef9311c19373 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:38:43.633421 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c70b4-e851-4ee5-842c-ef9311c19373 service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:38:43.633712 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c70b4-e851-4ee5-842c-ef9311c19373 service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:38:43.633996 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c70b4-e851-4ee5-842c-ef9311c19373 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:38:43.642497 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36c70b4-e851-4ee5-842c-ef9311c19373 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:38:43.643984 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36c70b4-e851-4ee5-842c-ef9311c19373 service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:38:43.653930 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1126/2248] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:38:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:38:53.649776 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=6 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:39:37.303192 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a948a3-a3d4-4c3a-a5ab-b99759348235 service nova] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:39:37.318397 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a948a3-a3d4-4c3a-a5ab-b99759348235 service nova] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:39:37.335174 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fef6d0-9268-4328-b643-07c78286d8f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3918fe05c8634bc39f3e295374701465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:39:37.335907 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fef6d0-9268-4328-b643-07c78286d8f5 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:39:37.336238 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fef6d0-9268-4328-b643-07c78286d8f5 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:39:37.336531 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fef6d0-9268-4328-b643-07c78286d8f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:39:37.338345 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-85fef6d0-9268-4328-b643-07c78286d8f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:39:37.357011 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fef6d0-9268-4328-b643-07c78286d8f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:39:37.358770 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fef6d0-9268-4328-b643-07c78286d8f5 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:39:37.371801 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1123/2249] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:39:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:39:47.366787 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=6 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:40:42.694000 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c70b4-e851-4ee5-842c-ef9311c19373 service cinder] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:40:42.695635 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-d36c70b4-e851-4ee5-842c-ef9311c19373 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:40:42.710559 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c70b4-e851-4ee5-842c-ef9311c19373 service cinder] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:40:42.716213 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10895a67-b70d-4afc-b7ee-09747ab6d92b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59294bff27c4b3f8aaeeab48ed35a0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:40:42.716851 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10895a67-b70d-4afc-b7ee-09747ab6d92b service placement] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:40:42.717134 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10895a67-b70d-4afc-b7ee-09747ab6d92b service placement] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:40:42.717412 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10895a67-b70d-4afc-b7ee-09747ab6d92b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:40:42.725835 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10895a67-b70d-4afc-b7ee-09747ab6d92b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:40:42.727424 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10895a67-b70d-4afc-b7ee-09747ab6d92b service placement] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:40:42.737103 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1127/2250] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:40:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:40:52.733010 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=6 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:41:35.118159 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fef6d0-9268-4328-b643-07c78286d8f5 service nova] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:41:35.127375 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fef6d0-9268-4328-b643-07c78286d8f5 service nova] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:41:35.130860 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb37fc3-20b4-46ab-8af5-07f99c4c5d8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:41:35.131488 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb37fc3-20b4-46ab-8af5-07f99c4c5d8e service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:41:35.131770 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb37fc3-20b4-46ab-8af5-07f99c4c5d8e service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:41:35.132079 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb37fc3-20b4-46ab-8af5-07f99c4c5d8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:41:35.140820 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb37fc3-20b4-46ab-8af5-07f99c4c5d8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:41:35.142227 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb37fc3-20b4-46ab-8af5-07f99c4c5d8e service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:41:35.150922 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1124/2251] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:41:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:41:35.235629 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10895a67-b70d-4afc-b7ee-09747ab6d92b service placement] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:41:35.244680 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10895a67-b70d-4afc-b7ee-09747ab6d92b service placement] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:41:35.248232 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8981f700-5e00-4a9c-8d16-217a81d596c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:41:35.248879 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981f700-5e00-4a9c-8d16-217a81d596c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:41:35.249162 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981f700-5e00-4a9c-8d16-217a81d596c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:41:35.249439 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981f700-5e00-4a9c-8d16-217a81d596c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:41:35.258853 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8981f700-5e00-4a9c-8d16-217a81d596c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:41:35.260327 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8981f700-5e00-4a9c-8d16-217a81d596c9 service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:41:35.291584 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1128/2252] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:41:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:41:35.347061 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb37fc3-20b4-46ab-8af5-07f99c4c5d8e service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:41:35.355907 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb37fc3-20b4-46ab-8af5-07f99c4c5d8e service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:41:35.360294 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2345985-6139-4b99-a08b-4eb4eb05cf1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:41:35.360939 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2345985-6139-4b99-a08b-4eb4eb05cf1a service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:41:35.361312 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2345985-6139-4b99-a08b-4eb4eb05cf1a service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:41:35.361664 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2345985-6139-4b99-a08b-4eb4eb05cf1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:41:35.371456 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2345985-6139-4b99-a08b-4eb4eb05cf1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:41:35.373000 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2345985-6139-4b99-a08b-4eb4eb05cf1a service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:41:35.413000 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1125/2253] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:41:35 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:41:45.288204 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=13 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:41:45.410824 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=19 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:42:45.966124 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8981f700-5e00-4a9c-8d16-217a81d596c9 service cinder] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:42:45.976210 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8981f700-5e00-4a9c-8d16-217a81d596c9 service cinder] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:42:45.979774 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33791c6b-6d0e-486d-bd67-243de1bcf93e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:42:45.980449 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33791c6b-6d0e-486d-bd67-243de1bcf93e service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:42:45.980741 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33791c6b-6d0e-486d-bd67-243de1bcf93e service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:42:45.981026 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33791c6b-6d0e-486d-bd67-243de1bcf93e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:42:45.988159 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33791c6b-6d0e-486d-bd67-243de1bcf93e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:42:45.989587 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33791c6b-6d0e-486d-bd67-243de1bcf93e service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:42:45.997529 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1129/2254] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:42:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:42:47.207223 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2345985-6139-4b99-a08b-4eb4eb05cf1a service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:42:47.215789 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2345985-6139-4b99-a08b-4eb4eb05cf1a service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:42:47.219367 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d53ca0-400a-49ad-a6b9-07675750ab08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:42:47.220042 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d53ca0-400a-49ad-a6b9-07675750ab08 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:42:47.220328 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d53ca0-400a-49ad-a6b9-07675750ab08 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:42:47.220610 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d53ca0-400a-49ad-a6b9-07675750ab08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:42:47.229776 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d53ca0-400a-49ad-a6b9-07675750ab08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:42:47.231202 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d53ca0-400a-49ad-a6b9-07675750ab08 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:42:47.257939 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1126/2255] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:42:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:42:55.994014 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=6 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:42:56.742861 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33791c6b-6d0e-486d-bd67-243de1bcf93e service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:42:56.751609 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33791c6b-6d0e-486d-bd67-243de1bcf93e service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:42:56.755363 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f4829-010e-49ab-ae87-6347aebd15af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:42:56.756041 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f4829-010e-49ab-ae87-6347aebd15af service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:42:56.756332 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f4829-010e-49ab-ae87-6347aebd15af service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:42:56.756616 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f4829-010e-49ab-ae87-6347aebd15af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:42:56.767423 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f4829-010e-49ab-ae87-6347aebd15af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:42:56.768893 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f4829-010e-49ab-ae87-6347aebd15af service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:42:56.780526 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1130/2256] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:42:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:42:57.255359 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=13 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:42:57.985168 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d53ca0-400a-49ad-a6b9-07675750ab08 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:42:57.994610 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d53ca0-400a-49ad-a6b9-07675750ab08 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:42:57.997967 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d7f2c0-b504-403b-9e28-bee62bafc200 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:42:57.998613 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7f2c0-b504-403b-9e28-bee62bafc200 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:42:57.998897 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7f2c0-b504-403b-9e28-bee62bafc200 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:42:57.999174 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7f2c0-b504-403b-9e28-bee62bafc200 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:42:58.009992 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d7f2c0-b504-403b-9e28-bee62bafc200 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:42:58.011499 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d7f2c0-b504-403b-9e28-bee62bafc200 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:42:58.022943 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1127/2257] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:42:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:43:00.243088 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f4829-010e-49ab-ae87-6347aebd15af service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:43:00.244513 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-eb1f4829-010e-49ab-ae87-6347aebd15af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:43:00.259912 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f4829-010e-49ab-ae87-6347aebd15af service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:43:00.265448 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c58f7-33e5-414e-8295-0db82b454d80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3918fe05c8634bc39f3e295374701465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:43:00.266096 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c58f7-33e5-414e-8295-0db82b454d80 service nova] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:43:00.266388 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c58f7-33e5-414e-8295-0db82b454d80 service nova] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:43:00.266675 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c58f7-33e5-414e-8295-0db82b454d80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:43:00.274951 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c58f7-33e5-414e-8295-0db82b454d80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:43:00.276588 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c58f7-33e5-414e-8295-0db82b454d80 service nova] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:43:00.304236 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1131/2258] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:43:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:43:08.017661 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=6 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:43:10.300847 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=19 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:43:44.338317 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d7f2c0-b504-403b-9e28-bee62bafc200 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:43:44.404864 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d7f2c0-b504-403b-9e28-bee62bafc200 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:43:44.410209 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c682209-988c-418a-a00f-e9473bbf7b4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3918fe05c8634bc39f3e295374701465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:43:44.410849 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c682209-988c-418a-a00f-e9473bbf7b4a service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:43:44.411136 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c682209-988c-418a-a00f-e9473bbf7b4a service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:43:44.411418 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c682209-988c-418a-a00f-e9473bbf7b4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:43:44.413334 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3c682209-988c-418a-a00f-e9473bbf7b4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:43:44.490387 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c682209-988c-418a-a00f-e9473bbf7b4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:43:44.492005 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c682209-988c-418a-a00f-e9473bbf7b4a service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:43:44.510340 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1128/2259] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:43:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:43:54.507824 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=69 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:45:49.356577 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c58f7-33e5-414e-8295-0db82b454d80 service nova] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:45:49.358136 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-fa4c58f7-33e5-414e-8295-0db82b454d80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:45:49.468017 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c58f7-33e5-414e-8295-0db82b454d80 service nova] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:45:49.473129 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc23f9-0b3f-4dfb-b0ca-839466d6d277 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59294bff27c4b3f8aaeeab48ed35a0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:45:49.473782 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc23f9-0b3f-4dfb-b0ca-839466d6d277 service placement] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:45:49.474073 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc23f9-0b3f-4dfb-b0ca-839466d6d277 service placement] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:45:49.474356 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc23f9-0b3f-4dfb-b0ca-839466d6d277 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:45:49.476288 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-9cfc23f9-0b3f-4dfb-b0ca-839466d6d277 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:45:49.487734 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfc23f9-0b3f-4dfb-b0ca-839466d6d277 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:45:49.489371 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfc23f9-0b3f-4dfb-b0ca-839466d6d277 service placement] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:45:49.499386 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1132/2260] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:45:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:45:59.495074 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=50 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:46:35.080444 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c682209-988c-418a-a00f-e9473bbf7b4a service nova] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:46:35.121271 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c682209-988c-418a-a00f-e9473bbf7b4a service nova] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:46:35.127310 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5143ea-b61d-43ab-8ee7-dbc7609928aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3918fe05c8634bc39f3e295374701465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:46:35.127975 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5143ea-b61d-43ab-8ee7-dbc7609928aa service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:46:35.128264 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5143ea-b61d-43ab-8ee7-dbc7609928aa service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:46:35.128542 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5143ea-b61d-43ab-8ee7-dbc7609928aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:46:35.130412 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8e5143ea-b61d-43ab-8ee7-dbc7609928aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:46:35.216889 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5143ea-b61d-43ab-8ee7-dbc7609928aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:46:35.218497 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5143ea-b61d-43ab-8ee7-dbc7609928aa service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:46:35.236419 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1129/2261] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:46:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:46:45.233716 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=59 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:46:45.394190 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c52b41-7ab9-4efa-a465-7154a5084ba3 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:46:45.394759 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c52b41-7ab9-4efa-a465-7154a5084ba3 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:46:45.394759 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c52b41-7ab9-4efa-a465-7154a5084ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:46:45.454716 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-57c52b41-7ab9-4efa-a465-7154a5084ba3 None None] MFA Rules not processed for user `5cf067b8833f4596a1b91073a66768f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:46:45.455953 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-57c52b41-7ab9-4efa-a465-7154a5084ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:46:45.529289 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1133/2262] 10.222.0.15 () {58 vars in 967 bytes} [Tue Jun 21 20:46:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:46:45.570441 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5143ea-b61d-43ab-8ee7-dbc7609928aa service nova] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:46:45.571866 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8e5143ea-b61d-43ab-8ee7-dbc7609928aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:46:45.660635 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5143ea-b61d-43ab-8ee7-dbc7609928aa service nova] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:46:45.665567 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e05339-27e1-4f3a-9182-4ee9602f2f16 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '038537bd12174154ba259e097b97b8bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:46:45.666210 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e05339-27e1-4f3a-9182-4ee9602f2f16 service swift] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:46:45.666494 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e05339-27e1-4f3a-9182-4ee9602f2f16 service swift] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:46:45.666774 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e05339-27e1-4f3a-9182-4ee9602f2f16 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:46:45.675261 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e05339-27e1-4f3a-9182-4ee9602f2f16 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:46:45.676864 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e05339-27e1-4f3a-9182-4ee9602f2f16 service swift] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:46:45.684708 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1130/2263] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jun 21 20:46:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 20:46:46.237100 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c52b41-7ab9-4efa-a465-7154a5084ba3 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:46:46.238525 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-57c52b41-7ab9-4efa-a465-7154a5084ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:46:46.249904 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c52b41-7ab9-4efa-a465-7154a5084ba3 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:46:46.254223 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32639fe-70b4-47fb-80d0-b51a7dec1d76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:46:46.254887 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32639fe-70b4-47fb-80d0-b51a7dec1d76 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:46:46.255175 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32639fe-70b4-47fb-80d0-b51a7dec1d76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:46:46.255456 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32639fe-70b4-47fb-80d0-b51a7dec1d76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:46:46.257273 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-f32639fe-70b4-47fb-80d0-b51a7dec1d76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:46:46.343974 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32639fe-70b4-47fb-80d0-b51a7dec1d76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:46:46.345772 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32639fe-70b4-47fb-80d0-b51a7dec1d76 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:46:46.364307 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1134/2264] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:46:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:46:48.020049 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e05339-27e1-4f3a-9182-4ee9602f2f16 service swift] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:46:48.091445 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e05339-27e1-4f3a-9182-4ee9602f2f16 service swift] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:46:48.096224 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1adadf-013a-481d-872f-c96cd0e73290 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:46:48.097244 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1adadf-013a-481d-872f-c96cd0e73290 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:46:48.097372 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1adadf-013a-481d-872f-c96cd0e73290 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:46:48.097715 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1adadf-013a-481d-872f-c96cd0e73290 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:46:48.099688 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ec1adadf-013a-481d-872f-c96cd0e73290 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:46:48.183141 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1adadf-013a-481d-872f-c96cd0e73290 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:46:48.184671 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1adadf-013a-481d-872f-c96cd0e73290 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:46:48.206670 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1131/2265] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:46:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:46:48.247225 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32639fe-70b4-47fb-80d0-b51a7dec1d76 service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:46:48.257882 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32639fe-70b4-47fb-80d0-b51a7dec1d76 service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:46:48.261938 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943f1739-e667-4c2d-9979-8ac6b8cf33bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:46:48.262713 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f1739-e667-4c2d-9979-8ac6b8cf33bb service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:46:48.263069 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f1739-e667-4c2d-9979-8ac6b8cf33bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:46:48.263435 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f1739-e667-4c2d-9979-8ac6b8cf33bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:46:48.266444 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-943f1739-e667-4c2d-9979-8ac6b8cf33bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:46:48.288285 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:46:48.357921 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943f1739-e667-4c2d-9979-8ac6b8cf33bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:46:48.359638 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943f1739-e667-4c2d-9979-8ac6b8cf33bb service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:46:48.370406 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1135/2266] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:46:48 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:46:50.183874 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1adadf-013a-481d-872f-c96cd0e73290 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:46:50.191678 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:46:50.196559 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1adadf-013a-481d-872f-c96cd0e73290 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:46:50.201911 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55392b71-91ec-45f6-b2b1-1c3c73eed83b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59294bff27c4b3f8aaeeab48ed35a0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:46:50.202562 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55392b71-91ec-45f6-b2b1-1c3c73eed83b service placement] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:46:50.202881 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55392b71-91ec-45f6-b2b1-1c3c73eed83b service placement] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:46:50.203162 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55392b71-91ec-45f6-b2b1-1c3c73eed83b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:46:50.205149 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-55392b71-91ec-45f6-b2b1-1c3c73eed83b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:46:50.217352 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55392b71-91ec-45f6-b2b1-1c3c73eed83b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:46:50.218926 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55392b71-91ec-45f6-b2b1-1c3c73eed83b service placement] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:46:50.229274 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1132/2267] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:46:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:46:50.531111 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943f1739-e667-4c2d-9979-8ac6b8cf33bb service cinder] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:46:50.547225 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943f1739-e667-4c2d-9979-8ac6b8cf33bb service cinder] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:46:50.554912 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e20312-e8f5-4dae-b119-442beaf06107 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3918fe05c8634bc39f3e295374701465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:46:50.556465 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e20312-e8f5-4dae-b119-442beaf06107 service nova] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:46:50.557317 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e20312-e8f5-4dae-b119-442beaf06107 service nova] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:46:50.557838 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e20312-e8f5-4dae-b119-442beaf06107 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:46:50.569956 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e20312-e8f5-4dae-b119-442beaf06107 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:46:50.571885 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e20312-e8f5-4dae-b119-442beaf06107 service nova] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:46:50.586237 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1136/2268] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:46:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:46:53.950523 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55392b71-91ec-45f6-b2b1-1c3c73eed83b service placement] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:46:53.952542 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-55392b71-91ec-45f6-b2b1-1c3c73eed83b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:46:53.967581 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55392b71-91ec-45f6-b2b1-1c3c73eed83b service placement] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:46:53.972036 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1921a7-032c-43b3-8977-56ac73160efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:46:53.972929 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1921a7-032c-43b3-8977-56ac73160efb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:46:53.973211 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1921a7-032c-43b3-8977-56ac73160efb admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:46:53.973485 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1921a7-032c-43b3-8977-56ac73160efb admin admin] PATH_INFO: `/v3/users/621ea4d1aae040298ba8420d767b33b0` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:46:53.974645 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1921a7-032c-43b3-8977-56ac73160efb admin admin] RBAC: Authorizing `identity:delete_user(user_id=621ea4d1aae040298ba8420d767b33b0)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:46:53.976582 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1921a7-032c-43b3-8977-56ac73160efb admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:46:54.020770 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0d1921a7-032c-43b3-8977-56ac73160efb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '621ea4d1aae040298ba8420d767b33b0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:46:54.021411 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0d1921a7-032c-43b3-8977-56ac73160efb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '621ea4d1aae040298ba8420d767b33b0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:46:54.022005 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0d1921a7-032c-43b3-8977-56ac73160efb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '621ea4d1aae040298ba8420d767b33b0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:46:54.033473 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0d1921a7-032c-43b3-8977-56ac73160efb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '621ea4d1aae040298ba8420d767b33b0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:46:54.040488 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0d1921a7-032c-43b3-8977-56ac73160efb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '621ea4d1aae040298ba8420d767b33b0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:46:54.053282 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1133/2269] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:46:53 2022] DELETE /identity/v3/users/621ea4d1aae040298ba8420d767b33b0 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:46:54.152819 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e20312-e8f5-4dae-b119-442beaf06107 service nova] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:46:54.161902 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e20312-e8f5-4dae-b119-442beaf06107 service nova] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:46:54.211652 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e5d13-4099-458f-b554-fa9e6b0c366d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:46:54.212335 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e5d13-4099-458f-b554-fa9e6b0c366d service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:46:54.212621 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e5d13-4099-458f-b554-fa9e6b0c366d service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:46:54.212899 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e5d13-4099-458f-b554-fa9e6b0c366d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:46:54.214656 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-305e5d13-4099-458f-b554-fa9e6b0c366d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:46:54.229723 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1921a7-032c-43b3-8977-56ac73160efb admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:46:54.231426 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0d1921a7-032c-43b3-8977-56ac73160efb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:46:54.293996 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e5d13-4099-458f-b554-fa9e6b0c366d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:46:54.295501 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e5d13-4099-458f-b554-fa9e6b0c366d service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:46:54.304989 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1921a7-032c-43b3-8977-56ac73160efb admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:46:54.306189 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1137/2270] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:46:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:46:54.310386 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a2ecb-18c2-4a3b-8412-136904433877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:46:54.311258 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a2ecb-18c2-4a3b-8412-136904433877 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:46:54.311547 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a2ecb-18c2-4a3b-8412-136904433877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:46:54.311951 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a2ecb-18c2-4a3b-8412-136904433877 admin admin] PATH_INFO: `/v3/projects/8aec22694f384bd3a7a7428bb1b48b2c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:46:54.313160 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a2ecb-18c2-4a3b-8412-136904433877 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8aec22694f384bd3a7a7428bb1b48b2c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:46:54.315895 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a2ecb-18c2-4a3b-8412-136904433877 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:46:54.368363 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6c9a2ecb-18c2-4a3b-8412-136904433877 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8aec22694f384bd3a7a7428bb1b48b2c', 'request_id': 'req-6c9a2ecb-18c2-4a3b-8412-136904433877'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:46:54.375933 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6c9a2ecb-18c2-4a3b-8412-136904433877 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8aec22694f384bd3a7a7428bb1b48b2c', 'request_id': 'req-6c9a2ecb-18c2-4a3b-8412-136904433877'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:46:54.382455 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6c9a2ecb-18c2-4a3b-8412-136904433877 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8aec22694f384bd3a7a7428bb1b48b2c', 'request_id': 'req-6c9a2ecb-18c2-4a3b-8412-136904433877'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:46:54.383610 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:46:54.396344 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6c9a2ecb-18c2-4a3b-8412-136904433877 admin admin] The token cache is being invalidate because project 8aec22694f384bd3a7a7428bb1b48b2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:46:54.396909 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6c9a2ecb-18c2-4a3b-8412-136904433877 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:46:54.397560 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6c9a2ecb-18c2-4a3b-8412-136904433877 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:46:54.399155 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1134/2271] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:46:54 2022] DELETE /identity/v3/projects/8aec22694f384bd3a7a7428bb1b48b2c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:46:54.403140 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e5d13-4099-458f-b554-fa9e6b0c366d service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:46:54.413336 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e5d13-4099-458f-b554-fa9e6b0c366d service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:46:54.455999 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:46:54.471472 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa8f247-553c-4595-9e5d-9255d94acf4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:46:54.472405 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8f247-553c-4595-9e5d-9255d94acf4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:46:54.472708 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8f247-553c-4595-9e5d-9255d94acf4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:46:54.472984 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8f247-553c-4595-9e5d-9255d94acf4b admin admin] PATH_INFO: `/v3/users/d33f382841204e15947bc5a22f42d802` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:46:54.488101 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa8f247-553c-4595-9e5d-9255d94acf4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d33f382841204e15947bc5a22f42d802)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:46:54.490079 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa8f247-553c-4595-9e5d-9255d94acf4b admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:46:54.538327 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-0aa8f247-553c-4595-9e5d-9255d94acf4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd33f382841204e15947bc5a22f42d802'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:46:54.539011 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-0aa8f247-553c-4595-9e5d-9255d94acf4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd33f382841204e15947bc5a22f42d802'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:46:54.546498 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-0aa8f247-553c-4595-9e5d-9255d94acf4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd33f382841204e15947bc5a22f42d802'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:46:54.559381 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-0aa8f247-553c-4595-9e5d-9255d94acf4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd33f382841204e15947bc5a22f42d802'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:46:54.560095 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-0aa8f247-553c-4595-9e5d-9255d94acf4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd33f382841204e15947bc5a22f42d802'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:46:54.572567 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1138/2272] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:46:54 2022] DELETE /identity/v3/users/d33f382841204e15947bc5a22f42d802 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:46:54.755752 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a2ecb-18c2-4a3b-8412-136904433877 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:46:54.758121 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6c9a2ecb-18c2-4a3b-8412-136904433877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:46:54.786419 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a2ecb-18c2-4a3b-8412-136904433877 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:46:54.881324 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d2ea1-3f8d-4d90-9285-f7a9af691d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:46:54.881910 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d2ea1-3f8d-4d90-9285-f7a9af691d89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:46:54.882199 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d2ea1-3f8d-4d90-9285-f7a9af691d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:46:54.882484 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d2ea1-3f8d-4d90-9285-f7a9af691d89 admin admin] PATH_INFO: `/v3/projects/9007dfcfa89449f88aeac7e56a33de94` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:46:54.894514 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455d2ea1-3f8d-4d90-9285-f7a9af691d89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9007dfcfa89449f88aeac7e56a33de94)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:46:54.896531 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455d2ea1-3f8d-4d90-9285-f7a9af691d89 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:46:54.951073 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-455d2ea1-3f8d-4d90-9285-f7a9af691d89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9007dfcfa89449f88aeac7e56a33de94', 'request_id': 'req-455d2ea1-3f8d-4d90-9285-f7a9af691d89'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:46:54.959070 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-455d2ea1-3f8d-4d90-9285-f7a9af691d89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9007dfcfa89449f88aeac7e56a33de94', 'request_id': 'req-455d2ea1-3f8d-4d90-9285-f7a9af691d89'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:46:54.964749 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-455d2ea1-3f8d-4d90-9285-f7a9af691d89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9007dfcfa89449f88aeac7e56a33de94', 'request_id': 'req-455d2ea1-3f8d-4d90-9285-f7a9af691d89'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:46:54.977034 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-455d2ea1-3f8d-4d90-9285-f7a9af691d89 admin admin] The token cache is being invalidate because project 9007dfcfa89449f88aeac7e56a33de94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:46:54.977321 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-455d2ea1-3f8d-4d90-9285-f7a9af691d89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:46:54.977983 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-455d2ea1-3f8d-4d90-9285-f7a9af691d89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:46:54.979522 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1135/2273] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:46:54 2022] DELETE /identity/v3/projects/9007dfcfa89449f88aeac7e56a33de94 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:46:57.560195 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa8f247-553c-4595-9e5d-9255d94acf4b admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:46:57.561724 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-0aa8f247-553c-4595-9e5d-9255d94acf4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:46:57.575627 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa8f247-553c-4595-9e5d-9255d94acf4b admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:46:57.632892 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59464f61-dc4a-4f97-b536-71578834faaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:46:57.633817 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59464f61-dc4a-4f97-b536-71578834faaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:46:57.634103 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59464f61-dc4a-4f97-b536-71578834faaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:46:57.634380 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59464f61-dc4a-4f97-b536-71578834faaf admin admin] PATH_INFO: `/v3/users/e41fb552c794495fa27a1ff74768b9d9` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:46:57.635556 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59464f61-dc4a-4f97-b536-71578834faaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=e41fb552c794495fa27a1ff74768b9d9)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:46:57.637512 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59464f61-dc4a-4f97-b536-71578834faaf admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:46:57.682841 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-59464f61-dc4a-4f97-b536-71578834faaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e41fb552c794495fa27a1ff74768b9d9'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:46:57.683409 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-59464f61-dc4a-4f97-b536-71578834faaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e41fb552c794495fa27a1ff74768b9d9'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:46:57.691213 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-59464f61-dc4a-4f97-b536-71578834faaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e41fb552c794495fa27a1ff74768b9d9'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:46:57.692474 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:46:57.706797 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-59464f61-dc4a-4f97-b536-71578834faaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e41fb552c794495fa27a1ff74768b9d9'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:46:57.707460 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-59464f61-dc4a-4f97-b536-71578834faaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e41fb552c794495fa27a1ff74768b9d9'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:46:57.719714 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1139/2274] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:46:57 2022] DELETE /identity/v3/users/e41fb552c794495fa27a1ff74768b9d9 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:46:57.895397 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d2ea1-3f8d-4d90-9285-f7a9af691d89 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:46:57.896870 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-455d2ea1-3f8d-4d90-9285-f7a9af691d89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:46:57.912896 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d2ea1-3f8d-4d90-9285-f7a9af691d89 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:46:57.976594 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52013e57-6cbb-4ccd-ba31-7659274548e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:46:57.977373 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52013e57-6cbb-4ccd-ba31-7659274548e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:46:57.977655 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52013e57-6cbb-4ccd-ba31-7659274548e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:46:57.977928 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52013e57-6cbb-4ccd-ba31-7659274548e7 admin admin] PATH_INFO: `/v3/projects/1f57677aeccd40b18fddf7968fdf8214` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:46:57.979100 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52013e57-6cbb-4ccd-ba31-7659274548e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f57677aeccd40b18fddf7968fdf8214)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:46:57.981039 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52013e57-6cbb-4ccd-ba31-7659274548e7 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:46:57.996878 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:46:58.025987 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-52013e57-6cbb-4ccd-ba31-7659274548e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f57677aeccd40b18fddf7968fdf8214', 'request_id': 'req-52013e57-6cbb-4ccd-ba31-7659274548e7'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:46:58.033567 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-52013e57-6cbb-4ccd-ba31-7659274548e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f57677aeccd40b18fddf7968fdf8214', 'request_id': 'req-52013e57-6cbb-4ccd-ba31-7659274548e7'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:46:58.039061 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-52013e57-6cbb-4ccd-ba31-7659274548e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f57677aeccd40b18fddf7968fdf8214', 'request_id': 'req-52013e57-6cbb-4ccd-ba31-7659274548e7'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:46:58.050144 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-52013e57-6cbb-4ccd-ba31-7659274548e7 admin admin] The token cache is being invalidate because project 1f57677aeccd40b18fddf7968fdf8214 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:46:58.050431 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-52013e57-6cbb-4ccd-ba31-7659274548e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:46:58.051063 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-52013e57-6cbb-4ccd-ba31-7659274548e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:46:58.052608 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1136/2275] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:46:57 2022] DELETE /identity/v3/projects/1f57677aeccd40b18fddf7968fdf8214 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:46:58.058341 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f94efd-61a7-4d88-bcc8-78715bd1e8b3 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:46:58.058638 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f94efd-61a7-4d88-bcc8-78715bd1e8b3 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:46:58.058922 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f94efd-61a7-4d88-bcc8-78715bd1e8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:46:58.114847 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-71f94efd-61a7-4d88-bcc8-78715bd1e8b3 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:46:58.116122 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-71f94efd-61a7-4d88-bcc8-78715bd1e8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:46:58.173389 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1140/2276] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:46:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:46:58.181698 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c622e04c-bb7d-4381-8a52-dced80432fa4 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:46:58.182021 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c622e04c-bb7d-4381-8a52-dced80432fa4 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:46:58.182305 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c622e04c-bb7d-4381-8a52-dced80432fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:46:58.201024 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c622e04c-bb7d-4381-8a52-dced80432fa4 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:46:58.202265 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c622e04c-bb7d-4381-8a52-dced80432fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:46:58.210723 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1137/2277] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:46:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:46:58.214668 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f94efd-61a7-4d88-bcc8-78715bd1e8b3 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:46:58.224710 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f94efd-61a7-4d88-bcc8-78715bd1e8b3 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:46:58.229442 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb9366b-e544-4998-90c2-5af4ebc735eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:46:58.230040 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb9366b-e544-4998-90c2-5af4ebc735eb admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:46:58.230334 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb9366b-e544-4998-90c2-5af4ebc735eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:46:58.230617 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb9366b-e544-4998-90c2-5af4ebc735eb admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:46:58.231352 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb9366b-e544-4998-90c2-5af4ebc735eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:46:58.231667 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb9366b-e544-4998-90c2-5af4ebc735eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:46:58.233313 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb9366b-e544-4998-90c2-5af4ebc735eb admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:46:58.244613 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1141/2278] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:46:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:46:58.248555 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c622e04c-bb7d-4381-8a52-dced80432fa4 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:46:58.258248 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c622e04c-bb7d-4381-8a52-dced80432fa4 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:46:58.263162 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609de15d-c208-4110-839b-e7bffd37081a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:46:58.263813 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609de15d-c208-4110-839b-e7bffd37081a admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:46:58.264139 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609de15d-c208-4110-839b-e7bffd37081a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:46:58.264423 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609de15d-c208-4110-839b-e7bffd37081a admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:46:58.265121 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609de15d-c208-4110-839b-e7bffd37081a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:46:58.267006 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609de15d-c208-4110-839b-e7bffd37081a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:46:58.302130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1138/2279] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:46:58 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:46:58.306090 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb9366b-e544-4998-90c2-5af4ebc735eb admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:46:58.316647 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb9366b-e544-4998-90c2-5af4ebc735eb admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:46:58.371939 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73384d3-ad47-45bf-84f3-2368c53026ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:46:58.372610 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73384d3-ad47-45bf-84f3-2368c53026ef admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:46:58.372899 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73384d3-ad47-45bf-84f3-2368c53026ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:46:58.373178 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73384d3-ad47-45bf-84f3-2368c53026ef admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:46:58.373871 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73384d3-ad47-45bf-84f3-2368c53026ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:46:58.375778 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73384d3-ad47-45bf-84f3-2368c53026ef admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:46:58.396703 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1142/2280] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:46:58 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:46:58.400770 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609de15d-c208-4110-839b-e7bffd37081a admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:46:58.411330 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609de15d-c208-4110-839b-e7bffd37081a admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:46:58.416041 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b8b85-09bc-431a-8b56-d2ff996cb02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:46:58.416626 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b8b85-09bc-431a-8b56-d2ff996cb02b admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:46:58.416910 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b8b85-09bc-431a-8b56-d2ff996cb02b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:46:58.417185 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b8b85-09bc-431a-8b56-d2ff996cb02b admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:46:58.417942 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5b8b85-09bc-431a-8b56-d2ff996cb02b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:46:58.419508 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5b8b85-09bc-431a-8b56-d2ff996cb02b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:46:58.432372 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1139/2281] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:46:58.433549 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73384d3-ad47-45bf-84f3-2368c53026ef admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:46:58.444670 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73384d3-ad47-45bf-84f3-2368c53026ef admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:46:58.449404 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ee35b-faef-48c0-a4c0-24dc72d52f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:46:58.450069 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ee35b-faef-48c0-a4c0-24dc72d52f4a admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:46:58.450354 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ee35b-faef-48c0-a4c0-24dc72d52f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:46:58.450644 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ee35b-faef-48c0-a4c0-24dc72d52f4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:46:58.451391 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ee35b-faef-48c0-a4c0-24dc72d52f4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:46:58.453007 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ee35b-faef-48c0-a4c0-24dc72d52f4a admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:46:58.463808 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1143/2282] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:46:58.468030 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b8b85-09bc-431a-8b56-d2ff996cb02b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:46:58.477876 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b8b85-09bc-431a-8b56-d2ff996cb02b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:46:58.484078 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467dd22b-1d78-42a6-92ca-af329da28151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:46:58.484909 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467dd22b-1d78-42a6-92ca-af329da28151 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:46:58.485199 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467dd22b-1d78-42a6-92ca-af329da28151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:46:58.485517 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467dd22b-1d78-42a6-92ca-af329da28151 admin admin] PATH_INFO: `/v3/projects/75dafb877f6c448daa0a8903aaf81494/users/e0c898b4a62a4b49800e7f97e2f54863/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:46:58.500695 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467dd22b-1d78-42a6-92ca-af329da28151 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75dafb877f6c448daa0a8903aaf81494, user_id=e0c898b4a62a4b49800e7f97e2f54863, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:46:58.503836 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467dd22b-1d78-42a6-92ca-af329da28151 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:46:58.518610 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1140/2283] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:46:58 2022] PUT /identity/v3/projects/75dafb877f6c448daa0a8903aaf81494/users/e0c898b4a62a4b49800e7f97e2f54863/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:46:58.528611 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e50553-a11a-4131-83e1-93a6aacb1008 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:46:58.528910 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e50553-a11a-4131-83e1-93a6aacb1008 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:46:58.529204 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e50553-a11a-4131-83e1-93a6aacb1008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:46:58.541620 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:46:58.561662 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-60e50553-a11a-4131-83e1-93a6aacb1008 None None] MFA Rules not processed for user `e0c898b4a62a4b49800e7f97e2f54863`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:46:58.562872 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-60e50553-a11a-4131-83e1-93a6aacb1008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:46:58.625945 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1144/2284] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:46:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:46:58.631047 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467dd22b-1d78-42a6-92ca-af329da28151 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:46:58.691583 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467dd22b-1d78-42a6-92ca-af329da28151 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:46:58.696335 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c2d6a0-ba9b-493c-bdc2-477d66d210fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:46:58.696985 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2d6a0-ba9b-493c-bdc2-477d66d210fa admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:46:58.697269 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2d6a0-ba9b-493c-bdc2-477d66d210fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:46:58.697543 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2d6a0-ba9b-493c-bdc2-477d66d210fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:46:58.698231 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c2d6a0-ba9b-493c-bdc2-477d66d210fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:46:58.700146 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c2d6a0-ba9b-493c-bdc2-477d66d210fa admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:46:58.724693 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1141/2285] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:46:58 2022] POST /identity/v3/projects => generated 379 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 20:46:58.728933 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e50553-a11a-4131-83e1-93a6aacb1008 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:46:58.740441 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e50553-a11a-4131-83e1-93a6aacb1008 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:46:58.797851 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0be5b4-ba69-4108-bd75-11921d936d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:46:58.799099 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0be5b4-ba69-4108-bd75-11921d936d4b admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:46:58.799386 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0be5b4-ba69-4108-bd75-11921d936d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:46:58.799668 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0be5b4-ba69-4108-bd75-11921d936d4b admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:46:58.800410 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0be5b4-ba69-4108-bd75-11921d936d4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:46:58.802347 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0be5b4-ba69-4108-bd75-11921d936d4b admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:46:58.824216 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1145/2286] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:46:58 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 20:46:58.828082 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c2d6a0-ba9b-493c-bdc2-477d66d210fa admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:46:58.838409 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c2d6a0-ba9b-493c-bdc2-477d66d210fa admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:46:58.843056 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854bd447-6e20-43a2-a209-fae522c6364f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:46:58.843719 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854bd447-6e20-43a2-a209-fae522c6364f admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:46:58.844034 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854bd447-6e20-43a2-a209-fae522c6364f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:46:58.844314 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854bd447-6e20-43a2-a209-fae522c6364f admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:46:58.845105 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854bd447-6e20-43a2-a209-fae522c6364f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:46:58.846693 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854bd447-6e20-43a2-a209-fae522c6364f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:46:58.857395 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1142/2287] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:46:58.861935 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0be5b4-ba69-4108-bd75-11921d936d4b admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:46:58.872072 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0be5b4-ba69-4108-bd75-11921d936d4b admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:46:58.877271 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a1a88-3cb2-4839-9fd1-74d9c821c80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:46:58.877928 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a1a88-3cb2-4839-9fd1-74d9c821c80f admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:46:58.878212 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a1a88-3cb2-4839-9fd1-74d9c821c80f admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:46:58.878491 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a1a88-3cb2-4839-9fd1-74d9c821c80f admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:46:58.879245 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a1a88-3cb2-4839-9fd1-74d9c821c80f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:46:58.880885 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a1a88-3cb2-4839-9fd1-74d9c821c80f admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:46:58.890586 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1146/2288] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:46:58.894596 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854bd447-6e20-43a2-a209-fae522c6364f admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:46:58.904600 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854bd447-6e20-43a2-a209-fae522c6364f admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:46:58.909687 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a1fcc-10e2-4f48-9d3f-adcaf8d633d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:46:58.910559 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a1fcc-10e2-4f48-9d3f-adcaf8d633d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:46:58.910842 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a1fcc-10e2-4f48-9d3f-adcaf8d633d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:46:58.911121 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a1fcc-10e2-4f48-9d3f-adcaf8d633d4 admin admin] PATH_INFO: `/v3/projects/e2d534f3e46148bcb259aa99bbd85a91/users/4de8c7d22e9d4024aeb56e40861ef831/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:46:58.913341 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:46:58.927779 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a1fcc-10e2-4f48-9d3f-adcaf8d633d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2d534f3e46148bcb259aa99bbd85a91, user_id=4de8c7d22e9d4024aeb56e40861ef831, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:46:58.930457 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a1fcc-10e2-4f48-9d3f-adcaf8d633d4 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:46:58.943026 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1143/2289] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:46:58 2022] PUT /identity/v3/projects/e2d534f3e46148bcb259aa99bbd85a91/users/4de8c7d22e9d4024aeb56e40861ef831/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:46:58.953125 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136428c-63cb-444b-a8e8-a7528d1ac2d1 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:46:58.953419 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136428c-63cb-444b-a8e8-a7528d1ac2d1 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:46:58.953698 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136428c-63cb-444b-a8e8-a7528d1ac2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:46:58.979521 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-b136428c-63cb-444b-a8e8-a7528d1ac2d1 None None] MFA Rules not processed for user `4de8c7d22e9d4024aeb56e40861ef831`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:46:58.980746 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-b136428c-63cb-444b-a8e8-a7528d1ac2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:46:59.043863 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1147/2290] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:46:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:46:59.049056 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a1fcc-10e2-4f48-9d3f-adcaf8d633d4 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:46:59.109246 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a1fcc-10e2-4f48-9d3f-adcaf8d633d4 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:46:59.114413 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8214077-1916-41ac-9a34-02e3483fac55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:46:59.115068 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8214077-1916-41ac-9a34-02e3483fac55 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:46:59.115356 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8214077-1916-41ac-9a34-02e3483fac55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:46:59.115636 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8214077-1916-41ac-9a34-02e3483fac55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:46:59.116387 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8214077-1916-41ac-9a34-02e3483fac55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:46:59.118329 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8214077-1916-41ac-9a34-02e3483fac55 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:46:59.142662 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1144/2291] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:46:59 2022] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:46:59.146675 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136428c-63cb-444b-a8e8-a7528d1ac2d1 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:46:59.153284 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:46:59.157483 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136428c-63cb-444b-a8e8-a7528d1ac2d1 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:46:59.213959 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c0b3f-24d0-4844-a584-55541a446821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:46:59.214630 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c0b3f-24d0-4844-a584-55541a446821 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:46:59.214914 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c0b3f-24d0-4844-a584-55541a446821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:46:59.215190 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c0b3f-24d0-4844-a584-55541a446821 admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:46:59.215872 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c0b3f-24d0-4844-a584-55541a446821 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:46:59.217821 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c0b3f-24d0-4844-a584-55541a446821 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:46:59.238110 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1148/2292] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:46:59 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:46:59.242200 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8214077-1916-41ac-9a34-02e3483fac55 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:46:59.252799 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8214077-1916-41ac-9a34-02e3483fac55 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:46:59.257486 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902150a0-a667-456b-9c6c-3460df85ef02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:46:59.258137 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902150a0-a667-456b-9c6c-3460df85ef02 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:46:59.258504 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902150a0-a667-456b-9c6c-3460df85ef02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:46:59.258790 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902150a0-a667-456b-9c6c-3460df85ef02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:46:59.259538 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902150a0-a667-456b-9c6c-3460df85ef02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:46:59.261681 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902150a0-a667-456b-9c6c-3460df85ef02 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:46:59.272616 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1145/2293] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:46:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:46:59.276683 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c0b3f-24d0-4844-a584-55541a446821 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:46:59.286547 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c0b3f-24d0-4844-a584-55541a446821 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:46:59.291130 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046d3bb-81b5-4dbe-982c-8de3ac945064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:46:59.292033 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046d3bb-81b5-4dbe-982c-8de3ac945064 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:46:59.292319 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046d3bb-81b5-4dbe-982c-8de3ac945064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:46:59.292596 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046d3bb-81b5-4dbe-982c-8de3ac945064 admin admin] PATH_INFO: `/v3/projects/01bcc4bbb0a7417ebc7ad43f7bfb6b11/users/f7b907ae5c754281a54a64cd028cba8e/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:46:59.308470 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2046d3bb-81b5-4dbe-982c-8de3ac945064 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01bcc4bbb0a7417ebc7ad43f7bfb6b11, user_id=f7b907ae5c754281a54a64cd028cba8e, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:46:59.311322 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2046d3bb-81b5-4dbe-982c-8de3ac945064 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:46:59.324879 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1149/2294] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:46:59 2022] PUT /identity/v3/projects/01bcc4bbb0a7417ebc7ad43f7bfb6b11/users/f7b907ae5c754281a54a64cd028cba8e/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:46:59.328712 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902150a0-a667-456b-9c6c-3460df85ef02 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:46:59.338869 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902150a0-a667-456b-9c6c-3460df85ef02 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:46:59.394833 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df39e1-e8aa-4713-a2ed-e4fd77be3530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:46:59.395499 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df39e1-e8aa-4713-a2ed-e4fd77be3530 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:46:59.395785 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df39e1-e8aa-4713-a2ed-e4fd77be3530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:46:59.396102 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df39e1-e8aa-4713-a2ed-e4fd77be3530 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:46:59.396824 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2df39e1-e8aa-4713-a2ed-e4fd77be3530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:46:59.398397 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2df39e1-e8aa-4713-a2ed-e4fd77be3530 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:46:59.407854 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1146/2295] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:46:59 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:46:59.412141 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046d3bb-81b5-4dbe-982c-8de3ac945064 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:46:59.422188 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046d3bb-81b5-4dbe-982c-8de3ac945064 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:46:59.427248 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb50f0-691a-42f0-968d-1b4204b7fe9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:46:59.428158 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb50f0-691a-42f0-968d-1b4204b7fe9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:46:59.428442 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb50f0-691a-42f0-968d-1b4204b7fe9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:46:59.428717 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb50f0-691a-42f0-968d-1b4204b7fe9f admin admin] PATH_INFO: `/v3/projects/01bcc4bbb0a7417ebc7ad43f7bfb6b11/users/f7b907ae5c754281a54a64cd028cba8e/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:46:59.430659 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb50f0-691a-42f0-968d-1b4204b7fe9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=01bcc4bbb0a7417ebc7ad43f7bfb6b11, user_id=f7b907ae5c754281a54a64cd028cba8e, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:46:59.433306 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb50f0-691a-42f0-968d-1b4204b7fe9f admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:46:59.444338 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1150/2296] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:46:59 2022] PUT /identity/v3/projects/01bcc4bbb0a7417ebc7ad43f7bfb6b11/users/f7b907ae5c754281a54a64cd028cba8e/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:46:59.455153 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fdf8a6-16c9-4753-a205-f7abae0050a9 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:46:59.455440 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fdf8a6-16c9-4753-a205-f7abae0050a9 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:46:59.455716 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fdf8a6-16c9-4753-a205-f7abae0050a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:46:59.481539 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-b1fdf8a6-16c9-4753-a205-f7abae0050a9 None None] MFA Rules not processed for user `f7b907ae5c754281a54a64cd028cba8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:46:59.482746 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b1fdf8a6-16c9-4753-a205-f7abae0050a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:46:59.524384 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:46:59.552589 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1147/2297] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:46:59 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:47:09.440532 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=42,keystone:INSERT=5 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:47:09.549589 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=10 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:47:35.901246 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb50f0-691a-42f0-968d-1b4204b7fe9f admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:47:35.903168 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-1ebb50f0-691a-42f0-968d-1b4204b7fe9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:47:35.974393 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb50f0-691a-42f0-968d-1b4204b7fe9f admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:47:35.978173 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27282fe6-2fdb-4656-a670-d2eeb3cf102f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:47:35.978853 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27282fe6-2fdb-4656-a670-d2eeb3cf102f service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:47:35.979126 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27282fe6-2fdb-4656-a670-d2eeb3cf102f service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:47:35.979407 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27282fe6-2fdb-4656-a670-d2eeb3cf102f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:47:35.988618 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27282fe6-2fdb-4656-a670-d2eeb3cf102f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:47:35.990044 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27282fe6-2fdb-4656-a670-d2eeb3cf102f service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:47:35.999550 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1151/2298] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:47:35 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:47:38.181379 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc6f91-7f2e-4b95-8aca-e93c9c167084 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:47:38.181928 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc6f91-7f2e-4b95-8aca-e93c9c167084 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:47:38.181928 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc6f91-7f2e-4b95-8aca-e93c9c167084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:47:38.208818 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-8bcc6f91-7f2e-4b95-8aca-e93c9c167084 None None] MFA Rules not processed for user `fc95af68a6d640699f788d5438cae607`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:47:38.210023 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8bcc6f91-7f2e-4b95-8aca-e93c9c167084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:47:38.263002 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1148/2299] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:47:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:47:38.560688 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27282fe6-2fdb-4656-a670-d2eeb3cf102f service cinder] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:47:38.562207 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-27282fe6-2fdb-4656-a670-d2eeb3cf102f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:47:38.617864 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27282fe6-2fdb-4656-a670-d2eeb3cf102f service cinder] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:47:38.621404 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48bbef8-d321-4167-91eb-baf1a20232d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:47:38.622052 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48bbef8-d321-4167-91eb-baf1a20232d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:47:38.622340 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48bbef8-d321-4167-91eb-baf1a20232d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:47:38.622620 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48bbef8-d321-4167-91eb-baf1a20232d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:47:38.624402 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-b48bbef8-d321-4167-91eb-baf1a20232d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:47:38.633716 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48bbef8-d321-4167-91eb-baf1a20232d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:47:38.635074 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48bbef8-d321-4167-91eb-baf1a20232d8 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:47:38.642911 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1152/2300] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:47:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:47:39.208937 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc6f91-7f2e-4b95-8aca-e93c9c167084 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:47:39.210549 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8bcc6f91-7f2e-4b95-8aca-e93c9c167084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:47:39.280567 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc6f91-7f2e-4b95-8aca-e93c9c167084 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:47:39.286155 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c52de-8d60-4105-8e6c-9b04ad4ebba9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59294bff27c4b3f8aaeeab48ed35a0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:47:39.286846 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c52de-8d60-4105-8e6c-9b04ad4ebba9 service placement] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:47:39.287128 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c52de-8d60-4105-8e6c-9b04ad4ebba9 service placement] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:47:39.287404 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c52de-8d60-4105-8e6c-9b04ad4ebba9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:47:39.289180 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a52c52de-8d60-4105-8e6c-9b04ad4ebba9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:47:39.300077 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c52de-8d60-4105-8e6c-9b04ad4ebba9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:47:39.301634 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c52de-8d60-4105-8e6c-9b04ad4ebba9 service placement] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:47:39.311335 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1149/2301] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:47:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:47:47.805890 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48bbef8-d321-4167-91eb-baf1a20232d8 service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:47:47.807361 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-b48bbef8-d321-4167-91eb-baf1a20232d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:47:47.889913 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48bbef8-d321-4167-91eb-baf1a20232d8 service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:47:47.895319 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32ee43-dd74-4baa-afe2-c3251a8b9773 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3918fe05c8634bc39f3e295374701465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:47:47.896003 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32ee43-dd74-4baa-afe2-c3251a8b9773 service nova] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:47:47.896287 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32ee43-dd74-4baa-afe2-c3251a8b9773 service nova] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:47:47.896563 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32ee43-dd74-4baa-afe2-c3251a8b9773 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:47:47.898306 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-3e32ee43-dd74-4baa-afe2-c3251a8b9773 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:47:47.912090 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e32ee43-dd74-4baa-afe2-c3251a8b9773 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:47:47.913599 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e32ee43-dd74-4baa-afe2-c3251a8b9773 service nova] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:47:47.924025 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1153/2302] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:47:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:47:48.086299 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c52de-8d60-4105-8e6c-9b04ad4ebba9 service placement] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:47:48.105267 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c52de-8d60-4105-8e6c-9b04ad4ebba9 service placement] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:47:48.109229 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3659da1-4a2f-4c03-835e-bc64b06bc229 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:47:48.109883 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3659da1-4a2f-4c03-835e-bc64b06bc229 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:47:48.110172 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3659da1-4a2f-4c03-835e-bc64b06bc229 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:47:48.110454 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3659da1-4a2f-4c03-835e-bc64b06bc229 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:47:48.112313 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c3659da1-4a2f-4c03-835e-bc64b06bc229 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:47:48.134272 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3659da1-4a2f-4c03-835e-bc64b06bc229 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:47:48.135744 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3659da1-4a2f-4c03-835e-bc64b06bc229 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:47:48.144251 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1150/2303] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:47:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:47:57.919662 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=91 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:47:58.140177 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=75 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:48:48.732440 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32ee43-dd74-4baa-afe2-c3251a8b9773 service nova] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:48:48.733863 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-3e32ee43-dd74-4baa-afe2-c3251a8b9773 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:48:48.745464 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32ee43-dd74-4baa-afe2-c3251a8b9773 service nova] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:48:48.749001 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca251aa6-5ed7-4ab0-a3c3-34f37283869e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:48:48.749637 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca251aa6-5ed7-4ab0-a3c3-34f37283869e service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:48:48.749924 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca251aa6-5ed7-4ab0-a3c3-34f37283869e service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:48:48.750206 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca251aa6-5ed7-4ab0-a3c3-34f37283869e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:48:48.805694 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca251aa6-5ed7-4ab0-a3c3-34f37283869e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:48:48.807125 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca251aa6-5ed7-4ab0-a3c3-34f37283869e service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:48:48.816219 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1154/2304] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:48:48 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:48:48.842012 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3659da1-4a2f-4c03-835e-bc64b06bc229 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:48:48.851201 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3659da1-4a2f-4c03-835e-bc64b06bc229 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:48:48.854768 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb851f-c173-481d-8702-014d5d035eac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:48:48.855413 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb851f-c173-481d-8702-014d5d035eac service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:48:48.855699 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb851f-c173-481d-8702-014d5d035eac service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:48:48.856103 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb851f-c173-481d-8702-014d5d035eac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:48:48.857889 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3bfb851f-c173-481d-8702-014d5d035eac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:48:48.927151 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb851f-c173-481d-8702-014d5d035eac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:48:48.928701 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb851f-c173-481d-8702-014d5d035eac service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:48:48.937717 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1151/2305] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:48:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:48:49.107444 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca251aa6-5ed7-4ab0-a3c3-34f37283869e service cinder] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:48:49.116491 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca251aa6-5ed7-4ab0-a3c3-34f37283869e service cinder] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:48:49.120024 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bbf472-4017-4583-a26e-118799234449 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:48:49.120646 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bbf472-4017-4583-a26e-118799234449 service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:48:49.120934 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bbf472-4017-4583-a26e-118799234449 service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:48:49.121223 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bbf472-4017-4583-a26e-118799234449 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:48:49.122982 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-12bbf472-4017-4583-a26e-118799234449 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:48:49.136066 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-12bbf472-4017-4583-a26e-118799234449 service cinder] Could not find project: 8aec22694f384bd3a7a7428bb1b48b2c.: keystone.exception.ProjectNotFound: Could not find project: 8aec22694f384bd3a7a7428bb1b48b2c. Jun 21 20:48:49.136066 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:48:49.136066 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:48:49.136066 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:48:49.136066 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:48:49.136066 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:48:49.136066 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:48:49.136066 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:48:49.136066 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:48:49.136066 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:48:49.136066 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:48:49.136066 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:48:49.136066 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Jun 21 20:48:49.136066 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Jun 21 20:48:49.136066 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Jun 21 20:48:49.137424 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Jun 21 20:48:49.137424 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Jun 21 20:48:49.137424 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Jun 21 20:48:49.137424 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:48:49.137424 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:48:49.137424 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 145, in validate_token Jun 21 20:48:49.137424 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application token = self._validate_token(token_id) Jun 21 20:48:49.137424 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:48:49.137424 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:48:49.137424 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:48:49.137424 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:48:49.137424 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:48:49.137424 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:48:49.137424 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:48:49.137424 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:48:49.137424 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:48:49.137424 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:48:49.138889 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:48:49.138889 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:48:49.138889 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:48:49.138889 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:48:49.138889 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 179, in _validate_token Jun 21 20:48:49.138889 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application token.mint(token_id, issued_at) Jun 21 20:48:49.138889 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 579, in mint Jun 21 20:48:49.138889 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._validate_token_resources() Jun 21 20:48:49.138889 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 464, in _validate_token_resources Jun 21 20:48:49.138889 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application if self.project and not self.project.get('enabled'): Jun 21 20:48:49.138889 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 162, in project Jun 21 20:48:49.138889 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application self.__project = PROVIDERS.resource_api.get_project( Jun 21 20:48:49.138889 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:48:49.138889 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:48:49.138889 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:48:49.138889 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:48:49.138889 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:48:49.140347 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:48:49.140347 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:48:49.140347 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:48:49.140347 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:48:49.140347 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:48:49.140347 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:48:49.140347 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:48:49.140347 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:48:49.140347 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:48:49.140347 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:48:49.140347 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:48:49.140347 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 20:48:49.140347 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 20:48:49.140347 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 20:48:49.140347 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 20:48:49.140347 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 20:48:49.140347 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 20:48:49.141710 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 8aec22694f384bd3a7a7428bb1b48b2c. Jun 21 20:48:49.141710 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:48:49.141710 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1155/2306] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:48:49 2022] GET /identity/v3/auth/tokens => generated 113 bytes in 30 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 21 20:48:49.436374 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb851f-c173-481d-8702-014d5d035eac service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:48:49.505850 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb851f-c173-481d-8702-014d5d035eac service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:48:49.510462 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda066db-a5bd-4a31-a1e7-d25331af1660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:48:49.511333 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda066db-a5bd-4a31-a1e7-d25331af1660 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:48:49.511615 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda066db-a5bd-4a31-a1e7-d25331af1660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:48:49.512053 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda066db-a5bd-4a31-a1e7-d25331af1660 admin admin] PATH_INFO: `/v3/users/e0c898b4a62a4b49800e7f97e2f54863` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:48:49.513364 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda066db-a5bd-4a31-a1e7-d25331af1660 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0c898b4a62a4b49800e7f97e2f54863)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:48:49.515534 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda066db-a5bd-4a31-a1e7-d25331af1660 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:48:49.563321 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-dda066db-a5bd-4a31-a1e7-d25331af1660 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0c898b4a62a4b49800e7f97e2f54863'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:48:49.564004 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-dda066db-a5bd-4a31-a1e7-d25331af1660 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0c898b4a62a4b49800e7f97e2f54863'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:48:49.564606 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-dda066db-a5bd-4a31-a1e7-d25331af1660 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0c898b4a62a4b49800e7f97e2f54863'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:48:49.576429 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-dda066db-a5bd-4a31-a1e7-d25331af1660 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0c898b4a62a4b49800e7f97e2f54863'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:48:49.584565 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-dda066db-a5bd-4a31-a1e7-d25331af1660 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0c898b4a62a4b49800e7f97e2f54863'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:48:49.599315 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1152/2307] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:48:49 2022] DELETE /identity/v3/users/e0c898b4a62a4b49800e7f97e2f54863 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:48:49.604203 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a8c26-a97a-42c4-a357-918c1e8d9368 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:48:49.604433 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a8c26-a97a-42c4-a357-918c1e8d9368 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:48:49.604714 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a8c26-a97a-42c4-a357-918c1e8d9368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:48:49.622680 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-ad0a8c26-a97a-42c4-a357-918c1e8d9368 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:48:49.623871 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-ad0a8c26-a97a-42c4-a357-918c1e8d9368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:48:49.682050 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1156/2308] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:48:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:48:49.691824 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda066db-a5bd-4a31-a1e7-d25331af1660 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:48:49.693237 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-dda066db-a5bd-4a31-a1e7-d25331af1660 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:48:49.703016 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:48:49.751586 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda066db-a5bd-4a31-a1e7-d25331af1660 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:48:49.755715 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aa6570-abd3-4eea-afbc-44a50d6518a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:48:49.756386 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa6570-abd3-4eea-afbc-44a50d6518a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:48:49.756669 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa6570-abd3-4eea-afbc-44a50d6518a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:48:49.757009 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa6570-abd3-4eea-afbc-44a50d6518a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:48:49.765776 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aa6570-abd3-4eea-afbc-44a50d6518a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:48:49.767194 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aa6570-abd3-4eea-afbc-44a50d6518a9 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:48:49.777179 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1153/2309] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:48:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:48:50.049678 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a8c26-a97a-42c4-a357-918c1e8d9368 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:48:50.051266 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-ad0a8c26-a97a-42c4-a357-918c1e8d9368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:48:50.064203 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a8c26-a97a-42c4-a357-918c1e8d9368 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:48:50.070059 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa5c2bf-e9e3-47e3-bc7d-b75e740607a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:48:50.070449 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5c2bf-e9e3-47e3-bc7d-b75e740607a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:48:50.070740 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5c2bf-e9e3-47e3-bc7d-b75e740607a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:48:50.071021 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5c2bf-e9e3-47e3-bc7d-b75e740607a0 admin admin] PATH_INFO: `/v3/projects/75dafb877f6c448daa0a8903aaf81494` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:48:50.072273 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa5c2bf-e9e3-47e3-bc7d-b75e740607a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75dafb877f6c448daa0a8903aaf81494)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:48:50.074233 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa5c2bf-e9e3-47e3-bc7d-b75e740607a0 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:48:50.134861 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-afa5c2bf-e9e3-47e3-bc7d-b75e740607a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75dafb877f6c448daa0a8903aaf81494', 'request_id': 'req-afa5c2bf-e9e3-47e3-bc7d-b75e740607a0'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:48:50.140842 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-afa5c2bf-e9e3-47e3-bc7d-b75e740607a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75dafb877f6c448daa0a8903aaf81494', 'request_id': 'req-afa5c2bf-e9e3-47e3-bc7d-b75e740607a0'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:48:50.148308 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-afa5c2bf-e9e3-47e3-bc7d-b75e740607a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75dafb877f6c448daa0a8903aaf81494', 'request_id': 'req-afa5c2bf-e9e3-47e3-bc7d-b75e740607a0'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:48:50.160503 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-afa5c2bf-e9e3-47e3-bc7d-b75e740607a0 admin admin] The token cache is being invalidate because project 75dafb877f6c448daa0a8903aaf81494 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:48:50.160798 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-afa5c2bf-e9e3-47e3-bc7d-b75e740607a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:48:50.161475 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-afa5c2bf-e9e3-47e3-bc7d-b75e740607a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:48:50.163017 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1157/2310] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:48:50 2022] DELETE /identity/v3/projects/75dafb877f6c448daa0a8903aaf81494 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:48:50.166946 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aa6570-abd3-4eea-afbc-44a50d6518a9 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:48:50.177088 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aa6570-abd3-4eea-afbc-44a50d6518a9 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:48:50.232573 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e120c9cc-0fc5-431c-b3f9-d91934f98485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:48:50.233456 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120c9cc-0fc5-431c-b3f9-d91934f98485 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:48:50.233744 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120c9cc-0fc5-431c-b3f9-d91934f98485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:48:50.234025 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120c9cc-0fc5-431c-b3f9-d91934f98485 admin admin] PATH_INFO: `/v3/users/4de8c7d22e9d4024aeb56e40861ef831` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:48:50.235210 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e120c9cc-0fc5-431c-b3f9-d91934f98485 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4de8c7d22e9d4024aeb56e40861ef831)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:48:50.237164 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e120c9cc-0fc5-431c-b3f9-d91934f98485 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:48:50.282657 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e120c9cc-0fc5-431c-b3f9-d91934f98485 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4de8c7d22e9d4024aeb56e40861ef831'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:48:50.283285 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e120c9cc-0fc5-431c-b3f9-d91934f98485 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4de8c7d22e9d4024aeb56e40861ef831'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:48:50.283891 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e120c9cc-0fc5-431c-b3f9-d91934f98485 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4de8c7d22e9d4024aeb56e40861ef831'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:48:50.295620 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e120c9cc-0fc5-431c-b3f9-d91934f98485 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4de8c7d22e9d4024aeb56e40861ef831'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:48:50.302966 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e120c9cc-0fc5-431c-b3f9-d91934f98485 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4de8c7d22e9d4024aeb56e40861ef831'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:48:50.315212 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1154/2311] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:48:50 2022] DELETE /identity/v3/users/4de8c7d22e9d4024aeb56e40861ef831 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:48:50.575707 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa5c2bf-e9e3-47e3-bc7d-b75e740607a0 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:48:50.577178 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-afa5c2bf-e9e3-47e3-bc7d-b75e740607a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:48:50.593885 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa5c2bf-e9e3-47e3-bc7d-b75e740607a0 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:48:50.603689 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:48:50.652216 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c99db3-a6de-4f0e-b988-fb1a56ab2c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:48:50.653087 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c99db3-a6de-4f0e-b988-fb1a56ab2c93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:48:50.653376 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c99db3-a6de-4f0e-b988-fb1a56ab2c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:48:50.653655 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c99db3-a6de-4f0e-b988-fb1a56ab2c93 admin admin] PATH_INFO: `/v3/projects/e2d534f3e46148bcb259aa99bbd85a91` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:48:50.654834 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c99db3-a6de-4f0e-b988-fb1a56ab2c93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2d534f3e46148bcb259aa99bbd85a91)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:48:50.656815 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c99db3-a6de-4f0e-b988-fb1a56ab2c93 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:48:50.702185 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-23c99db3-a6de-4f0e-b988-fb1a56ab2c93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2d534f3e46148bcb259aa99bbd85a91', 'request_id': 'req-23c99db3-a6de-4f0e-b988-fb1a56ab2c93'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:48:50.707598 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-23c99db3-a6de-4f0e-b988-fb1a56ab2c93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2d534f3e46148bcb259aa99bbd85a91', 'request_id': 'req-23c99db3-a6de-4f0e-b988-fb1a56ab2c93'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:48:50.714755 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-23c99db3-a6de-4f0e-b988-fb1a56ab2c93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2d534f3e46148bcb259aa99bbd85a91', 'request_id': 'req-23c99db3-a6de-4f0e-b988-fb1a56ab2c93'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:48:50.726216 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-23c99db3-a6de-4f0e-b988-fb1a56ab2c93 admin admin] The token cache is being invalidate because project e2d534f3e46148bcb259aa99bbd85a91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:48:50.726509 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-23c99db3-a6de-4f0e-b988-fb1a56ab2c93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:48:50.727142 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-23c99db3-a6de-4f0e-b988-fb1a56ab2c93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:48:50.728768 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1158/2312] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:48:50 2022] DELETE /identity/v3/projects/e2d534f3e46148bcb259aa99bbd85a91 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:48:50.732803 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e120c9cc-0fc5-431c-b3f9-d91934f98485 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:48:50.734200 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e120c9cc-0fc5-431c-b3f9-d91934f98485 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:48:50.747443 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e120c9cc-0fc5-431c-b3f9-d91934f98485 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:48:50.774035 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:48:50.806738 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d69f68-d59d-4e47-8784-b48483d863c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:48:50.807630 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d69f68-d59d-4e47-8784-b48483d863c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:48:50.807910 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d69f68-d59d-4e47-8784-b48483d863c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:48:50.808209 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d69f68-d59d-4e47-8784-b48483d863c4 admin admin] PATH_INFO: `/v3/users/f7b907ae5c754281a54a64cd028cba8e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:48:50.809375 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d69f68-d59d-4e47-8784-b48483d863c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7b907ae5c754281a54a64cd028cba8e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:48:50.811269 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d69f68-d59d-4e47-8784-b48483d863c4 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:48:50.859747 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d2d69f68-d59d-4e47-8784-b48483d863c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7b907ae5c754281a54a64cd028cba8e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:48:50.860437 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d2d69f68-d59d-4e47-8784-b48483d863c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7b907ae5c754281a54a64cd028cba8e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:48:50.861053 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d2d69f68-d59d-4e47-8784-b48483d863c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7b907ae5c754281a54a64cd028cba8e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:48:50.872865 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d2d69f68-d59d-4e47-8784-b48483d863c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7b907ae5c754281a54a64cd028cba8e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:48:50.879631 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d2d69f68-d59d-4e47-8784-b48483d863c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7b907ae5c754281a54a64cd028cba8e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:48:50.891598 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1155/2313] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:48:50 2022] DELETE /identity/v3/users/f7b907ae5c754281a54a64cd028cba8e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:48:51.416927 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c99db3-a6de-4f0e-b988-fb1a56ab2c93 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:48:51.418408 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-23c99db3-a6de-4f0e-b988-fb1a56ab2c93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:48:51.433697 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c99db3-a6de-4f0e-b988-fb1a56ab2c93 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:48:51.495853 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8886981d-5e9d-4184-9852-1ec8c6cf2aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:48:51.496749 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886981d-5e9d-4184-9852-1ec8c6cf2aa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:48:51.497034 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886981d-5e9d-4184-9852-1ec8c6cf2aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:48:51.497315 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886981d-5e9d-4184-9852-1ec8c6cf2aa5 admin admin] PATH_INFO: `/v3/projects/01bcc4bbb0a7417ebc7ad43f7bfb6b11` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:48:51.498558 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8886981d-5e9d-4184-9852-1ec8c6cf2aa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01bcc4bbb0a7417ebc7ad43f7bfb6b11)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:48:51.500530 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8886981d-5e9d-4184-9852-1ec8c6cf2aa5 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:48:51.545543 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:48:51.548516 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-8886981d-5e9d-4184-9852-1ec8c6cf2aa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01bcc4bbb0a7417ebc7ad43f7bfb6b11', 'request_id': 'req-8886981d-5e9d-4184-9852-1ec8c6cf2aa5'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:48:51.556206 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-8886981d-5e9d-4184-9852-1ec8c6cf2aa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01bcc4bbb0a7417ebc7ad43f7bfb6b11', 'request_id': 'req-8886981d-5e9d-4184-9852-1ec8c6cf2aa5'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:48:51.563196 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-8886981d-5e9d-4184-9852-1ec8c6cf2aa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01bcc4bbb0a7417ebc7ad43f7bfb6b11', 'request_id': 'req-8886981d-5e9d-4184-9852-1ec8c6cf2aa5'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:48:51.574243 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-8886981d-5e9d-4184-9852-1ec8c6cf2aa5 admin admin] The token cache is being invalidate because project 01bcc4bbb0a7417ebc7ad43f7bfb6b11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:48:51.574552 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-8886981d-5e9d-4184-9852-1ec8c6cf2aa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:48:51.575163 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-8886981d-5e9d-4184-9852-1ec8c6cf2aa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:48:51.576732 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1159/2314] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:48:51 2022] DELETE /identity/v3/projects/01bcc4bbb0a7417ebc7ad43f7bfb6b11 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:48:51.583164 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df9d57-7c40-4713-b1ec-43b206c0b6dc None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:48:51.583682 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df9d57-7c40-4713-b1ec-43b206c0b6dc None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:48:51.583796 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df9d57-7c40-4713-b1ec-43b206c0b6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:48:51.601379 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-17df9d57-7c40-4713-b1ec-43b206c0b6dc None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:48:51.602574 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-17df9d57-7c40-4713-b1ec-43b206c0b6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:48:51.662214 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1156/2315] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:48:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:48:51.670546 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4b2cc-8408-4ca5-9849-ccbcc094a4ea None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:48:51.670930 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4b2cc-8408-4ca5-9849-ccbcc094a4ea None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:48:51.671267 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4b2cc-8408-4ca5-9849-ccbcc094a4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:48:51.689849 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-49f4b2cc-8408-4ca5-9849-ccbcc094a4ea None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:48:51.691046 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-49f4b2cc-8408-4ca5-9849-ccbcc094a4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:48:51.699135 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1160/2316] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:48:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:48:51.703411 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df9d57-7c40-4713-b1ec-43b206c0b6dc None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:48:51.713672 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df9d57-7c40-4713-b1ec-43b206c0b6dc None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:48:51.719447 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71128ae-f865-4d29-a310-09c57ea2f7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:48:51.720305 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71128ae-f865-4d29-a310-09c57ea2f7ac admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:48:51.720597 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71128ae-f865-4d29-a310-09c57ea2f7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:48:51.721589 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71128ae-f865-4d29-a310-09c57ea2f7ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:48:51.723278 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71128ae-f865-4d29-a310-09c57ea2f7ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:48:51.723608 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71128ae-f865-4d29-a310-09c57ea2f7ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:48:51.725251 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71128ae-f865-4d29-a310-09c57ea2f7ac admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:48:51.737237 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1157/2317] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:48:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:48:51.741644 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4b2cc-8408-4ca5-9849-ccbcc094a4ea None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:48:51.751020 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4b2cc-8408-4ca5-9849-ccbcc094a4ea None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:48:51.755600 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a719d821-68e1-4b13-a088-7de399427463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:48:51.756277 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719d821-68e1-4b13-a088-7de399427463 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:48:51.756558 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719d821-68e1-4b13-a088-7de399427463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:48:51.756833 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719d821-68e1-4b13-a088-7de399427463 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:48:51.757996 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a719d821-68e1-4b13-a088-7de399427463 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:48:51.759409 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a719d821-68e1-4b13-a088-7de399427463 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:48:51.785637 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1161/2318] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:48:51 2022] POST /identity/v3/projects => generated 365 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:48:51.788508 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71128ae-f865-4d29-a310-09c57ea2f7ac admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:48:51.798477 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71128ae-f865-4d29-a310-09c57ea2f7ac admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:48:51.831278 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:48:51.856833 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d33ed-4baf-41e4-8f31-5de8fd14e897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:48:51.857566 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d33ed-4baf-41e4-8f31-5de8fd14e897 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:48:51.857854 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d33ed-4baf-41e4-8f31-5de8fd14e897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:48:51.858532 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d33ed-4baf-41e4-8f31-5de8fd14e897 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:48:51.858819 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369d33ed-4baf-41e4-8f31-5de8fd14e897 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:48:51.860789 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369d33ed-4baf-41e4-8f31-5de8fd14e897 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:48:51.880553 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1158/2319] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:48:51 2022] POST /identity/v3/users => generated 283 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:48:51.884675 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a719d821-68e1-4b13-a088-7de399427463 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:48:51.894795 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a719d821-68e1-4b13-a088-7de399427463 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:48:51.900370 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30fb3df-76ba-4c5d-83ae-1a6edef34ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:48:51.901041 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30fb3df-76ba-4c5d-83ae-1a6edef34ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:48:51.901400 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30fb3df-76ba-4c5d-83ae-1a6edef34ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:48:51.901672 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30fb3df-76ba-4c5d-83ae-1a6edef34ac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:48:51.902399 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30fb3df-76ba-4c5d-83ae-1a6edef34ac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:48:51.904066 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30fb3df-76ba-4c5d-83ae-1a6edef34ac1 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:48:51.914644 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1162/2320] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:48:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:48:51.918592 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d33ed-4baf-41e4-8f31-5de8fd14e897 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:48:51.929202 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d33ed-4baf-41e4-8f31-5de8fd14e897 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:48:51.933900 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16d33b-a016-452b-9966-6ac25edc28cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:48:51.934579 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16d33b-a016-452b-9966-6ac25edc28cb admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:48:51.934862 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16d33b-a016-452b-9966-6ac25edc28cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:48:51.935141 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16d33b-a016-452b-9966-6ac25edc28cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:48:51.935906 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d16d33b-a016-452b-9966-6ac25edc28cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:48:51.937773 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d16d33b-a016-452b-9966-6ac25edc28cb admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:48:51.948501 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1159/2321] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:48:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:48:51.952618 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30fb3df-76ba-4c5d-83ae-1a6edef34ac1 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:48:51.962960 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30fb3df-76ba-4c5d-83ae-1a6edef34ac1 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:48:51.967798 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf601c1-a486-4d94-be77-d1fca4ed93bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:48:51.968712 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf601c1-a486-4d94-be77-d1fca4ed93bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:48:51.968994 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf601c1-a486-4d94-be77-d1fca4ed93bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:48:51.969268 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf601c1-a486-4d94-be77-d1fca4ed93bf admin admin] PATH_INFO: `/v3/projects/871d69ec855b4de9b81cf06d1e8182be/users/d1bc5127fe8f4a16ad458a6eaec12252/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:48:51.985358 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf601c1-a486-4d94-be77-d1fca4ed93bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=871d69ec855b4de9b81cf06d1e8182be, user_id=d1bc5127fe8f4a16ad458a6eaec12252, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:48:51.988099 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf601c1-a486-4d94-be77-d1fca4ed93bf admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:48:52.001866 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1163/2322] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:48:51 2022] PUT /identity/v3/projects/871d69ec855b4de9b81cf06d1e8182be/users/d1bc5127fe8f4a16ad458a6eaec12252/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:48:52.014013 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7fc05-b778-4a83-bfef-8184ea39ac4f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:48:52.014311 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7fc05-b778-4a83-bfef-8184ea39ac4f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:48:52.014599 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7fc05-b778-4a83-bfef-8184ea39ac4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:48:52.041989 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ddc7fc05-b778-4a83-bfef-8184ea39ac4f None None] MFA Rules not processed for user `d1bc5127fe8f4a16ad458a6eaec12252`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:48:52.043199 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ddc7fc05-b778-4a83-bfef-8184ea39ac4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:48:52.107169 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1160/2323] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:48:52 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:48:52.111491 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf601c1-a486-4d94-be77-d1fca4ed93bf admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:48:52.176716 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf601c1-a486-4d94-be77-d1fca4ed93bf admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:48:52.181438 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba0fd2-7aae-499b-8c36-a99a1ba7e274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:48:52.182107 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba0fd2-7aae-499b-8c36-a99a1ba7e274 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:48:52.182394 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba0fd2-7aae-499b-8c36-a99a1ba7e274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:48:52.182673 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba0fd2-7aae-499b-8c36-a99a1ba7e274 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:48:52.183376 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ba0fd2-7aae-499b-8c36-a99a1ba7e274 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:48:52.185311 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ba0fd2-7aae-499b-8c36-a99a1ba7e274 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:48:52.212518 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1164/2324] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:48:52 2022] POST /identity/v3/projects => generated 367 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:48:52.216310 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7fc05-b778-4a83-bfef-8184ea39ac4f None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:48:52.228084 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7fc05-b778-4a83-bfef-8184ea39ac4f None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:48:52.284196 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed11f3-76c0-4f41-a9a1-38d8f1c7ef1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:48:52.284865 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed11f3-76c0-4f41-a9a1-38d8f1c7ef1b admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:48:52.285674 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed11f3-76c0-4f41-a9a1-38d8f1c7ef1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:48:52.285950 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed11f3-76c0-4f41-a9a1-38d8f1c7ef1b admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:48:52.286635 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ed11f3-76c0-4f41-a9a1-38d8f1c7ef1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:48:52.288612 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ed11f3-76c0-4f41-a9a1-38d8f1c7ef1b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:48:52.309808 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1161/2325] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:48:52 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:48:52.313388 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba0fd2-7aae-499b-8c36-a99a1ba7e274 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:48:52.323670 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba0fd2-7aae-499b-8c36-a99a1ba7e274 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:48:52.328375 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e007dfbe-ec9e-4252-8f16-ca686a66065c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:48:52.329020 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e007dfbe-ec9e-4252-8f16-ca686a66065c admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:48:52.329310 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e007dfbe-ec9e-4252-8f16-ca686a66065c admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:48:52.329595 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e007dfbe-ec9e-4252-8f16-ca686a66065c admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:48:52.330325 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e007dfbe-ec9e-4252-8f16-ca686a66065c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:48:52.332438 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e007dfbe-ec9e-4252-8f16-ca686a66065c admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:48:52.342958 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1165/2326] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:48:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:48:52.346783 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed11f3-76c0-4f41-a9a1-38d8f1c7ef1b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:48:52.357113 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed11f3-76c0-4f41-a9a1-38d8f1c7ef1b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:48:52.361671 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1cd0f-e912-41d8-bfd7-a3ea155b8604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:48:52.362828 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1cd0f-e912-41d8-bfd7-a3ea155b8604 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:48:52.363157 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1cd0f-e912-41d8-bfd7-a3ea155b8604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:48:52.363477 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1cd0f-e912-41d8-bfd7-a3ea155b8604 admin admin] PATH_INFO: `/v3/projects/5238a36d892d49179ed075524b4f2529/users/46bd096750c84be6a32b51f413169ef6/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:48:52.378486 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb1cd0f-e912-41d8-bfd7-a3ea155b8604 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5238a36d892d49179ed075524b4f2529, user_id=46bd096750c84be6a32b51f413169ef6, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:48:52.381229 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb1cd0f-e912-41d8-bfd7-a3ea155b8604 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:48:52.393807 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1162/2327] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:48:52 2022] PUT /identity/v3/projects/5238a36d892d49179ed075524b4f2529/users/46bd096750c84be6a32b51f413169ef6/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:48:52.398203 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e007dfbe-ec9e-4252-8f16-ca686a66065c admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:48:52.408150 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e007dfbe-ec9e-4252-8f16-ca686a66065c admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:48:52.449421 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:48:52.466552 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71a920-ab5b-4e85-9cb3-b8694ff0a818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:48:52.467217 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71a920-ab5b-4e85-9cb3-b8694ff0a818 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:48:52.467502 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71a920-ab5b-4e85-9cb3-b8694ff0a818 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:48:52.467780 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71a920-ab5b-4e85-9cb3-b8694ff0a818 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:48:52.468538 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa71a920-ab5b-4e85-9cb3-b8694ff0a818 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:48:52.470119 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa71a920-ab5b-4e85-9cb3-b8694ff0a818 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:48:52.480510 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1166/2328] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:48:52 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:48:52.484536 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1cd0f-e912-41d8-bfd7-a3ea155b8604 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:48:52.494661 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1cd0f-e912-41d8-bfd7-a3ea155b8604 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:48:52.499154 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072885d5-8585-4278-9a22-7567fc949f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:48:52.500048 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072885d5-8585-4278-9a22-7567fc949f12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:48:52.500332 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072885d5-8585-4278-9a22-7567fc949f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:48:52.500606 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072885d5-8585-4278-9a22-7567fc949f12 admin admin] PATH_INFO: `/v3/projects/5238a36d892d49179ed075524b4f2529/users/46bd096750c84be6a32b51f413169ef6/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:48:52.502556 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072885d5-8585-4278-9a22-7567fc949f12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5238a36d892d49179ed075524b4f2529, user_id=46bd096750c84be6a32b51f413169ef6, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:48:52.505199 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072885d5-8585-4278-9a22-7567fc949f12 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:48:52.508163 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:48:52.516216 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1163/2329] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:48:52 2022] PUT /identity/v3/projects/5238a36d892d49179ed075524b4f2529/users/46bd096750c84be6a32b51f413169ef6/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:48:52.526504 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185f0fd-2051-4000-b382-2488ebdaf766 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:48:52.526802 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185f0fd-2051-4000-b382-2488ebdaf766 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:48:52.527114 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185f0fd-2051-4000-b382-2488ebdaf766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:48:52.553515 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-2185f0fd-2051-4000-b382-2488ebdaf766 None None] MFA Rules not processed for user `46bd096750c84be6a32b51f413169ef6`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:48:52.554710 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-2185f0fd-2051-4000-b382-2488ebdaf766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:48:52.627653 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1167/2330] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:48:52 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:48:52.639087 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072885d5-8585-4278-9a22-7567fc949f12 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:48:52.640839 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-072885d5-8585-4278-9a22-7567fc949f12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:48:52.696937 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072885d5-8585-4278-9a22-7567fc949f12 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:48:52.700156 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5af238-b3bc-4a3e-8343-c301dcba337f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:48:52.700790 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5af238-b3bc-4a3e-8343-c301dcba337f service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:48:52.701399 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5af238-b3bc-4a3e-8343-c301dcba337f service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:48:52.701689 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5af238-b3bc-4a3e-8343-c301dcba337f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:48:52.710914 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5af238-b3bc-4a3e-8343-c301dcba337f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:48:52.712366 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5af238-b3bc-4a3e-8343-c301dcba337f service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:48:52.721852 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1164/2331] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:48:52 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:48:52.796007 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2185f0fd-2051-4000-b382-2488ebdaf766 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:48:52.805521 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2185f0fd-2051-4000-b382-2488ebdaf766 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:48:52.809178 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d30ae2c-46f9-4236-881e-751cb187cf1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:48:52.809819 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30ae2c-46f9-4236-881e-751cb187cf1f service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:48:52.810111 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30ae2c-46f9-4236-881e-751cb187cf1f service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:48:52.810398 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30ae2c-46f9-4236-881e-751cb187cf1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:48:52.868108 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d30ae2c-46f9-4236-881e-751cb187cf1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:48:52.869541 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d30ae2c-46f9-4236-881e-751cb187cf1f service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:48:52.878449 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1168/2332] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:48:52 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:49:02.717384 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=28 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:49:02.874378 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=71 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:50:52.617945 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5af238-b3bc-4a3e-8343-c301dcba337f service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:50:52.619326 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ea5af238-b3bc-4a3e-8343-c301dcba337f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:50:52.687986 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5af238-b3bc-4a3e-8343-c301dcba337f service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:50:52.692931 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58579723-44ab-45ca-9f5a-32f1701755bb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59294bff27c4b3f8aaeeab48ed35a0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:50:52.693577 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58579723-44ab-45ca-9f5a-32f1701755bb service placement] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:50:52.693861 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58579723-44ab-45ca-9f5a-32f1701755bb service placement] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:50:52.694141 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58579723-44ab-45ca-9f5a-32f1701755bb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:50:52.695867 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-58579723-44ab-45ca-9f5a-32f1701755bb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:50:52.707053 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58579723-44ab-45ca-9f5a-32f1701755bb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:50:52.708686 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58579723-44ab-45ca-9f5a-32f1701755bb service placement] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:50:52.718956 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1165/2333] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:50:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:51:02.714753 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=32 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:51:36.892408 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d30ae2c-46f9-4236-881e-751cb187cf1f service cinder] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:51:36.893847 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-0d30ae2c-46f9-4236-881e-751cb187cf1f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:51:36.905003 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d30ae2c-46f9-4236-881e-751cb187cf1f service cinder] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:51:36.908565 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d41b45e-d688-439d-8762-12bb759c4354 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:51:36.909204 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41b45e-d688-439d-8762-12bb759c4354 service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:51:36.909491 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41b45e-d688-439d-8762-12bb759c4354 service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:51:36.909771 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41b45e-d688-439d-8762-12bb759c4354 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:51:36.911488 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-9d41b45e-d688-439d-8762-12bb759c4354 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:51:36.969848 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d41b45e-d688-439d-8762-12bb759c4354 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:51:36.971286 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d41b45e-d688-439d-8762-12bb759c4354 service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:51:36.980691 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1169/2334] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:51:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:51:46.976100 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=28 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:52:57.925423 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58579723-44ab-45ca-9f5a-32f1701755bb service placement] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:52:57.926835 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-58579723-44ab-45ca-9f5a-32f1701755bb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:52:57.983744 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58579723-44ab-45ca-9f5a-32f1701755bb service placement] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:52:57.987358 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd9ced-4a56-4d8c-9dff-12f3046d610a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:52:57.988037 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd9ced-4a56-4d8c-9dff-12f3046d610a service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:52:57.988327 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd9ced-4a56-4d8c-9dff-12f3046d610a service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:52:57.988610 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd9ced-4a56-4d8c-9dff-12f3046d610a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:52:57.990384 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-cbbd9ced-4a56-4d8c-9dff-12f3046d610a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:52:57.999740 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd9ced-4a56-4d8c-9dff-12f3046d610a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:52:58.001192 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd9ced-4a56-4d8c-9dff-12f3046d610a service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:52:58.009103 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1166/2335] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:52:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 20:53:08.005552 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=26 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:53:37.260024 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d41b45e-d688-439d-8762-12bb759c4354 service cinder] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:53:37.268443 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d41b45e-d688-439d-8762-12bb759c4354 service cinder] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:53:37.272042 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4641e-569f-42d1-bb53-c6c670cdadce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:53:37.272686 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4641e-569f-42d1-bb53-c6c670cdadce service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:53:37.272972 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4641e-569f-42d1-bb53-c6c670cdadce service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:53:37.273253 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4641e-569f-42d1-bb53-c6c670cdadce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:53:37.275010 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-5bb4641e-569f-42d1-bb53-c6c670cdadce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:53:37.342203 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb4641e-569f-42d1-bb53-c6c670cdadce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:53:37.343628 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb4641e-569f-42d1-bb53-c6c670cdadce service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:53:37.362389 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1170/2336] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:53:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:53:37.404851 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd9ced-4a56-4d8c-9dff-12f3046d610a service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:53:37.413858 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd9ced-4a56-4d8c-9dff-12f3046d610a service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:53:37.417365 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c51cfe-fb2d-4cd7-861b-933895922d9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:53:37.417993 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c51cfe-fb2d-4cd7-861b-933895922d9e service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:53:37.418892 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c51cfe-fb2d-4cd7-861b-933895922d9e service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:53:37.419174 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c51cfe-fb2d-4cd7-861b-933895922d9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:53:37.420944 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e3c51cfe-fb2d-4cd7-861b-933895922d9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:53:37.486500 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c51cfe-fb2d-4cd7-861b-933895922d9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:53:37.487854 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c51cfe-fb2d-4cd7-861b-933895922d9e service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:53:37.505368 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1167/2337] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:53:37 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:53:37.775566 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4641e-569f-42d1-bb53-c6c670cdadce service cinder] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:53:37.781008 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-5bb4641e-569f-42d1-bb53-c6c670cdadce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:53:37.793556 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4641e-569f-42d1-bb53-c6c670cdadce service cinder] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:53:37.797684 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae522b40-3245-4503-84d3-3abc230365e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:53:37.798768 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae522b40-3245-4503-84d3-3abc230365e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:53:37.799238 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae522b40-3245-4503-84d3-3abc230365e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:53:37.799698 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae522b40-3245-4503-84d3-3abc230365e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:53:37.802003 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-ae522b40-3245-4503-84d3-3abc230365e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:53:37.823160 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c51cfe-fb2d-4cd7-861b-933895922d9e service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:53:37.833284 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c51cfe-fb2d-4cd7-861b-933895922d9e service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:53:37.842243 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0068b9d3-c00d-465f-b0fe-2cc01c12d9f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:53:37.842925 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068b9d3-c00d-465f-b0fe-2cc01c12d9f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:53:37.843223 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068b9d3-c00d-465f-b0fe-2cc01c12d9f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:53:37.843502 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068b9d3-c00d-465f-b0fe-2cc01c12d9f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:53:37.845416 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0068b9d3-c00d-465f-b0fe-2cc01c12d9f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:53:37.881766 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae522b40-3245-4503-84d3-3abc230365e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:53:37.883203 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae522b40-3245-4503-84d3-3abc230365e5 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:53:37.892905 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1171/2338] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:53:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:53:37.913803 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0068b9d3-c00d-465f-b0fe-2cc01c12d9f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:53:37.915252 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0068b9d3-c00d-465f-b0fe-2cc01c12d9f1 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:53:37.925556 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1168/2339] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:53:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:53:41.187487 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae522b40-3245-4503-84d3-3abc230365e5 service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:53:41.188530 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-ae522b40-3245-4503-84d3-3abc230365e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:53:41.213475 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae522b40-3245-4503-84d3-3abc230365e5 service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:53:41.223336 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb61e35a-304f-406f-bee3-f884e5ff495b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59294bff27c4b3f8aaeeab48ed35a0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:53:41.229501 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61e35a-304f-406f-bee3-f884e5ff495b service placement] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:53:41.230084 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61e35a-304f-406f-bee3-f884e5ff495b service placement] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:53:41.231385 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61e35a-304f-406f-bee3-f884e5ff495b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:53:41.233610 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-eb61e35a-304f-406f-bee3-f884e5ff495b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:53:41.251108 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb61e35a-304f-406f-bee3-f884e5ff495b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:53:41.253213 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb61e35a-304f-406f-bee3-f884e5ff495b service placement] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:53:41.274187 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1172/2340] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:53:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:53:41.298745 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0068b9d3-c00d-465f-b0fe-2cc01c12d9f1 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:53:41.302253 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0068b9d3-c00d-465f-b0fe-2cc01c12d9f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:53:41.335473 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0068b9d3-c00d-465f-b0fe-2cc01c12d9f1 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:53:41.344952 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb61e35a-304f-406f-bee3-f884e5ff495b service placement] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:53:41.365450 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb61e35a-304f-406f-bee3-f884e5ff495b service placement] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:53:41.367596 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98350ca0-226b-46fc-991c-eefc9251fa46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:53:41.372146 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98350ca0-226b-46fc-991c-eefc9251fa46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:53:41.372439 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98350ca0-226b-46fc-991c-eefc9251fa46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:53:41.372724 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98350ca0-226b-46fc-991c-eefc9251fa46 admin admin] PATH_INFO: `/v3/users/4f3b5970d9534441a2d208633b2e9942` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:53:41.388138 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98350ca0-226b-46fc-991c-eefc9251fa46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f3b5970d9534441a2d208633b2e9942)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:53:41.390214 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98350ca0-226b-46fc-991c-eefc9251fa46 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:53:41.398711 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc35c988-9f04-412b-a72f-97b960db3776 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59294bff27c4b3f8aaeeab48ed35a0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:53:41.400640 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35c988-9f04-412b-a72f-97b960db3776 service placement] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:53:41.401155 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35c988-9f04-412b-a72f-97b960db3776 service placement] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:53:41.401636 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35c988-9f04-412b-a72f-97b960db3776 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:53:41.405789 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-fc35c988-9f04-412b-a72f-97b960db3776 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:53:41.441399 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc35c988-9f04-412b-a72f-97b960db3776 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:53:41.444357 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc35c988-9f04-412b-a72f-97b960db3776 service placement] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:53:41.476445 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1173/2341] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:53:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 20:53:41.485441 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc35c988-9f04-412b-a72f-97b960db3776 service placement] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:53:41.487329 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-98350ca0-226b-46fc-991c-eefc9251fa46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f3b5970d9534441a2d208633b2e9942'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:53:41.487494 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-fc35c988-9f04-412b-a72f-97b960db3776 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:53:41.488074 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-98350ca0-226b-46fc-991c-eefc9251fa46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f3b5970d9534441a2d208633b2e9942'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:53:41.493009 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-98350ca0-226b-46fc-991c-eefc9251fa46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f3b5970d9534441a2d208633b2e9942'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:53:41.517819 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-98350ca0-226b-46fc-991c-eefc9251fa46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f3b5970d9534441a2d208633b2e9942'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:53:41.521171 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc35c988-9f04-412b-a72f-97b960db3776 service placement] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:53:41.524742 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:53:41.527028 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f4766-97b0-4f0b-8aae-0d4ab37a4668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:53:41.528059 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f4766-97b0-4f0b-8aae-0d4ab37a4668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:53:41.528401 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f4766-97b0-4f0b-8aae-0d4ab37a4668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:53:41.528686 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f4766-97b0-4f0b-8aae-0d4ab37a4668 admin admin] PATH_INFO: `/v3/users/4080825b9e154e808a9418fa8d6db987` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:53:41.530018 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8f4766-97b0-4f0b-8aae-0d4ab37a4668 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4080825b9e154e808a9418fa8d6db987)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:53:41.532829 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8f4766-97b0-4f0b-8aae-0d4ab37a4668 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:53:41.544182 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-98350ca0-226b-46fc-991c-eefc9251fa46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f3b5970d9534441a2d208633b2e9942'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:53:41.561630 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1169/2342] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:53:41 2022] DELETE /identity/v3/users/4f3b5970d9534441a2d208633b2e9942 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:53:41.590817 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:53:41.593903 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-6e8f4766-97b0-4f0b-8aae-0d4ab37a4668 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4080825b9e154e808a9418fa8d6db987'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:53:41.594657 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-6e8f4766-97b0-4f0b-8aae-0d4ab37a4668 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4080825b9e154e808a9418fa8d6db987'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:53:41.606496 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-6e8f4766-97b0-4f0b-8aae-0d4ab37a4668 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4080825b9e154e808a9418fa8d6db987'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:53:41.622832 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-6e8f4766-97b0-4f0b-8aae-0d4ab37a4668 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4080825b9e154e808a9418fa8d6db987'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:53:41.624080 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-6e8f4766-97b0-4f0b-8aae-0d4ab37a4668 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4080825b9e154e808a9418fa8d6db987'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:53:41.638453 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1174/2343] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:53:41 2022] DELETE /identity/v3/users/4080825b9e154e808a9418fa8d6db987 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:53:41.771596 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98350ca0-226b-46fc-991c-eefc9251fa46 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:53:41.773178 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-98350ca0-226b-46fc-991c-eefc9251fa46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:53:41.836902 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f4766-97b0-4f0b-8aae-0d4ab37a4668 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:53:41.838455 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-6e8f4766-97b0-4f0b-8aae-0d4ab37a4668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:53:41.862189 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98350ca0-226b-46fc-991c-eefc9251fa46 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:53:41.919201 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f4766-97b0-4f0b-8aae-0d4ab37a4668 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:53:41.922421 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb444537-81c8-440b-a8ca-1d2a1d0ab349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:53:41.923300 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb444537-81c8-440b-a8ca-1d2a1d0ab349 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:53:41.923593 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb444537-81c8-440b-a8ca-1d2a1d0ab349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:53:41.923876 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb444537-81c8-440b-a8ca-1d2a1d0ab349 admin admin] PATH_INFO: `/v3/projects/2ae73ae596ed45a080e3f0b8dcc4b389` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:53:41.924034 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f31ff0b-6885-4fa9-88a5-0d8e92252ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:53:41.924787 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31ff0b-6885-4fa9-88a5-0d8e92252ceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:53:41.925079 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31ff0b-6885-4fa9-88a5-0d8e92252ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:53:41.925214 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb444537-81c8-440b-a8ca-1d2a1d0ab349 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ae73ae596ed45a080e3f0b8dcc4b389)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:53:41.925361 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31ff0b-6885-4fa9-88a5-0d8e92252ceb admin admin] PATH_INFO: `/v3/projects/1bf055d91e7f47a090641c0ca0436442` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:53:41.926550 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f31ff0b-6885-4fa9-88a5-0d8e92252ceb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bf055d91e7f47a090641c0ca0436442)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:53:41.927030 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb444537-81c8-440b-a8ca-1d2a1d0ab349 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:53:41.928515 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f31ff0b-6885-4fa9-88a5-0d8e92252ceb admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:53:41.978614 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fb444537-81c8-440b-a8ca-1d2a1d0ab349 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ae73ae596ed45a080e3f0b8dcc4b389', 'request_id': 'req-fb444537-81c8-440b-a8ca-1d2a1d0ab349'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:53:41.983089 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-0f31ff0b-6885-4fa9-88a5-0d8e92252ceb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bf055d91e7f47a090641c0ca0436442', 'request_id': 'req-0f31ff0b-6885-4fa9-88a5-0d8e92252ceb'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:53:41.985911 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fb444537-81c8-440b-a8ca-1d2a1d0ab349 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ae73ae596ed45a080e3f0b8dcc4b389', 'request_id': 'req-fb444537-81c8-440b-a8ca-1d2a1d0ab349'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:53:41.989187 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-0f31ff0b-6885-4fa9-88a5-0d8e92252ceb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bf055d91e7f47a090641c0ca0436442', 'request_id': 'req-0f31ff0b-6885-4fa9-88a5-0d8e92252ceb'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:53:41.992167 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fb444537-81c8-440b-a8ca-1d2a1d0ab349 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ae73ae596ed45a080e3f0b8dcc4b389', 'request_id': 'req-fb444537-81c8-440b-a8ca-1d2a1d0ab349'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:53:41.996735 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-0f31ff0b-6885-4fa9-88a5-0d8e92252ceb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bf055d91e7f47a090641c0ca0436442', 'request_id': 'req-0f31ff0b-6885-4fa9-88a5-0d8e92252ceb'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:53:42.004958 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fb444537-81c8-440b-a8ca-1d2a1d0ab349 admin admin] The token cache is being invalidate because project 2ae73ae596ed45a080e3f0b8dcc4b389 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:53:42.005247 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fb444537-81c8-440b-a8ca-1d2a1d0ab349 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:53:42.005892 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fb444537-81c8-440b-a8ca-1d2a1d0ab349 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:53:42.007461 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1170/2344] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:53:41 2022] DELETE /identity/v3/projects/2ae73ae596ed45a080e3f0b8dcc4b389 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:53:42.008163 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-0f31ff0b-6885-4fa9-88a5-0d8e92252ceb admin admin] The token cache is being invalidate because project 1bf055d91e7f47a090641c0ca0436442 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:53:42.008448 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-0f31ff0b-6885-4fa9-88a5-0d8e92252ceb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:53:42.009089 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-0f31ff0b-6885-4fa9-88a5-0d8e92252ceb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:53:42.010967 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1175/2345] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:53:41 2022] DELETE /identity/v3/projects/1bf055d91e7f47a090641c0ca0436442 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:53:42.014312 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865ee09-97d1-4b22-bcff-17db890455c3 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:53:42.014883 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865ee09-97d1-4b22-bcff-17db890455c3 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:53:42.015334 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865ee09-97d1-4b22-bcff-17db890455c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:53:42.016684 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe3d24-9470-4b9f-b08e-2b54396db654 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:53:42.016975 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe3d24-9470-4b9f-b08e-2b54396db654 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:53:42.017257 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe3d24-9470-4b9f-b08e-2b54396db654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:53:42.033987 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c865ee09-97d1-4b22-bcff-17db890455c3 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:53:42.034715 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-e7fe3d24-9470-4b9f-b08e-2b54396db654 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:53:42.035218 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c865ee09-97d1-4b22-bcff-17db890455c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:53:42.035899 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-e7fe3d24-9470-4b9f-b08e-2b54396db654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:53:42.054724 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:53:42.081037 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:53:42.097807 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1176/2346] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:53:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 20:53:42.100503 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1171/2347] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:53:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:53:42.105814 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affe470-2404-4c00-b3a6-609bb84b4056 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:53:42.106670 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affe470-2404-4c00-b3a6-609bb84b4056 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:53:42.107172 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affe470-2404-4c00-b3a6-609bb84b4056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:53:42.108796 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf57799-07d4-4a43-abc0-11d98d856758 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:53:42.109088 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf57799-07d4-4a43-abc0-11d98d856758 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:53:42.109366 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf57799-07d4-4a43-abc0-11d98d856758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:53:42.126179 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-0affe470-2404-4c00-b3a6-609bb84b4056 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:53:42.127052 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ebf57799-07d4-4a43-abc0-11d98d856758 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:53:42.127391 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-0affe470-2404-4c00-b3a6-609bb84b4056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:53:42.128245 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ebf57799-07d4-4a43-abc0-11d98d856758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:53:42.135500 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1177/2348] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:53:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:53:42.137344 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1172/2349] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:53:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:53:42.139800 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0affe470-2404-4c00-b3a6-609bb84b4056 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:53:42.141099 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf57799-07d4-4a43-abc0-11d98d856758 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:53:42.148918 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0affe470-2404-4c00-b3a6-609bb84b4056 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:53:42.149872 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf57799-07d4-4a43-abc0-11d98d856758 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:53:42.154114 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e31dd-2b9d-40a2-a8e1-ff2f2f6c5d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:53:42.154762 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e31dd-2b9d-40a2-a8e1-ff2f2f6c5d12 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:53:42.154875 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c83dac7-a32e-41ce-879f-a6ae02b657ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:53:42.155054 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e31dd-2b9d-40a2-a8e1-ff2f2f6c5d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:53:42.155341 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e31dd-2b9d-40a2-a8e1-ff2f2f6c5d12 admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:53:42.155483 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83dac7-a32e-41ce-879f-a6ae02b657ce admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:53:42.155766 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83dac7-a32e-41ce-879f-a6ae02b657ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:53:42.156075 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83dac7-a32e-41ce-879f-a6ae02b657ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:53:42.156204 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e31dd-2b9d-40a2-a8e1-ff2f2f6c5d12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:53:42.156439 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e31dd-2b9d-40a2-a8e1-ff2f2f6c5d12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:53:42.156790 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c83dac7-a32e-41ce-879f-a6ae02b657ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:53:42.157096 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c83dac7-a32e-41ce-879f-a6ae02b657ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:53:42.158017 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e31dd-2b9d-40a2-a8e1-ff2f2f6c5d12 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:53:42.158667 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c83dac7-a32e-41ce-879f-a6ae02b657ce admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:53:42.170407 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1173/2350] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:53:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:53:42.174832 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1178/2351] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:53:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:53:42.174982 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c83dac7-a32e-41ce-879f-a6ae02b657ce admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:53:42.175661 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e31dd-2b9d-40a2-a8e1-ff2f2f6c5d12 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:53:42.184698 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c83dac7-a32e-41ce-879f-a6ae02b657ce admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:53:42.185956 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e31dd-2b9d-40a2-a8e1-ff2f2f6c5d12 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:53:42.189438 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62f0fc-8cee-4008-a5ad-5731c649deb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:53:42.190079 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62f0fc-8cee-4008-a5ad-5731c649deb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:53:42.190368 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62f0fc-8cee-4008-a5ad-5731c649deb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:53:42.190485 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a894ba97-1c3a-43cd-bbff-338e7fee690a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:53:42.190959 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62f0fc-8cee-4008-a5ad-5731c649deb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:53:42.191090 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894ba97-1c3a-43cd-bbff-338e7fee690a admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:53:42.191376 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894ba97-1c3a-43cd-bbff-338e7fee690a admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:53:42.191502 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe62f0fc-8cee-4008-a5ad-5731c649deb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:53:42.191655 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894ba97-1c3a-43cd-bbff-338e7fee690a admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:53:42.192365 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a894ba97-1c3a-43cd-bbff-338e7fee690a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:53:42.193320 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe62f0fc-8cee-4008-a5ad-5731c649deb1 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:53:42.194262 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a894ba97-1c3a-43cd-bbff-338e7fee690a admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:53:42.223364 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1174/2352] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:53:42 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 20:53:42.223579 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1179/2353] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:53:42 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:53:42.224299 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62f0fc-8cee-4008-a5ad-5731c649deb1 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:53:42.224451 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a894ba97-1c3a-43cd-bbff-338e7fee690a admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:53:42.286828 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62f0fc-8cee-4008-a5ad-5731c649deb1 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:53:42.287299 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a894ba97-1c3a-43cd-bbff-338e7fee690a admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:53:42.291652 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09720349-dcbb-49f9-8da9-bc2910a8724b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:53:42.291975 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb713c-5574-488b-b485-6ca3a1139e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:53:42.292358 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09720349-dcbb-49f9-8da9-bc2910a8724b admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:53:42.292650 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09720349-dcbb-49f9-8da9-bc2910a8724b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:53:42.292786 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb713c-5574-488b-b485-6ca3a1139e03 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:53:42.292933 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09720349-dcbb-49f9-8da9-bc2910a8724b admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:53:42.293551 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb713c-5574-488b-b485-6ca3a1139e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:53:42.293825 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb713c-5574-488b-b485-6ca3a1139e03 admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:53:42.294273 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09720349-dcbb-49f9-8da9-bc2910a8724b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:53:42.294512 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeb713c-5574-488b-b485-6ca3a1139e03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:53:42.296241 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09720349-dcbb-49f9-8da9-bc2910a8724b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:53:42.296454 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeb713c-5574-488b-b485-6ca3a1139e03 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:53:42.319796 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1175/2354] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:53:42 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 20:53:42.320400 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1180/2355] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:53:42 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:53:42.321537 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09720349-dcbb-49f9-8da9-bc2910a8724b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:53:42.321683 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb713c-5574-488b-b485-6ca3a1139e03 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:53:42.331386 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb713c-5574-488b-b485-6ca3a1139e03 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:53:42.332076 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09720349-dcbb-49f9-8da9-bc2910a8724b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:53:42.336083 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7cc586-5ac6-424c-a138-7d6bffeb4bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:53:42.336656 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae19b2a-b9d9-4d3e-bc59-09414da8df5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:53:42.336819 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7cc586-5ac6-424c-a138-7d6bffeb4bbf admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:53:42.337014 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7cc586-5ac6-424c-a138-7d6bffeb4bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:53:42.337295 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7cc586-5ac6-424c-a138-7d6bffeb4bbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:53:42.337422 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae19b2a-b9d9-4d3e-bc59-09414da8df5f admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:53:42.337575 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae19b2a-b9d9-4d3e-bc59-09414da8df5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:53:42.337853 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae19b2a-b9d9-4d3e-bc59-09414da8df5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:53:42.338022 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7cc586-5ac6-424c-a138-7d6bffeb4bbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:53:42.338573 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae19b2a-b9d9-4d3e-bc59-09414da8df5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:53:42.339653 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7cc586-5ac6-424c-a138-7d6bffeb4bbf admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:53:42.340328 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae19b2a-b9d9-4d3e-bc59-09414da8df5f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:53:42.352444 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1181/2356] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 20:53:42.352681 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1176/2357] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:53:42.353965 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7cc586-5ac6-424c-a138-7d6bffeb4bbf admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:53:42.354097 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae19b2a-b9d9-4d3e-bc59-09414da8df5f admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:53:42.363990 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7cc586-5ac6-424c-a138-7d6bffeb4bbf admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:53:42.364388 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae19b2a-b9d9-4d3e-bc59-09414da8df5f admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:53:42.368706 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97614f96-95ad-49b1-a387-9480c98ef2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:53:42.369028 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cd2516-fc1f-4f2b-9294-7696425f4c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:53:42.369350 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97614f96-95ad-49b1-a387-9480c98ef2cb admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:53:42.369639 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97614f96-95ad-49b1-a387-9480c98ef2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:53:42.369776 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd2516-fc1f-4f2b-9294-7696425f4c70 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:53:42.369944 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97614f96-95ad-49b1-a387-9480c98ef2cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:53:42.370061 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd2516-fc1f-4f2b-9294-7696425f4c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:53:42.370271 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd2516-fc1f-4f2b-9294-7696425f4c70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:53:42.370636 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97614f96-95ad-49b1-a387-9480c98ef2cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:53:42.371004 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cd2516-fc1f-4f2b-9294-7696425f4c70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:53:42.372905 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97614f96-95ad-49b1-a387-9480c98ef2cb admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:53:42.373222 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cd2516-fc1f-4f2b-9294-7696425f4c70 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:53:42.383791 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1177/2359] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:53:42.383966 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1182/2359] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 20:53:42.387978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cd2516-fc1f-4f2b-9294-7696425f4c70 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:53:42.388142 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97614f96-95ad-49b1-a387-9480c98ef2cb admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:53:42.397657 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cd2516-fc1f-4f2b-9294-7696425f4c70 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:53:42.397819 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97614f96-95ad-49b1-a387-9480c98ef2cb admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:53:42.402179 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaabec3-4df8-480e-9b92-1717bb2773e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:53:42.402357 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ebe433-b843-4305-aca0-9d2f7cd606b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:53:42.403075 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaabec3-4df8-480e-9b92-1717bb2773e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:53:42.403197 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebe433-b843-4305-aca0-9d2f7cd606b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:53:42.403364 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaabec3-4df8-480e-9b92-1717bb2773e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:53:42.403474 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebe433-b843-4305-aca0-9d2f7cd606b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:53:42.403639 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaabec3-4df8-480e-9b92-1717bb2773e5 admin admin] PATH_INFO: `/v3/projects/2d2458b8f12b481ca3e50b8dac971463/users/1ab6068b5e5e43428a637306a9049caa/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:53:42.403749 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebe433-b843-4305-aca0-9d2f7cd606b0 admin admin] PATH_INFO: `/v3/projects/242ac2b3713542b992fe1b555837ea02/users/cdf7951e127441579c2e8c80caf8ca28/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:53:42.418961 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaabec3-4df8-480e-9b92-1717bb2773e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d2458b8f12b481ca3e50b8dac971463, user_id=1ab6068b5e5e43428a637306a9049caa, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:53:42.419134 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ebe433-b843-4305-aca0-9d2f7cd606b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=242ac2b3713542b992fe1b555837ea02, user_id=cdf7951e127441579c2e8c80caf8ca28, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:53:42.421724 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ebe433-b843-4305-aca0-9d2f7cd606b0 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:53:42.421873 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaabec3-4df8-480e-9b92-1717bb2773e5 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:53:42.436763 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1183/2360] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:53:42 2022] PUT /identity/v3/projects/242ac2b3713542b992fe1b555837ea02/users/cdf7951e127441579c2e8c80caf8ca28/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:53:42.444117 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1178/2361] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:53:42 2022] PUT /identity/v3/projects/2d2458b8f12b481ca3e50b8dac971463/users/1ab6068b5e5e43428a637306a9049caa/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:53:42.446819 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bcf67d-1e3f-47f1-842b-5050083a6e1b None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:53:42.446967 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5639b8a-8ae1-4678-be27-1acbb6aa62fa None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:53:42.447117 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5639b8a-8ae1-4678-be27-1acbb6aa62fa None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:53:42.447238 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bcf67d-1e3f-47f1-842b-5050083a6e1b None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:53:42.447401 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5639b8a-8ae1-4678-be27-1acbb6aa62fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:53:42.447512 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bcf67d-1e3f-47f1-842b-5050083a6e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:53:42.474441 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-b5639b8a-8ae1-4678-be27-1acbb6aa62fa None None] MFA Rules not processed for user `1ab6068b5e5e43428a637306a9049caa`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:53:42.474711 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-81bcf67d-1e3f-47f1-842b-5050083a6e1b None None] MFA Rules not processed for user `cdf7951e127441579c2e8c80caf8ca28`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:53:42.475663 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b5639b8a-8ae1-4678-be27-1acbb6aa62fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:53:42.475900 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-81bcf67d-1e3f-47f1-842b-5050083a6e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:53:42.488653 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:53:42.523778 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:53:42.543901 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1179/2362] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:53:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:53:42.548129 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1184/2363] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:53:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:53:42.548291 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5639b8a-8ae1-4678-be27-1acbb6aa62fa None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:53:42.559856 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bcf67d-1e3f-47f1-842b-5050083a6e1b None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:53:42.561383 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-81bcf67d-1e3f-47f1-842b-5050083a6e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:53:42.613972 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5639b8a-8ae1-4678-be27-1acbb6aa62fa None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:53:42.618647 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa8be4-8908-4c5d-afde-6294a3d50452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:53:42.619315 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa8be4-8908-4c5d-afde-6294a3d50452 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:53:42.619606 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa8be4-8908-4c5d-afde-6294a3d50452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:53:42.619886 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa8be4-8908-4c5d-afde-6294a3d50452 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:53:42.620616 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aa8be4-8908-4c5d-afde-6294a3d50452 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:53:42.622546 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aa8be4-8908-4c5d-afde-6294a3d50452 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:53:42.650990 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1180/2364] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:53:42 2022] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 20:53:42.651944 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa8be4-8908-4c5d-afde-6294a3d50452 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:53:42.667507 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bcf67d-1e3f-47f1-842b-5050083a6e1b None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:53:42.713966 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa8be4-8908-4c5d-afde-6294a3d50452 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:53:42.719165 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce15e7a-5da7-4926-8656-a3dfc9b5b6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:53:42.719818 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce15e7a-5da7-4926-8656-a3dfc9b5b6e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:53:42.720141 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce15e7a-5da7-4926-8656-a3dfc9b5b6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:53:42.720425 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce15e7a-5da7-4926-8656-a3dfc9b5b6e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:53:42.721114 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce15e7a-5da7-4926-8656-a3dfc9b5b6e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:53:42.723027 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce15e7a-5da7-4926-8656-a3dfc9b5b6e3 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:53:42.735295 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a3d1c-78d9-4f35-b381-e2988c24bc3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3918fe05c8634bc39f3e295374701465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:53:42.736130 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a3d1c-78d9-4f35-b381-e2988c24bc3c service nova] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:53:42.736419 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a3d1c-78d9-4f35-b381-e2988c24bc3c service nova] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:53:42.736756 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a3d1c-78d9-4f35-b381-e2988c24bc3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:53:42.742871 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1181/2365] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:53:42 2022] POST /identity/v3/users => generated 296 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 20:53:42.747348 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce15e7a-5da7-4926-8656-a3dfc9b5b6e3 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:53:42.756979 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce15e7a-5da7-4926-8656-a3dfc9b5b6e3 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:53:42.762896 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf9797-fb92-4c43-889b-5c96dc382666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:53:42.763342 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf9797-fb92-4c43-889b-5c96dc382666 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:53:42.763628 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf9797-fb92-4c43-889b-5c96dc382666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:53:42.763908 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf9797-fb92-4c43-889b-5c96dc382666 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:53:42.764687 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cf9797-fb92-4c43-889b-5c96dc382666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:53:42.766263 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cf9797-fb92-4c43-889b-5c96dc382666 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:53:42.776352 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1182/2366] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 20:53:42.780259 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf9797-fb92-4c43-889b-5c96dc382666 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:53:42.789074 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:53:42.789927 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf9797-fb92-4c43-889b-5c96dc382666 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:53:42.795083 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf27bd0e-d41e-4406-be04-e7dc0e09c92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:53:42.796099 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27bd0e-d41e-4406-be04-e7dc0e09c92d admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:53:42.796391 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27bd0e-d41e-4406-be04-e7dc0e09c92d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:53:42.796678 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27bd0e-d41e-4406-be04-e7dc0e09c92d admin admin] PATH_INFO: `/v3/projects/c2ad3780f9bd4c15af9136f3e6766436/users/076bc0d50e8240cead28c2b02b2b5500/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:53:42.797621 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0a3d1c-78d9-4f35-b381-e2988c24bc3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:53:42.799232 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0a3d1c-78d9-4f35-b381-e2988c24bc3c service nova] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:53:42.809236 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1185/2367] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:53:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 20:53:42.812845 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf27bd0e-d41e-4406-be04-e7dc0e09c92d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2ad3780f9bd4c15af9136f3e6766436, user_id=076bc0d50e8240cead28c2b02b2b5500, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:53:42.815787 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf27bd0e-d41e-4406-be04-e7dc0e09c92d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:53:42.818858 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:53:42.850712 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1183/2368] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:53:42 2022] PUT /identity/v3/projects/c2ad3780f9bd4c15af9136f3e6766436/users/076bc0d50e8240cead28c2b02b2b5500/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:53:42.857114 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a3d1c-78d9-4f35-b381-e2988c24bc3c service nova] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:53:42.870534 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a3d1c-78d9-4f35-b381-e2988c24bc3c service nova] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:53:42.928649 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce521af-fe48-4d25-ab3f-b2d46bce95a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:53:42.929324 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce521af-fe48-4d25-ab3f-b2d46bce95a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:53:42.929611 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce521af-fe48-4d25-ab3f-b2d46bce95a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:53:42.930598 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce521af-fe48-4d25-ab3f-b2d46bce95a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:53:42.930866 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce521af-fe48-4d25-ab3f-b2d46bce95a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:53:42.932483 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce521af-fe48-4d25-ab3f-b2d46bce95a3 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:53:42.943000 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1186/2369] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:53:42.947140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf27bd0e-d41e-4406-be04-e7dc0e09c92d admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:53:42.958157 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf27bd0e-d41e-4406-be04-e7dc0e09c92d admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:53:42.963000 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26d8416-c6d5-4219-9751-c0027bded230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:53:42.963891 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d8416-c6d5-4219-9751-c0027bded230 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:53:42.964348 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d8416-c6d5-4219-9751-c0027bded230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:53:42.964640 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d8416-c6d5-4219-9751-c0027bded230 admin admin] PATH_INFO: `/v3/projects/c2ad3780f9bd4c15af9136f3e6766436/users/076bc0d50e8240cead28c2b02b2b5500/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:53:42.966613 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26d8416-c6d5-4219-9751-c0027bded230 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2ad3780f9bd4c15af9136f3e6766436, user_id=076bc0d50e8240cead28c2b02b2b5500, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:53:42.970415 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26d8416-c6d5-4219-9751-c0027bded230 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:53:42.981477 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1184/2370] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:53:42 2022] PUT /identity/v3/projects/c2ad3780f9bd4c15af9136f3e6766436/users/076bc0d50e8240cead28c2b02b2b5500/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:53:42.992797 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5522dd3a-bcb1-4715-821b-2c8504f2d2db None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:53:42.993096 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5522dd3a-bcb1-4715-821b-2c8504f2d2db None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:53:42.993379 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5522dd3a-bcb1-4715-821b-2c8504f2d2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:53:43.019868 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-5522dd3a-bcb1-4715-821b-2c8504f2d2db None None] MFA Rules not processed for user `076bc0d50e8240cead28c2b02b2b5500`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:53:43.021154 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-5522dd3a-bcb1-4715-821b-2c8504f2d2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:53:43.089221 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1187/2371] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:53:42 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:53:52.977131 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=7,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:53:53.086290 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=67 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:54:43.152997 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26d8416-c6d5-4219-9751-c0027bded230 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:54:43.215041 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26d8416-c6d5-4219-9751-c0027bded230 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:54:43.219627 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68eceda-780c-41fe-b41e-24419df06fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:54:43.220542 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68eceda-780c-41fe-b41e-24419df06fae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:54:43.220829 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68eceda-780c-41fe-b41e-24419df06fae admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:54:43.221108 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68eceda-780c-41fe-b41e-24419df06fae admin admin] PATH_INFO: `/v3/users/1ab6068b5e5e43428a637306a9049caa` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:54:43.222347 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68eceda-780c-41fe-b41e-24419df06fae admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ab6068b5e5e43428a637306a9049caa)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:54:43.224301 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68eceda-780c-41fe-b41e-24419df06fae admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:54:43.269784 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d68eceda-780c-41fe-b41e-24419df06fae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ab6068b5e5e43428a637306a9049caa'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:54:43.270449 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d68eceda-780c-41fe-b41e-24419df06fae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ab6068b5e5e43428a637306a9049caa'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:54:43.271043 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d68eceda-780c-41fe-b41e-24419df06fae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ab6068b5e5e43428a637306a9049caa'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:54:43.283240 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d68eceda-780c-41fe-b41e-24419df06fae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ab6068b5e5e43428a637306a9049caa'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:54:43.290193 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d68eceda-780c-41fe-b41e-24419df06fae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ab6068b5e5e43428a637306a9049caa'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:54:43.303075 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1185/2372] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:54:43 2022] DELETE /identity/v3/users/1ab6068b5e5e43428a637306a9049caa => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:54:43.307839 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d113b6-2c17-4bea-b85f-38d2a2a6a928 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:54:43.308355 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d113b6-2c17-4bea-b85f-38d2a2a6a928 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:54:43.308473 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d113b6-2c17-4bea-b85f-38d2a2a6a928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:54:43.325311 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-b9d113b6-2c17-4bea-b85f-38d2a2a6a928 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:54:43.326562 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-b9d113b6-2c17-4bea-b85f-38d2a2a6a928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:54:43.384587 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1188/2373] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:54:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:54:43.394141 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68eceda-780c-41fe-b41e-24419df06fae admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:54:43.395545 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d68eceda-780c-41fe-b41e-24419df06fae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:54:43.451734 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68eceda-780c-41fe-b41e-24419df06fae admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:54:43.455325 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df7615-9df4-4c13-aa1c-2afd903bf4df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:54:43.455992 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df7615-9df4-4c13-aa1c-2afd903bf4df service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:54:43.456284 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df7615-9df4-4c13-aa1c-2afd903bf4df service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:54:43.456575 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df7615-9df4-4c13-aa1c-2afd903bf4df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:54:43.465779 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15df7615-9df4-4c13-aa1c-2afd903bf4df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:54:43.467717 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15df7615-9df4-4c13-aa1c-2afd903bf4df service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:54:43.477182 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1186/2374] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:54:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:54:43.737872 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d113b6-2c17-4bea-b85f-38d2a2a6a928 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:54:43.739454 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-b9d113b6-2c17-4bea-b85f-38d2a2a6a928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:54:43.751655 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d113b6-2c17-4bea-b85f-38d2a2a6a928 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:54:43.756336 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f049a-f904-413b-801b-3e784532ca76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:54:43.757216 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f049a-f904-413b-801b-3e784532ca76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:54:43.757504 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f049a-f904-413b-801b-3e784532ca76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:54:43.757789 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f049a-f904-413b-801b-3e784532ca76 admin admin] PATH_INFO: `/v3/projects/2d2458b8f12b481ca3e50b8dac971463` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:54:43.758989 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f049a-f904-413b-801b-3e784532ca76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d2458b8f12b481ca3e50b8dac971463)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:54:43.761044 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f049a-f904-413b-801b-3e784532ca76 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:54:43.809622 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-c37f049a-f904-413b-801b-3e784532ca76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d2458b8f12b481ca3e50b8dac971463', 'request_id': 'req-c37f049a-f904-413b-801b-3e784532ca76'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:54:43.815038 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-c37f049a-f904-413b-801b-3e784532ca76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d2458b8f12b481ca3e50b8dac971463', 'request_id': 'req-c37f049a-f904-413b-801b-3e784532ca76'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:54:43.822061 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-c37f049a-f904-413b-801b-3e784532ca76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d2458b8f12b481ca3e50b8dac971463', 'request_id': 'req-c37f049a-f904-413b-801b-3e784532ca76'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:54:43.833360 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-c37f049a-f904-413b-801b-3e784532ca76 admin admin] The token cache is being invalidate because project 2d2458b8f12b481ca3e50b8dac971463 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:54:43.833649 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-c37f049a-f904-413b-801b-3e784532ca76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:54:43.834288 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-c37f049a-f904-413b-801b-3e784532ca76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:54:43.835826 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1189/2375] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:54:43 2022] DELETE /identity/v3/projects/2d2458b8f12b481ca3e50b8dac971463 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:54:43.839713 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df7615-9df4-4c13-aa1c-2afd903bf4df service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:54:43.850130 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df7615-9df4-4c13-aa1c-2afd903bf4df service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:54:43.869049 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:54:43.907979 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16753b49-386e-40ea-8f16-c57c527b91a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:54:43.908855 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16753b49-386e-40ea-8f16-c57c527b91a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:54:43.909142 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16753b49-386e-40ea-8f16-c57c527b91a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:54:43.909424 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16753b49-386e-40ea-8f16-c57c527b91a2 admin admin] PATH_INFO: `/v3/users/076bc0d50e8240cead28c2b02b2b5500` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:54:43.910605 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16753b49-386e-40ea-8f16-c57c527b91a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=076bc0d50e8240cead28c2b02b2b5500)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:54:43.912630 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16753b49-386e-40ea-8f16-c57c527b91a2 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:54:43.957736 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-16753b49-386e-40ea-8f16-c57c527b91a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '076bc0d50e8240cead28c2b02b2b5500'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:54:43.958375 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-16753b49-386e-40ea-8f16-c57c527b91a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '076bc0d50e8240cead28c2b02b2b5500'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:54:43.958972 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-16753b49-386e-40ea-8f16-c57c527b91a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '076bc0d50e8240cead28c2b02b2b5500'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:54:43.971813 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-16753b49-386e-40ea-8f16-c57c527b91a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '076bc0d50e8240cead28c2b02b2b5500'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:54:43.978736 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-16753b49-386e-40ea-8f16-c57c527b91a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '076bc0d50e8240cead28c2b02b2b5500'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:54:43.990797 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1187/2376] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:54:43 2022] DELETE /identity/v3/users/076bc0d50e8240cead28c2b02b2b5500 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:54:44.254596 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f049a-f904-413b-801b-3e784532ca76 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:54:44.256194 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-c37f049a-f904-413b-801b-3e784532ca76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:54:44.269803 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f049a-f904-413b-801b-3e784532ca76 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:54:44.329783 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1786bb56-0f6d-4ddf-bd9e-79c47767f1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:54:44.330654 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1786bb56-0f6d-4ddf-bd9e-79c47767f1c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:54:44.330945 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1786bb56-0f6d-4ddf-bd9e-79c47767f1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:54:44.331228 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1786bb56-0f6d-4ddf-bd9e-79c47767f1c3 admin admin] PATH_INFO: `/v3/projects/c2ad3780f9bd4c15af9136f3e6766436` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:54:44.332450 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1786bb56-0f6d-4ddf-bd9e-79c47767f1c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2ad3780f9bd4c15af9136f3e6766436)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:54:44.334360 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1786bb56-0f6d-4ddf-bd9e-79c47767f1c3 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:54:44.363985 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:54:44.382910 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-1786bb56-0f6d-4ddf-bd9e-79c47767f1c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2ad3780f9bd4c15af9136f3e6766436', 'request_id': 'req-1786bb56-0f6d-4ddf-bd9e-79c47767f1c3'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:54:44.388390 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-1786bb56-0f6d-4ddf-bd9e-79c47767f1c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2ad3780f9bd4c15af9136f3e6766436', 'request_id': 'req-1786bb56-0f6d-4ddf-bd9e-79c47767f1c3'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:54:44.396132 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-1786bb56-0f6d-4ddf-bd9e-79c47767f1c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2ad3780f9bd4c15af9136f3e6766436', 'request_id': 'req-1786bb56-0f6d-4ddf-bd9e-79c47767f1c3'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:54:44.406755 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-1786bb56-0f6d-4ddf-bd9e-79c47767f1c3 admin admin] The token cache is being invalidate because project c2ad3780f9bd4c15af9136f3e6766436 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:54:44.407042 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-1786bb56-0f6d-4ddf-bd9e-79c47767f1c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:54:44.407657 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-1786bb56-0f6d-4ddf-bd9e-79c47767f1c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:54:44.409190 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1190/2377] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:54:44 2022] DELETE /identity/v3/projects/c2ad3780f9bd4c15af9136f3e6766436 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:54:44.413972 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063c9c5-da11-42ed-ae1b-b2d9379797bb None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:54:44.414463 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063c9c5-da11-42ed-ae1b-b2d9379797bb None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:54:44.414573 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063c9c5-da11-42ed-ae1b-b2d9379797bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:54:44.432676 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-9063c9c5-da11-42ed-ae1b-b2d9379797bb None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:54:44.433881 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9063c9c5-da11-42ed-ae1b-b2d9379797bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:54:44.491870 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1188/2378] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:54:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:54:44.500522 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02620333-1641-4456-a7e9-d0d529a02298 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:54:44.500759 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02620333-1641-4456-a7e9-d0d529a02298 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:54:44.501047 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02620333-1641-4456-a7e9-d0d529a02298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:54:44.520178 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-02620333-1641-4456-a7e9-d0d529a02298 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:54:44.521377 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-02620333-1641-4456-a7e9-d0d529a02298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:54:44.529250 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1191/2379] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:54:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:54:44.533223 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9063c9c5-da11-42ed-ae1b-b2d9379797bb None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:54:44.542812 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9063c9c5-da11-42ed-ae1b-b2d9379797bb None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:54:44.547969 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ccfb2a-697b-4500-a8fc-5a378d0ed476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:54:44.548626 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ccfb2a-697b-4500-a8fc-5a378d0ed476 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:54:44.548923 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ccfb2a-697b-4500-a8fc-5a378d0ed476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:54:44.549206 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ccfb2a-697b-4500-a8fc-5a378d0ed476 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:54:44.549948 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ccfb2a-697b-4500-a8fc-5a378d0ed476 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:54:44.550261 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ccfb2a-697b-4500-a8fc-5a378d0ed476 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:54:44.551857 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ccfb2a-697b-4500-a8fc-5a378d0ed476 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:54:44.564034 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1189/2380] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:54:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:54:44.568208 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02620333-1641-4456-a7e9-d0d529a02298 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:54:44.577248 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02620333-1641-4456-a7e9-d0d529a02298 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:54:44.581868 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3633e8-9de0-4f92-913a-54a41ea8bd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:54:44.582517 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3633e8-9de0-4f92-913a-54a41ea8bd2b admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:54:44.582806 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3633e8-9de0-4f92-913a-54a41ea8bd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:54:44.583086 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3633e8-9de0-4f92-913a-54a41ea8bd2b admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:54:44.583777 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3633e8-9de0-4f92-913a-54a41ea8bd2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:54:44.585709 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3633e8-9de0-4f92-913a-54a41ea8bd2b admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:54:44.612010 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1192/2381] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:54:44 2022] POST /identity/v3/projects => generated 367 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:54:44.615501 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ccfb2a-697b-4500-a8fc-5a378d0ed476 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:54:44.625871 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ccfb2a-697b-4500-a8fc-5a378d0ed476 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:54:44.651174 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:54:44.684033 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f13eb-ebe8-42ef-b0d1-16640b487d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:54:44.684707 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f13eb-ebe8-42ef-b0d1-16640b487d34 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:54:44.684984 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f13eb-ebe8-42ef-b0d1-16640b487d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:54:44.685264 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f13eb-ebe8-42ef-b0d1-16640b487d34 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:54:44.686588 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311f13eb-ebe8-42ef-b0d1-16640b487d34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:54:44.688530 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311f13eb-ebe8-42ef-b0d1-16640b487d34 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:54:44.708573 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1190/2382] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:54:44 2022] POST /identity/v3/users => generated 284 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:54:44.712784 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3633e8-9de0-4f92-913a-54a41ea8bd2b admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:54:44.722711 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3633e8-9de0-4f92-913a-54a41ea8bd2b admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:54:44.727250 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574a04a2-a8ed-4eec-a21e-a33543dd1ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:54:44.727901 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a04a2-a8ed-4eec-a21e-a33543dd1ce3 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:54:44.728210 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a04a2-a8ed-4eec-a21e-a33543dd1ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:54:44.728488 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a04a2-a8ed-4eec-a21e-a33543dd1ce3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:54:44.729238 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574a04a2-a8ed-4eec-a21e-a33543dd1ce3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:54:44.730806 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574a04a2-a8ed-4eec-a21e-a33543dd1ce3 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:54:44.741389 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1193/2383] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:54:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:54:44.744978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f13eb-ebe8-42ef-b0d1-16640b487d34 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:54:44.755412 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f13eb-ebe8-42ef-b0d1-16640b487d34 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:54:44.759944 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8153cb40-351e-4030-a138-1b66a81d9223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:54:44.760596 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153cb40-351e-4030-a138-1b66a81d9223 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:54:44.760883 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153cb40-351e-4030-a138-1b66a81d9223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:54:44.761172 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153cb40-351e-4030-a138-1b66a81d9223 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:54:44.762124 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8153cb40-351e-4030-a138-1b66a81d9223 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:54:44.763507 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8153cb40-351e-4030-a138-1b66a81d9223 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:54:44.775026 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1191/2384] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:54:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:54:44.778958 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574a04a2-a8ed-4eec-a21e-a33543dd1ce3 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:54:44.789286 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574a04a2-a8ed-4eec-a21e-a33543dd1ce3 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:54:44.793824 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0b8ec-fbaa-48c7-acc8-b56bcff55d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:54:44.794691 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0b8ec-fbaa-48c7-acc8-b56bcff55d0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:54:44.795515 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0b8ec-fbaa-48c7-acc8-b56bcff55d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:54:44.795792 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0b8ec-fbaa-48c7-acc8-b56bcff55d0e admin admin] PATH_INFO: `/v3/projects/e9ec86e6ad9440ceb890f29089f5439a/users/564622dfdde644f78cd35ca238eda83c/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:54:44.810058 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e0b8ec-fbaa-48c7-acc8-b56bcff55d0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9ec86e6ad9440ceb890f29089f5439a, user_id=564622dfdde644f78cd35ca238eda83c, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:54:44.812714 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e0b8ec-fbaa-48c7-acc8-b56bcff55d0e admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:54:44.824921 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1194/2385] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:54:44 2022] PUT /identity/v3/projects/e9ec86e6ad9440ceb890f29089f5439a/users/564622dfdde644f78cd35ca238eda83c/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:54:44.834795 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a447053-f4bd-4961-b151-583e9b951fb8 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:54:44.835089 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a447053-f4bd-4961-b151-583e9b951fb8 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:54:44.835371 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a447053-f4bd-4961-b151-583e9b951fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:54:44.863097 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-1a447053-f4bd-4961-b151-583e9b951fb8 None None] MFA Rules not processed for user `564622dfdde644f78cd35ca238eda83c`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:54:44.864319 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1a447053-f4bd-4961-b151-583e9b951fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:54:44.926956 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1192/2386] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:54:44 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:54:44.931725 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0b8ec-fbaa-48c7-acc8-b56bcff55d0e admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:54:44.993062 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0b8ec-fbaa-48c7-acc8-b56bcff55d0e admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:54:44.997671 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f854307-de65-49f4-8228-cfa728ea060e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:54:44.998342 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f854307-de65-49f4-8228-cfa728ea060e admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:54:44.998633 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f854307-de65-49f4-8228-cfa728ea060e admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:54:44.998911 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f854307-de65-49f4-8228-cfa728ea060e admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:54:44.999610 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f854307-de65-49f4-8228-cfa728ea060e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:54:45.001537 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f854307-de65-49f4-8228-cfa728ea060e admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:54:45.025564 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1195/2387] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:54:44 2022] POST /identity/v3/projects => generated 369 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:54:45.030035 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a447053-f4bd-4961-b151-583e9b951fb8 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:54:45.040416 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a447053-f4bd-4961-b151-583e9b951fb8 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:54:45.097725 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce06b1-fd81-46b3-973b-0ff53cf7b7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:54:45.098400 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce06b1-fd81-46b3-973b-0ff53cf7b7d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:54:45.098688 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce06b1-fd81-46b3-973b-0ff53cf7b7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:54:45.098971 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce06b1-fd81-46b3-973b-0ff53cf7b7d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:54:45.099674 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ce06b1-fd81-46b3-973b-0ff53cf7b7d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:54:45.101618 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ce06b1-fd81-46b3-973b-0ff53cf7b7d6 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:54:45.121034 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1193/2388] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:54:45 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:54:45.125173 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f854307-de65-49f4-8228-cfa728ea060e admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:54:45.135367 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f854307-de65-49f4-8228-cfa728ea060e admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:54:45.140441 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d87ecd-0188-49aa-9a4a-1caeaafe42b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:54:45.141092 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d87ecd-0188-49aa-9a4a-1caeaafe42b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:54:45.141375 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d87ecd-0188-49aa-9a4a-1caeaafe42b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:54:45.141652 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d87ecd-0188-49aa-9a4a-1caeaafe42b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:54:45.142379 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d87ecd-0188-49aa-9a4a-1caeaafe42b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:54:45.143980 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d87ecd-0188-49aa-9a4a-1caeaafe42b3 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:54:45.154207 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1196/2389] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 20:54:45.158749 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce06b1-fd81-46b3-973b-0ff53cf7b7d6 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:54:45.169084 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce06b1-fd81-46b3-973b-0ff53cf7b7d6 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:54:45.173795 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe84c5-7cf1-4f08-82b0-337d95cd1923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:54:45.174670 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe84c5-7cf1-4f08-82b0-337d95cd1923 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:54:45.174959 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe84c5-7cf1-4f08-82b0-337d95cd1923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:54:45.175239 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe84c5-7cf1-4f08-82b0-337d95cd1923 admin admin] PATH_INFO: `/v3/projects/b7dcb22035e34813aa32bf0bc80d40f0/users/c1c9023cbaf441d4835ac9ebb4e97ffc/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:54:45.190099 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe84c5-7cf1-4f08-82b0-337d95cd1923 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7dcb22035e34813aa32bf0bc80d40f0, user_id=c1c9023cbaf441d4835ac9ebb4e97ffc, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:54:45.192771 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe84c5-7cf1-4f08-82b0-337d95cd1923 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:54:45.205603 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1194/2390] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:54:45 2022] PUT /identity/v3/projects/b7dcb22035e34813aa32bf0bc80d40f0/users/c1c9023cbaf441d4835ac9ebb4e97ffc/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:54:45.209369 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d87ecd-0188-49aa-9a4a-1caeaafe42b3 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:54:45.219700 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d87ecd-0188-49aa-9a4a-1caeaafe42b3 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:54:45.245420 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:54:45.282530 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4834c1-b9e0-404c-9da1-145178d07b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:54:45.283128 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4834c1-b9e0-404c-9da1-145178d07b85 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:54:45.283413 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4834c1-b9e0-404c-9da1-145178d07b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:54:45.283689 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4834c1-b9e0-404c-9da1-145178d07b85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:54:45.284444 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4834c1-b9e0-404c-9da1-145178d07b85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:54:45.286030 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4834c1-b9e0-404c-9da1-145178d07b85 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:54:45.295512 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1197/2391] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:54:45.299630 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe84c5-7cf1-4f08-82b0-337d95cd1923 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:54:45.305474 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:54:45.311840 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe84c5-7cf1-4f08-82b0-337d95cd1923 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:54:45.316711 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a7ba3-2c34-4845-9a64-afc422f2aeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:54:45.317592 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a7ba3-2c34-4845-9a64-afc422f2aeef admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:54:45.317881 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a7ba3-2c34-4845-9a64-afc422f2aeef admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:54:45.318164 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a7ba3-2c34-4845-9a64-afc422f2aeef admin admin] PATH_INFO: `/v3/projects/b7dcb22035e34813aa32bf0bc80d40f0/users/c1c9023cbaf441d4835ac9ebb4e97ffc/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:54:45.320226 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8a7ba3-2c34-4845-9a64-afc422f2aeef admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7dcb22035e34813aa32bf0bc80d40f0, user_id=c1c9023cbaf441d4835ac9ebb4e97ffc, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:54:45.322865 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8a7ba3-2c34-4845-9a64-afc422f2aeef admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:54:45.333515 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1195/2392] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:54:45 2022] PUT /identity/v3/projects/b7dcb22035e34813aa32bf0bc80d40f0/users/c1c9023cbaf441d4835ac9ebb4e97ffc/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:54:45.345344 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10a49c-6515-4734-84c5-84bfb46dc83d None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:54:45.345855 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10a49c-6515-4734-84c5-84bfb46dc83d None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:54:45.345977 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10a49c-6515-4734-84c5-84bfb46dc83d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:54:45.372390 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-5d10a49c-6515-4734-84c5-84bfb46dc83d None None] MFA Rules not processed for user `c1c9023cbaf441d4835ac9ebb4e97ffc`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:54:45.373617 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-5d10a49c-6515-4734-84c5-84bfb46dc83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:54:45.439374 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1198/2393] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:54:45 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:54:55.329787 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=4,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:54:55.436547 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=52 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:55:37.851898 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a7ba3-2c34-4845-9a64-afc422f2aeef admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:55:37.853822 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2c8a7ba3-2c34-4845-9a64-afc422f2aeef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:55:37.909676 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a7ba3-2c34-4845-9a64-afc422f2aeef admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:55:37.913204 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0096d965-5672-44a0-80f6-8a8f31852934 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:55:37.913836 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096d965-5672-44a0-80f6-8a8f31852934 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:55:37.914118 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096d965-5672-44a0-80f6-8a8f31852934 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:55:37.914391 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096d965-5672-44a0-80f6-8a8f31852934 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:55:37.916123 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0096d965-5672-44a0-80f6-8a8f31852934 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:55:37.972962 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0096d965-5672-44a0-80f6-8a8f31852934 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:55:37.974372 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0096d965-5672-44a0-80f6-8a8f31852934 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:55:37.983609 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1196/2394] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:55:37 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:55:38.025438 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10a49c-6515-4734-84c5-84bfb46dc83d None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:55:38.035289 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10a49c-6515-4734-84c5-84bfb46dc83d None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:55:38.038809 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b69ade-3ad3-4903-a11b-b31fdf21426b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:55:38.039449 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b69ade-3ad3-4903-a11b-b31fdf21426b service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:55:38.039737 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b69ade-3ad3-4903-a11b-b31fdf21426b service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:55:38.040049 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b69ade-3ad3-4903-a11b-b31fdf21426b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:55:38.041778 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-46b69ade-3ad3-4903-a11b-b31fdf21426b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:55:38.109347 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b69ade-3ad3-4903-a11b-b31fdf21426b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:55:38.110705 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b69ade-3ad3-4903-a11b-b31fdf21426b service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:55:38.128376 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1199/2395] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:55:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:55:38.203389 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0096d965-5672-44a0-80f6-8a8f31852934 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:55:38.204421 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0096d965-5672-44a0-80f6-8a8f31852934 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:55:38.206931 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b69ade-3ad3-4903-a11b-b31fdf21426b service cinder] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:55:38.215248 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0096d965-5672-44a0-80f6-8a8f31852934 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:55:38.215427 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b69ade-3ad3-4903-a11b-b31fdf21426b service cinder] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:55:38.219379 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26433add-6216-41cf-83b8-b88032941c82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:55:38.219812 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61add9-fd61-4ac8-80b2-d622c6d0f214 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:55:38.220042 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26433add-6216-41cf-83b8-b88032941c82 service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:55:38.220329 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26433add-6216-41cf-83b8-b88032941c82 service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:55:38.220501 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61add9-fd61-4ac8-80b2-d622c6d0f214 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:55:38.220637 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26433add-6216-41cf-83b8-b88032941c82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:55:38.220787 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61add9-fd61-4ac8-80b2-d622c6d0f214 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:55:38.221062 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61add9-fd61-4ac8-80b2-d622c6d0f214 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:55:38.222348 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-26433add-6216-41cf-83b8-b88032941c82 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:55:38.222870 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3a61add9-fd61-4ac8-80b2-d622c6d0f214 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:55:38.235324 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-26433add-6216-41cf-83b8-b88032941c82 service cinder] Could not find project: c2ad3780f9bd4c15af9136f3e6766436.: keystone.exception.ProjectNotFound: Could not find project: c2ad3780f9bd4c15af9136f3e6766436. Jun 21 20:55:38.235324 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 20:55:38.235324 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 20:55:38.235324 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 20:55:38.235324 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 20:55:38.235324 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 20:55:38.235324 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 20:55:38.235324 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 20:55:38.235324 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 20:55:38.235324 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 20:55:38.235324 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 20:55:38.235324 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 20:55:38.235324 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Jun 21 20:55:38.235324 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Jun 21 20:55:38.235324 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Jun 21 20:55:38.236611 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Jun 21 20:55:38.236611 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Jun 21 20:55:38.236611 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Jun 21 20:55:38.236611 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:55:38.236611 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:55:38.236611 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 145, in validate_token Jun 21 20:55:38.236611 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application token = self._validate_token(token_id) Jun 21 20:55:38.236611 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:55:38.236611 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:55:38.236611 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:55:38.236611 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:55:38.236611 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:55:38.236611 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:55:38.236611 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:55:38.236611 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:55:38.236611 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:55:38.236611 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:55:38.237824 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:55:38.237824 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:55:38.237824 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:55:38.237824 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:55:38.237824 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 179, in _validate_token Jun 21 20:55:38.237824 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application token.mint(token_id, issued_at) Jun 21 20:55:38.237824 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 579, in mint Jun 21 20:55:38.237824 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._validate_token_resources() Jun 21 20:55:38.237824 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 464, in _validate_token_resources Jun 21 20:55:38.237824 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application if self.project and not self.project.get('enabled'): Jun 21 20:55:38.237824 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 162, in project Jun 21 20:55:38.237824 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application self.__project = PROVIDERS.resource_api.get_project( Jun 21 20:55:38.237824 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 20:55:38.237824 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 20:55:38.237824 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 20:55:38.237824 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 20:55:38.237824 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 20:55:38.238994 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 20:55:38.238994 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 20:55:38.238994 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jun 21 20:55:38.238994 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 20:55:38.238994 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jun 21 20:55:38.238994 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 20:55:38.238994 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 20:55:38.238994 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 20:55:38.238994 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jun 21 20:55:38.238994 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 20:55:38.238994 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jun 21 20:55:38.238994 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 20:55:38.238994 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 20:55:38.238994 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 20:55:38.238994 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 20:55:38.238994 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 20:55:38.238994 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 20:55:38.240170 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: c2ad3780f9bd4c15af9136f3e6766436. Jun 21 20:55:38.240170 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jun 21 20:55:38.240170 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1200/2396] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:55:38 2022] GET /identity/v3/auth/tokens => generated 113 bytes in 30 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jun 21 20:55:38.312136 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a61add9-fd61-4ac8-80b2-d622c6d0f214 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:55:38.313568 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a61add9-fd61-4ac8-80b2-d622c6d0f214 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:55:38.331439 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1197/2397] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:55:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:55:38.367342 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26433add-6216-41cf-83b8-b88032941c82 service cinder] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:55:38.368310 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61add9-fd61-4ac8-80b2-d622c6d0f214 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:55:38.375656 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26433add-6216-41cf-83b8-b88032941c82 service cinder] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:55:38.377274 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61add9-fd61-4ac8-80b2-d622c6d0f214 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:55:38.379248 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ea4ea-2f79-49ea-9f9d-0a4ae03dd44b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:55:38.379889 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ea4ea-2f79-49ea-9f9d-0a4ae03dd44b service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:55:38.380218 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ea4ea-2f79-49ea-9f9d-0a4ae03dd44b service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:55:38.381866 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ea4ea-2f79-49ea-9f9d-0a4ae03dd44b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:55:38.382134 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a02214d-eb0d-4565-b200-77e21e8acb80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:55:38.382782 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02214d-eb0d-4565-b200-77e21e8acb80 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:55:38.383070 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02214d-eb0d-4565-b200-77e21e8acb80 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:55:38.383353 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02214d-eb0d-4565-b200-77e21e8acb80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:55:38.385153 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8a02214d-eb0d-4565-b200-77e21e8acb80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:55:38.391632 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ea4ea-2f79-49ea-9f9d-0a4ae03dd44b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:55:38.393095 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ea4ea-2f79-49ea-9f9d-0a4ae03dd44b service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:55:38.400286 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a02214d-eb0d-4565-b200-77e21e8acb80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:55:38.401721 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a02214d-eb0d-4565-b200-77e21e8acb80 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:55:38.403206 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1201/2398] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:55:38 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:55:38.416094 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1198/2399] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:55:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 20:55:40.193883 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ea4ea-2f79-49ea-9f9d-0a4ae03dd44b service cinder] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:55:40.195366 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-ba2ea4ea-2f79-49ea-9f9d-0a4ae03dd44b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:55:40.215685 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ea4ea-2f79-49ea-9f9d-0a4ae03dd44b service cinder] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:55:40.222037 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec2e240-81f9-46a6-886c-de23880f565b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3918fe05c8634bc39f3e295374701465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:55:40.222783 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2e240-81f9-46a6-886c-de23880f565b service nova] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:55:40.223131 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2e240-81f9-46a6-886c-de23880f565b service nova] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:55:40.223474 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2e240-81f9-46a6-886c-de23880f565b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:55:40.225412 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-2ec2e240-81f9-46a6-886c-de23880f565b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:55:40.238242 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec2e240-81f9-46a6-886c-de23880f565b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:55:40.239981 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec2e240-81f9-46a6-886c-de23880f565b service nova] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:55:40.263323 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1202/2400] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:55:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:55:42.734750 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab212b01-a897-47f1-ad64-cba78880a5f4 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:55:42.735332 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab212b01-a897-47f1-ad64-cba78880a5f4 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:55:42.735638 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab212b01-a897-47f1-ad64-cba78880a5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:55:42.752422 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ab212b01-a897-47f1-ad64-cba78880a5f4 None None] MFA Rules not processed for user `fc95af68a6d640699f788d5438cae607`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:55:42.753630 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ab212b01-a897-47f1-ad64-cba78880a5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:55:42.773684 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:55:42.809173 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1199/2401] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:55:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:55:43.104160 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec2e240-81f9-46a6-886c-de23880f565b service nova] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:55:43.105551 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-2ec2e240-81f9-46a6-886c-de23880f565b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:55:43.160215 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec2e240-81f9-46a6-886c-de23880f565b service nova] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:55:43.163744 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ffaff-615e-4edb-9536-db0ee5ffc769 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:55:43.164411 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ffaff-615e-4edb-9536-db0ee5ffc769 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:55:43.164696 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ffaff-615e-4edb-9536-db0ee5ffc769 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:55:43.164995 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ffaff-615e-4edb-9536-db0ee5ffc769 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:55:43.166703 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-d90ffaff-615e-4edb-9536-db0ee5ffc769 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:55:43.175894 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90ffaff-615e-4edb-9536-db0ee5ffc769 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:55:43.177378 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90ffaff-615e-4edb-9536-db0ee5ffc769 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:55:43.185497 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1203/2402] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:55:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:55:43.492013 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab212b01-a897-47f1-ad64-cba78880a5f4 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:55:43.493399 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ab212b01-a897-47f1-ad64-cba78880a5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:55:43.564121 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab212b01-a897-47f1-ad64-cba78880a5f4 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:55:43.569107 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a42df2f-e10d-492c-b5f4-8b8209bfb5bd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59294bff27c4b3f8aaeeab48ed35a0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:55:43.569760 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42df2f-e10d-492c-b5f4-8b8209bfb5bd service placement] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:55:43.570048 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42df2f-e10d-492c-b5f4-8b8209bfb5bd service placement] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:55:43.570329 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42df2f-e10d-492c-b5f4-8b8209bfb5bd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:55:43.572129 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5a42df2f-e10d-492c-b5f4-8b8209bfb5bd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:55:43.584073 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a42df2f-e10d-492c-b5f4-8b8209bfb5bd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:55:43.585645 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a42df2f-e10d-492c-b5f4-8b8209bfb5bd service placement] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:55:43.595485 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1200/2403] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:55:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:55:51.992791 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ffaff-615e-4edb-9536-db0ee5ffc769 service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:55:52.006579 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ffaff-615e-4edb-9536-db0ee5ffc769 service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:55:52.012092 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58afbc9-309b-4c21-9fd6-a7886814950c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3918fe05c8634bc39f3e295374701465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:55:52.012743 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58afbc9-309b-4c21-9fd6-a7886814950c service nova] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:55:52.013028 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58afbc9-309b-4c21-9fd6-a7886814950c service nova] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:55:52.013831 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58afbc9-309b-4c21-9fd6-a7886814950c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:55:52.015594 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-b58afbc9-309b-4c21-9fd6-a7886814950c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:55:52.028086 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58afbc9-309b-4c21-9fd6-a7886814950c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:55:52.030381 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58afbc9-309b-4c21-9fd6-a7886814950c service nova] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:55:52.041628 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1204/2404] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:55:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 20:55:53.591232 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=45 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:55:56.636820 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a42df2f-e10d-492c-b5f4-8b8209bfb5bd service placement] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:55:56.658236 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a42df2f-e10d-492c-b5f4-8b8209bfb5bd service placement] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:55:56.663449 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c89d6-66f6-4de1-b46d-86fd71170bf6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59294bff27c4b3f8aaeeab48ed35a0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:55:56.664149 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c89d6-66f6-4de1-b46d-86fd71170bf6 service placement] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:55:56.664438 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c89d6-66f6-4de1-b46d-86fd71170bf6 service placement] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:55:56.664723 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c89d6-66f6-4de1-b46d-86fd71170bf6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:55:56.666534 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3e2c89d6-66f6-4de1-b46d-86fd71170bf6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:55:56.692473 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2c89d6-66f6-4de1-b46d-86fd71170bf6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:55:56.694081 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2c89d6-66f6-4de1-b46d-86fd71170bf6 service placement] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:55:56.705335 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1201/2405] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:55:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:56:02.036982 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=84 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:56:06.701204 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=15 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:56:57.294046 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58afbc9-309b-4c21-9fd6-a7886814950c service nova] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:56:57.304056 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c89d6-66f6-4de1-b46d-86fd71170bf6 service placement] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:56:57.342980 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58afbc9-309b-4c21-9fd6-a7886814950c service nova] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:56:57.348364 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df06d8a0-cb3e-40ee-be9b-ad6ae82f711e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:56:57.349555 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06d8a0-cb3e-40ee-be9b-ad6ae82f711e service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:56:57.350336 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06d8a0-cb3e-40ee-be9b-ad6ae82f711e service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:56:57.350472 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06d8a0-cb3e-40ee-be9b-ad6ae82f711e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:56:57.352274 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-df06d8a0-cb3e-40ee-be9b-ad6ae82f711e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:56:57.360367 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c89d6-66f6-4de1-b46d-86fd71170bf6 service placement] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:56:57.365376 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa215af-2191-4954-a845-d78b715d8db6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:56:57.366025 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa215af-2191-4954-a845-d78b715d8db6 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:56:57.366312 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa215af-2191-4954-a845-d78b715d8db6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:56:57.366588 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa215af-2191-4954-a845-d78b715d8db6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:56:57.440790 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa215af-2191-4954-a845-d78b715d8db6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:56:57.442339 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa215af-2191-4954-a845-d78b715d8db6 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:56:57.442864 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df06d8a0-cb3e-40ee-be9b-ad6ae82f711e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:56:57.444458 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df06d8a0-cb3e-40ee-be9b-ad6ae82f711e service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:56:57.452806 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1202/2406] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:56:57 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 20:56:57.456782 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1205/2407] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:56:57 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:56:57.805708 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa215af-2191-4954-a845-d78b715d8db6 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:56:57.805708 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0fa215af-2191-4954-a845-d78b715d8db6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:56:58.013270 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa215af-2191-4954-a845-d78b715d8db6 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:56:58.025909 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d96f86b-f029-4b0c-8792-d58b54a2df78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:56:58.026978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96f86b-f029-4b0c-8792-d58b54a2df78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:56:58.027387 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96f86b-f029-4b0c-8792-d58b54a2df78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:56:58.027672 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96f86b-f029-4b0c-8792-d58b54a2df78 admin admin] PATH_INFO: `/v3/users/cdf7951e127441579c2e8c80caf8ca28` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:56:58.029426 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d96f86b-f029-4b0c-8792-d58b54a2df78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdf7951e127441579c2e8c80caf8ca28)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:56:58.031452 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d96f86b-f029-4b0c-8792-d58b54a2df78 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:56:58.085220 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:56:58.103368 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8d96f86b-f029-4b0c-8792-d58b54a2df78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdf7951e127441579c2e8c80caf8ca28'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:56:58.104196 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8d96f86b-f029-4b0c-8792-d58b54a2df78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdf7951e127441579c2e8c80caf8ca28'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:56:58.107650 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8d96f86b-f029-4b0c-8792-d58b54a2df78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdf7951e127441579c2e8c80caf8ca28'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:56:58.129785 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8d96f86b-f029-4b0c-8792-d58b54a2df78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdf7951e127441579c2e8c80caf8ca28'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:56:58.138773 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8d96f86b-f029-4b0c-8792-d58b54a2df78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdf7951e127441579c2e8c80caf8ca28'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:56:58.159703 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1203/2408] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:56:57 2022] DELETE /identity/v3/users/cdf7951e127441579c2e8c80caf8ca28 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:56:58.164412 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9f8a2-732f-4e1c-9743-ab3893091136 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:56:58.164715 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9f8a2-732f-4e1c-9743-ab3893091136 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:56:58.165014 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9f8a2-732f-4e1c-9743-ab3893091136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:56:58.196372 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-00a9f8a2-732f-4e1c-9743-ab3893091136 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:56:58.197751 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-00a9f8a2-732f-4e1c-9743-ab3893091136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:56:58.263062 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1206/2409] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:56:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:56:58.285030 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d96f86b-f029-4b0c-8792-d58b54a2df78 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:56:58.286579 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8d96f86b-f029-4b0c-8792-d58b54a2df78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:56:58.351169 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d96f86b-f029-4b0c-8792-d58b54a2df78 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:56:58.359602 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d1dc3-a273-477c-8f19-033293b73f7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:56:58.360767 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d1dc3-a273-477c-8f19-033293b73f7f service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:56:58.361447 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d1dc3-a273-477c-8f19-033293b73f7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:56:58.361903 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d1dc3-a273-477c-8f19-033293b73f7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:56:58.373331 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09d1dc3-a273-477c-8f19-033293b73f7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:56:58.375115 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09d1dc3-a273-477c-8f19-033293b73f7f service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:56:58.386610 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1204/2410] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:56:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:56:58.845974 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a9f8a2-732f-4e1c-9743-ab3893091136 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:56:58.847413 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-00a9f8a2-732f-4e1c-9743-ab3893091136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:56:58.859818 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a9f8a2-732f-4e1c-9743-ab3893091136 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:56:58.866557 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ee12bf-947a-40a4-86c0-b59c90a920b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:56:58.867415 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee12bf-947a-40a4-86c0-b59c90a920b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:56:58.867700 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee12bf-947a-40a4-86c0-b59c90a920b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:56:58.868007 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee12bf-947a-40a4-86c0-b59c90a920b1 admin admin] PATH_INFO: `/v3/projects/242ac2b3713542b992fe1b555837ea02` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:56:58.874501 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ee12bf-947a-40a4-86c0-b59c90a920b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=242ac2b3713542b992fe1b555837ea02)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:56:58.876684 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ee12bf-947a-40a4-86c0-b59c90a920b1 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:56:58.917095 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:56:58.929007 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-13ee12bf-947a-40a4-86c0-b59c90a920b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '242ac2b3713542b992fe1b555837ea02', 'request_id': 'req-13ee12bf-947a-40a4-86c0-b59c90a920b1'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:56:58.934549 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-13ee12bf-947a-40a4-86c0-b59c90a920b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '242ac2b3713542b992fe1b555837ea02', 'request_id': 'req-13ee12bf-947a-40a4-86c0-b59c90a920b1'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:56:58.942126 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-13ee12bf-947a-40a4-86c0-b59c90a920b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '242ac2b3713542b992fe1b555837ea02', 'request_id': 'req-13ee12bf-947a-40a4-86c0-b59c90a920b1'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:56:58.953438 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-13ee12bf-947a-40a4-86c0-b59c90a920b1 admin admin] The token cache is being invalidate because project 242ac2b3713542b992fe1b555837ea02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:56:58.953723 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-13ee12bf-947a-40a4-86c0-b59c90a920b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:56:58.954345 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-13ee12bf-947a-40a4-86c0-b59c90a920b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:56:58.955871 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1207/2411] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:56:58 2022] DELETE /identity/v3/projects/242ac2b3713542b992fe1b555837ea02 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:56:58.960651 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0479c7-7bb9-4af6-87ec-a69f98af9bdf None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:56:58.960941 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0479c7-7bb9-4af6-87ec-a69f98af9bdf None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:56:58.961221 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0479c7-7bb9-4af6-87ec-a69f98af9bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:56:59.009379 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-cf0479c7-7bb9-4af6-87ec-a69f98af9bdf None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:56:59.010567 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-cf0479c7-7bb9-4af6-87ec-a69f98af9bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:56:59.071995 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1205/2412] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:56:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:56:59.080080 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0151e3-f4aa-4467-acdb-e53a6c8bec55 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:56:59.080316 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0151e3-f4aa-4467-acdb-e53a6c8bec55 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:56:59.080600 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0151e3-f4aa-4467-acdb-e53a6c8bec55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:56:59.098657 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-4c0151e3-f4aa-4467-acdb-e53a6c8bec55 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:56:59.099845 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-4c0151e3-f4aa-4467-acdb-e53a6c8bec55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:56:59.107993 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1208/2413] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:56:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:56:59.111936 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0479c7-7bb9-4af6-87ec-a69f98af9bdf None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:56:59.122121 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0479c7-7bb9-4af6-87ec-a69f98af9bdf None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:56:59.126701 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d74620-3391-4d7e-babb-d618efe37da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:56:59.127356 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d74620-3391-4d7e-babb-d618efe37da7 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:56:59.127643 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d74620-3391-4d7e-babb-d618efe37da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:56:59.127943 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d74620-3391-4d7e-babb-d618efe37da7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:56:59.128682 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d74620-3391-4d7e-babb-d618efe37da7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:56:59.129003 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d74620-3391-4d7e-babb-d618efe37da7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:56:59.130593 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d74620-3391-4d7e-babb-d618efe37da7 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:56:59.142636 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1206/2414] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:56:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:56:59.146700 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0151e3-f4aa-4467-acdb-e53a6c8bec55 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:56:59.156321 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0151e3-f4aa-4467-acdb-e53a6c8bec55 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:56:59.160954 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d49c9-76fe-4232-a08c-86e321d28f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:56:59.161832 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d49c9-76fe-4232-a08c-86e321d28f65 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:56:59.162123 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d49c9-76fe-4232-a08c-86e321d28f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:56:59.162409 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d49c9-76fe-4232-a08c-86e321d28f65 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:56:59.163101 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655d49c9-76fe-4232-a08c-86e321d28f65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:56:59.165042 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655d49c9-76fe-4232-a08c-86e321d28f65 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:56:59.205624 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1209/2415] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:56:59 2022] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:56:59.210208 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d74620-3391-4d7e-babb-d618efe37da7 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:56:59.221081 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d74620-3391-4d7e-babb-d618efe37da7 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:56:59.237142 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:56:59.287140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19792631-250a-4da1-9e42-e080a4df433f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:56:59.287904 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19792631-250a-4da1-9e42-e080a4df433f admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:56:59.288225 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19792631-250a-4da1-9e42-e080a4df433f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:56:59.288632 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19792631-250a-4da1-9e42-e080a4df433f admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:56:59.289264 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19792631-250a-4da1-9e42-e080a4df433f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:56:59.291131 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19792631-250a-4da1-9e42-e080a4df433f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:56:59.312345 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1207/2416] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:56:59 2022] POST /identity/v3/users => generated 291 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:56:59.316210 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d49c9-76fe-4232-a08c-86e321d28f65 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:56:59.327038 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d49c9-76fe-4232-a08c-86e321d28f65 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:56:59.331863 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55332f39-3564-4821-a537-2804995c15ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:56:59.332559 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55332f39-3564-4821-a537-2804995c15ae admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:56:59.332911 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55332f39-3564-4821-a537-2804995c15ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:56:59.333371 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55332f39-3564-4821-a537-2804995c15ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:56:59.334253 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55332f39-3564-4821-a537-2804995c15ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:56:59.335886 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55332f39-3564-4821-a537-2804995c15ae admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:56:59.346540 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1210/2417] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:56:59.350555 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19792631-250a-4da1-9e42-e080a4df433f admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:56:59.361128 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19792631-250a-4da1-9e42-e080a4df433f admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:56:59.366046 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11690ec6-2b09-4504-9a70-cda353aff824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:56:59.366765 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11690ec6-2b09-4504-9a70-cda353aff824 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:56:59.367079 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11690ec6-2b09-4504-9a70-cda353aff824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:56:59.367387 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11690ec6-2b09-4504-9a70-cda353aff824 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:56:59.368272 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11690ec6-2b09-4504-9a70-cda353aff824 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:56:59.369982 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11690ec6-2b09-4504-9a70-cda353aff824 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:56:59.381101 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1208/2418] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:56:59.385418 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55332f39-3564-4821-a537-2804995c15ae admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:56:59.396277 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55332f39-3564-4821-a537-2804995c15ae admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:56:59.400999 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d0466-774c-4285-8a46-d738001908f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:56:59.402489 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d0466-774c-4285-8a46-d738001908f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:56:59.403018 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d0466-774c-4285-8a46-d738001908f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:56:59.403307 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d0466-774c-4285-8a46-d738001908f0 admin admin] PATH_INFO: `/v3/projects/39ad4d08d7ac478bbf7d36028f05bd78/users/f1ae112e72584a3fa2b1405001065681/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:56:59.419468 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000d0466-774c-4285-8a46-d738001908f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39ad4d08d7ac478bbf7d36028f05bd78, user_id=f1ae112e72584a3fa2b1405001065681, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:56:59.422612 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000d0466-774c-4285-8a46-d738001908f0 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:56:59.436889 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1211/2419] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:56:59 2022] PUT /identity/v3/projects/39ad4d08d7ac478bbf7d36028f05bd78/users/f1ae112e72584a3fa2b1405001065681/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:56:59.446981 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e0bab-06de-43de-9708-5b396aa3e3e4 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:56:59.447275 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e0bab-06de-43de-9708-5b396aa3e3e4 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:56:59.447557 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e0bab-06de-43de-9708-5b396aa3e3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:56:59.475964 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-600e0bab-06de-43de-9708-5b396aa3e3e4 None None] MFA Rules not processed for user `f1ae112e72584a3fa2b1405001065681`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:56:59.477246 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-600e0bab-06de-43de-9708-5b396aa3e3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:56:59.546766 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1209/2420] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:56:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:56:59.551433 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d0466-774c-4285-8a46-d738001908f0 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:56:59.570186 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e0bab-06de-43de-9708-5b396aa3e3e4 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:56:59.571552 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-600e0bab-06de-43de-9708-5b396aa3e3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:56:59.618969 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d0466-774c-4285-8a46-d738001908f0 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:56:59.623814 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa2ab92-a5d3-4351-9873-6cca07523e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:56:59.624604 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2ab92-a5d3-4351-9873-6cca07523e79 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:56:59.624968 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2ab92-a5d3-4351-9873-6cca07523e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:56:59.625326 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2ab92-a5d3-4351-9873-6cca07523e79 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:56:59.626126 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa2ab92-a5d3-4351-9873-6cca07523e79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:56:59.628140 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa2ab92-a5d3-4351-9873-6cca07523e79 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:56:59.635350 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e0bab-06de-43de-9708-5b396aa3e3e4 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:56:59.641716 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40548ca-ec61-4011-9f7d-1a44ee0f152f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:56:59.643070 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40548ca-ec61-4011-9f7d-1a44ee0f152f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:56:59.643358 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40548ca-ec61-4011-9f7d-1a44ee0f152f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:56:59.643669 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40548ca-ec61-4011-9f7d-1a44ee0f152f admin admin] PATH_INFO: `/v3/users/564622dfdde644f78cd35ca238eda83c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:56:59.645139 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40548ca-ec61-4011-9f7d-1a44ee0f152f admin admin] RBAC: Authorizing `identity:delete_user(user_id=564622dfdde644f78cd35ca238eda83c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:56:59.647622 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40548ca-ec61-4011-9f7d-1a44ee0f152f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:56:59.657008 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1212/2421] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:56:59 2022] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:56:59.660926 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa2ab92-a5d3-4351-9873-6cca07523e79 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:56:59.676907 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:56:59.697789 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c40548ca-ec61-4011-9f7d-1a44ee0f152f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '564622dfdde644f78cd35ca238eda83c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:56:59.699067 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c40548ca-ec61-4011-9f7d-1a44ee0f152f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '564622dfdde644f78cd35ca238eda83c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:56:59.699697 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c40548ca-ec61-4011-9f7d-1a44ee0f152f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '564622dfdde644f78cd35ca238eda83c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:56:59.700513 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:56:59.713601 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c40548ca-ec61-4011-9f7d-1a44ee0f152f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '564622dfdde644f78cd35ca238eda83c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:56:59.722247 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c40548ca-ec61-4011-9f7d-1a44ee0f152f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '564622dfdde644f78cd35ca238eda83c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:56:59.727379 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa2ab92-a5d3-4351-9873-6cca07523e79 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:56:59.733766 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9520a8e8-3b16-4eb2-97a6-e3877ae81d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:56:59.734508 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520a8e8-3b16-4eb2-97a6-e3877ae81d23 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:56:59.734863 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520a8e8-3b16-4eb2-97a6-e3877ae81d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:56:59.735255 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520a8e8-3b16-4eb2-97a6-e3877ae81d23 admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:56:59.735658 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1210/2422] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:56:59 2022] DELETE /identity/v3/users/564622dfdde644f78cd35ca238eda83c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:56:59.736526 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9520a8e8-3b16-4eb2-97a6-e3877ae81d23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:56:59.738895 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9520a8e8-3b16-4eb2-97a6-e3877ae81d23 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:56:59.739716 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b5c1f-a247-48cb-a627-a8c23103d7fd None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:56:59.740037 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b5c1f-a247-48cb-a627-a8c23103d7fd None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:56:59.740321 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b5c1f-a247-48cb-a627-a8c23103d7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:56:59.761662 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e46b5c1f-a247-48cb-a627-a8c23103d7fd None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:56:59.763024 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e46b5c1f-a247-48cb-a627-a8c23103d7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:56:59.767356 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1213/2423] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:56:59 2022] POST /identity/v3/users => generated 297 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 20:56:59.768650 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9520a8e8-3b16-4eb2-97a6-e3877ae81d23 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:56:59.772107 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-9520a8e8-3b16-4eb2-97a6-e3877ae81d23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:56:59.784419 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9520a8e8-3b16-4eb2-97a6-e3877ae81d23 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:56:59.826960 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1211/2424] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:56:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:56:59.836967 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46b5c1f-a247-48cb-a627-a8c23103d7fd None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:56:59.838348 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e46b5c1f-a247-48cb-a627-a8c23103d7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:56:59.843470 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb983d39-810c-474b-b78f-5aea7563254a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:56:59.844112 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb983d39-810c-474b-b78f-5aea7563254a admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:56:59.844401 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb983d39-810c-474b-b78f-5aea7563254a admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:56:59.844680 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb983d39-810c-474b-b78f-5aea7563254a admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:56:59.845415 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb983d39-810c-474b-b78f-5aea7563254a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:56:59.847077 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb983d39-810c-474b-b78f-5aea7563254a admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:56:59.858979 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1214/2425] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 20:56:59.863844 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb983d39-810c-474b-b78f-5aea7563254a admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:56:59.874009 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb983d39-810c-474b-b78f-5aea7563254a admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:56:59.878760 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a3e6d-aa03-4cd6-ba55-c2dd6eb6bb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:56:59.879655 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a3e6d-aa03-4cd6-ba55-c2dd6eb6bb85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:56:59.879966 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a3e6d-aa03-4cd6-ba55-c2dd6eb6bb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:56:59.880254 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a3e6d-aa03-4cd6-ba55-c2dd6eb6bb85 admin admin] PATH_INFO: `/v3/projects/b9ff0f998db34bdc8065d780bf77d461/users/bc030391d7524c72971d526749817535/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:56:59.895611 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23a3e6d-aa03-4cd6-ba55-c2dd6eb6bb85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9ff0f998db34bdc8065d780bf77d461, user_id=bc030391d7524c72971d526749817535, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:56:59.898313 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23a3e6d-aa03-4cd6-ba55-c2dd6eb6bb85 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:56:59.900113 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46b5c1f-a247-48cb-a627-a8c23103d7fd None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:56:59.904279 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b4ef9d-9183-401d-a9ee-e621f0c4ca10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:56:59.905020 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4ef9d-9183-401d-a9ee-e621f0c4ca10 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:56:59.905303 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4ef9d-9183-401d-a9ee-e621f0c4ca10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:56:59.905602 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4ef9d-9183-401d-a9ee-e621f0c4ca10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:56:59.912011 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1215/2426] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:56:59 2022] PUT /identity/v3/projects/b9ff0f998db34bdc8065d780bf77d461/users/bc030391d7524c72971d526749817535/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:56:59.914976 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b4ef9d-9183-401d-a9ee-e621f0c4ca10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:56:59.915774 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a3e6d-aa03-4cd6-ba55-c2dd6eb6bb85 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:56:59.916431 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b4ef9d-9183-401d-a9ee-e621f0c4ca10 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:56:59.927423 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1212/2427] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:56:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 20:56:59.979693 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a3e6d-aa03-4cd6-ba55-c2dd6eb6bb85 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:56:59.985504 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6119624a-9e5a-4ad5-b06c-adf34cb7c65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:56:59.986289 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119624a-9e5a-4ad5-b06c-adf34cb7c65d admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:56:59.986552 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119624a-9e5a-4ad5-b06c-adf34cb7c65d admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:56:59.986827 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119624a-9e5a-4ad5-b06c-adf34cb7c65d admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:56:59.987577 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6119624a-9e5a-4ad5-b06c-adf34cb7c65d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:56:59.989214 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6119624a-9e5a-4ad5-b06c-adf34cb7c65d admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:00.000511 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1216/2428] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 20:57:00.004898 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b4ef9d-9183-401d-a9ee-e621f0c4ca10 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:00.015132 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b4ef9d-9183-401d-a9ee-e621f0c4ca10 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:00.019716 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8810d94-8105-47f6-8b4a-c997d5aadf23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:00.020620 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8810d94-8105-47f6-8b4a-c997d5aadf23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:00.020901 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8810d94-8105-47f6-8b4a-c997d5aadf23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:00.021178 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8810d94-8105-47f6-8b4a-c997d5aadf23 admin admin] PATH_INFO: `/v3/projects/b9ff0f998db34bdc8065d780bf77d461/users/bc030391d7524c72971d526749817535/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:00.023163 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8810d94-8105-47f6-8b4a-c997d5aadf23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9ff0f998db34bdc8065d780bf77d461, user_id=bc030391d7524c72971d526749817535, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:00.026222 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8810d94-8105-47f6-8b4a-c997d5aadf23 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:00.036684 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1213/2429] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:57:00 2022] PUT /identity/v3/projects/b9ff0f998db34bdc8065d780bf77d461/users/bc030391d7524c72971d526749817535/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:57:00.048246 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a670f54-6a59-4052-b6b4-ffcf2c809142 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:00.048563 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a670f54-6a59-4052-b6b4-ffcf2c809142 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:00.048847 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a670f54-6a59-4052-b6b4-ffcf2c809142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:00.080604 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-8a670f54-6a59-4052-b6b4-ffcf2c809142 None None] MFA Rules not processed for user `bc030391d7524c72971d526749817535`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:00.081506 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-8a670f54-6a59-4052-b6b4-ffcf2c809142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:00.113026 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:00.163136 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1217/2430] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:00 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:57:00.176120 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8810d94-8105-47f6-8b4a-c997d5aadf23 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:00.177845 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c8810d94-8105-47f6-8b4a-c997d5aadf23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:00.209184 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a670f54-6a59-4052-b6b4-ffcf2c809142 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:00.211020 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-8a670f54-6a59-4052-b6b4-ffcf2c809142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:00.215614 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:00.241604 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8810d94-8105-47f6-8b4a-c997d5aadf23 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:00.245903 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce5d83a-0ca7-4151-a726-4d6c77454cea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:00.246558 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5d83a-0ca7-4151-a726-4d6c77454cea service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:00.246843 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5d83a-0ca7-4151-a726-4d6c77454cea service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:00.247121 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5d83a-0ca7-4151-a726-4d6c77454cea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:00.256314 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce5d83a-0ca7-4151-a726-4d6c77454cea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:00.257754 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce5d83a-0ca7-4151-a726-4d6c77454cea service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:00.267319 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1214/2431] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:57:00 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:57:00.293865 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a670f54-6a59-4052-b6b4-ffcf2c809142 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:00.298483 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3facc885-ab16-4b44-b165-7f004dae5c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:00.299350 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3facc885-ab16-4b44-b165-7f004dae5c72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:00.299634 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3facc885-ab16-4b44-b165-7f004dae5c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:00.299906 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3facc885-ab16-4b44-b165-7f004dae5c72 admin admin] PATH_INFO: `/v3/projects/e9ec86e6ad9440ceb890f29089f5439a` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:00.301353 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3facc885-ab16-4b44-b165-7f004dae5c72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9ec86e6ad9440ceb890f29089f5439a)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:00.303240 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3facc885-ab16-4b44-b165-7f004dae5c72 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:00.351158 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-3facc885-ab16-4b44-b165-7f004dae5c72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9ec86e6ad9440ceb890f29089f5439a', 'request_id': 'req-3facc885-ab16-4b44-b165-7f004dae5c72'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:00.357681 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-3facc885-ab16-4b44-b165-7f004dae5c72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9ec86e6ad9440ceb890f29089f5439a', 'request_id': 'req-3facc885-ab16-4b44-b165-7f004dae5c72'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:00.365578 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-3facc885-ab16-4b44-b165-7f004dae5c72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9ec86e6ad9440ceb890f29089f5439a', 'request_id': 'req-3facc885-ab16-4b44-b165-7f004dae5c72'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:00.378298 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-3facc885-ab16-4b44-b165-7f004dae5c72 admin admin] The token cache is being invalidate because project e9ec86e6ad9440ceb890f29089f5439a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:57:00.378588 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-3facc885-ab16-4b44-b165-7f004dae5c72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:00.379362 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-3facc885-ab16-4b44-b165-7f004dae5c72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:00.381044 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1218/2432] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:57:00 2022] DELETE /identity/v3/projects/e9ec86e6ad9440ceb890f29089f5439a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:57:00.385239 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce5d83a-0ca7-4151-a726-4d6c77454cea service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:00.397603 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce5d83a-0ca7-4151-a726-4d6c77454cea service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:00.453887 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f6d7d-1649-405d-9d8d-87257d7fce91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:00.454765 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f6d7d-1649-405d-9d8d-87257d7fce91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:00.455053 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f6d7d-1649-405d-9d8d-87257d7fce91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:00.455331 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f6d7d-1649-405d-9d8d-87257d7fce91 admin admin] PATH_INFO: `/v3/users/c1c9023cbaf441d4835ac9ebb4e97ffc` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:00.456542 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3f6d7d-1649-405d-9d8d-87257d7fce91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1c9023cbaf441d4835ac9ebb4e97ffc)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:00.458895 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3f6d7d-1649-405d-9d8d-87257d7fce91 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:00.507549 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fa3f6d7d-1649-405d-9d8d-87257d7fce91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1c9023cbaf441d4835ac9ebb4e97ffc'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:00.508491 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fa3f6d7d-1649-405d-9d8d-87257d7fce91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1c9023cbaf441d4835ac9ebb4e97ffc'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:00.509270 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fa3f6d7d-1649-405d-9d8d-87257d7fce91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1c9023cbaf441d4835ac9ebb4e97ffc'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:00.526870 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fa3f6d7d-1649-405d-9d8d-87257d7fce91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1c9023cbaf441d4835ac9ebb4e97ffc'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:00.536446 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fa3f6d7d-1649-405d-9d8d-87257d7fce91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1c9023cbaf441d4835ac9ebb4e97ffc'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:00.549914 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1215/2433] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:57:00 2022] DELETE /identity/v3/users/c1c9023cbaf441d4835ac9ebb4e97ffc => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:57:00.610842 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3facc885-ab16-4b44-b165-7f004dae5c72 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:00.612398 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-3facc885-ab16-4b44-b165-7f004dae5c72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:00.662614 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:00.681996 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3facc885-ab16-4b44-b165-7f004dae5c72 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:00.743086 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a972e-47a5-4e07-b749-a5bd3af837f9 tempest-VolumeQuotaClassesTest-1533220218 tempest-VolumeQuotaClassesTest-1533220218-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc030391d7524c72971d526749817535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9ff0f998db34bdc8065d780bf77d461', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:00.743856 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a972e-47a5-4e07-b749-a5bd3af837f9 tempest-VolumeQuotaClassesTest-1533220218 tempest-VolumeQuotaClassesTest-1533220218-project-admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:00.744204 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a972e-47a5-4e07-b749-a5bd3af837f9 tempest-VolumeQuotaClassesTest-1533220218 tempest-VolumeQuotaClassesTest-1533220218-project-admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:00.744499 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a972e-47a5-4e07-b749-a5bd3af837f9 tempest-VolumeQuotaClassesTest-1533220218 tempest-VolumeQuotaClassesTest-1533220218-project-admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:00.745277 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a972e-47a5-4e07-b749-a5bd3af837f9 tempest-VolumeQuotaClassesTest-1533220218 tempest-VolumeQuotaClassesTest-1533220218-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:57:00.745596 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a972e-47a5-4e07-b749-a5bd3af837f9 tempest-VolumeQuotaClassesTest-1533220218 tempest-VolumeQuotaClassesTest-1533220218-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:00.747214 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a972e-47a5-4e07-b749-a5bd3af837f9 tempest-VolumeQuotaClassesTest-1533220218 tempest-VolumeQuotaClassesTest-1533220218-project-admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:00.761827 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1219/2434] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:57:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:57:00.763515 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f6d7d-1649-405d-9d8d-87257d7fce91 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:00.764941 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-fa3f6d7d-1649-405d-9d8d-87257d7fce91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:00.779384 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f6d7d-1649-405d-9d8d-87257d7fce91 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:00.783938 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaac224-4a7e-4fc4-bf6a-c6d5f426bf5f tempest-VolumeQuotaClassesTest-1533220218 tempest-VolumeQuotaClassesTest-1533220218-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc030391d7524c72971d526749817535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9ff0f998db34bdc8065d780bf77d461', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:00.784669 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaac224-4a7e-4fc4-bf6a-c6d5f426bf5f tempest-VolumeQuotaClassesTest-1533220218 tempest-VolumeQuotaClassesTest-1533220218-project-admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:00.784917 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaac224-4a7e-4fc4-bf6a-c6d5f426bf5f tempest-VolumeQuotaClassesTest-1533220218 tempest-VolumeQuotaClassesTest-1533220218-project-admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:00.785210 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaac224-4a7e-4fc4-bf6a-c6d5f426bf5f tempest-VolumeQuotaClassesTest-1533220218 tempest-VolumeQuotaClassesTest-1533220218-project-admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:00.785934 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaac224-4a7e-4fc4-bf6a-c6d5f426bf5f tempest-VolumeQuotaClassesTest-1533220218 tempest-VolumeQuotaClassesTest-1533220218-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:00.787866 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaac224-4a7e-4fc4-bf6a-c6d5f426bf5f tempest-VolumeQuotaClassesTest-1533220218 tempest-VolumeQuotaClassesTest-1533220218-project-admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:00.821177 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1216/2435] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:57:00 2022] POST /identity/v3/projects => generated 354 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:57:00.822563 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a972e-47a5-4e07-b749-a5bd3af837f9 tempest-VolumeQuotaClassesTest-1533220218 tempest-VolumeQuotaClassesTest-1533220218-project-admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:00.829699 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaac224-4a7e-4fc4-bf6a-c6d5f426bf5f tempest-VolumeQuotaClassesTest-1533220218 tempest-VolumeQuotaClassesTest-1533220218-project-admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:00.831588 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ceaac224-4a7e-4fc4-bf6a-c6d5f426bf5f tempest-VolumeQuotaClassesTest-1533220218 tempest-VolumeQuotaClassesTest-1533220218-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:00.838175 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a972e-47a5-4e07-b749-a5bd3af837f9 tempest-VolumeQuotaClassesTest-1533220218 tempest-VolumeQuotaClassesTest-1533220218-project-admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:00.882851 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:00.905980 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be95e7-b0ea-442b-82c5-cc87cd00a676 tempest-VolumeQuotaClassesTest-1533220218 tempest-VolumeQuotaClassesTest-1533220218-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc030391d7524c72971d526749817535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9ff0f998db34bdc8065d780bf77d461', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:00.906653 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be95e7-b0ea-442b-82c5-cc87cd00a676 tempest-VolumeQuotaClassesTest-1533220218 tempest-VolumeQuotaClassesTest-1533220218-project-admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:00.906968 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be95e7-b0ea-442b-82c5-cc87cd00a676 tempest-VolumeQuotaClassesTest-1533220218 tempest-VolumeQuotaClassesTest-1533220218-project-admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:00.907257 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be95e7-b0ea-442b-82c5-cc87cd00a676 tempest-VolumeQuotaClassesTest-1533220218 tempest-VolumeQuotaClassesTest-1533220218-project-admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:00.908017 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be95e7-b0ea-442b-82c5-cc87cd00a676 tempest-VolumeQuotaClassesTest-1533220218 tempest-VolumeQuotaClassesTest-1533220218-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:57:00.908337 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be95e7-b0ea-442b-82c5-cc87cd00a676 tempest-VolumeQuotaClassesTest-1533220218 tempest-VolumeQuotaClassesTest-1533220218-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:00.909941 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be95e7-b0ea-442b-82c5-cc87cd00a676 tempest-VolumeQuotaClassesTest-1533220218 tempest-VolumeQuotaClassesTest-1533220218-project-admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:00.915580 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaac224-4a7e-4fc4-bf6a-c6d5f426bf5f tempest-VolumeQuotaClassesTest-1533220218 tempest-VolumeQuotaClassesTest-1533220218-project-admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:00.920300 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46e5d43-bcae-45d1-b069-3c97c6db7f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:00.921189 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e5d43-bcae-45d1-b069-3c97c6db7f0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:00.921474 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e5d43-bcae-45d1-b069-3c97c6db7f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:00.921751 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e5d43-bcae-45d1-b069-3c97c6db7f0f admin admin] PATH_INFO: `/v3/projects/b7dcb22035e34813aa32bf0bc80d40f0` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:00.922460 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1220/2436] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:57:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:57:00.922946 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46e5d43-bcae-45d1-b069-3c97c6db7f0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7dcb22035e34813aa32bf0bc80d40f0)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:00.924897 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46e5d43-bcae-45d1-b069-3c97c6db7f0f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:00.965322 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be95e7-b0ea-442b-82c5-cc87cd00a676 tempest-VolumeQuotaClassesTest-1533220218 tempest-VolumeQuotaClassesTest-1533220218-project-admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:00.974569 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b46e5d43-bcae-45d1-b069-3c97c6db7f0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7dcb22035e34813aa32bf0bc80d40f0', 'request_id': 'req-b46e5d43-bcae-45d1-b069-3c97c6db7f0f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:00.975897 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be95e7-b0ea-442b-82c5-cc87cd00a676 tempest-VolumeQuotaClassesTest-1533220218 tempest-VolumeQuotaClassesTest-1533220218-project-admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:00.983460 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b46e5d43-bcae-45d1-b069-3c97c6db7f0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7dcb22035e34813aa32bf0bc80d40f0', 'request_id': 'req-b46e5d43-bcae-45d1-b069-3c97c6db7f0f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:00.990453 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b46e5d43-bcae-45d1-b069-3c97c6db7f0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7dcb22035e34813aa32bf0bc80d40f0', 'request_id': 'req-b46e5d43-bcae-45d1-b069-3c97c6db7f0f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:01.001524 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b46e5d43-bcae-45d1-b069-3c97c6db7f0f admin admin] The token cache is being invalidate because project b7dcb22035e34813aa32bf0bc80d40f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:57:01.001818 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b46e5d43-bcae-45d1-b069-3c97c6db7f0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:01.002498 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b46e5d43-bcae-45d1-b069-3c97c6db7f0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:01.004083 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1217/2437] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:57:00 2022] DELETE /identity/v3/projects/b7dcb22035e34813aa32bf0bc80d40f0 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:57:01.009693 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1540335-b1e4-4db4-bfc1-e08829a56ff0 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:01.009968 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1540335-b1e4-4db4-bfc1-e08829a56ff0 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:01.010251 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1540335-b1e4-4db4-bfc1-e08829a56ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:01.028515 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c1540335-b1e4-4db4-bfc1-e08829a56ff0 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:01.029696 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c1540335-b1e4-4db4-bfc1-e08829a56ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:01.038825 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285d622e-5b44-4d49-bd6f-4493f711cbc7 tempest-VolumeQuotaClassesTest-1533220218 tempest-VolumeQuotaClassesTest-1533220218-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc030391d7524c72971d526749817535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9ff0f998db34bdc8065d780bf77d461', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:01.039691 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d622e-5b44-4d49-bd6f-4493f711cbc7 tempest-VolumeQuotaClassesTest-1533220218 tempest-VolumeQuotaClassesTest-1533220218-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:01.040010 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d622e-5b44-4d49-bd6f-4493f711cbc7 tempest-VolumeQuotaClassesTest-1533220218 tempest-VolumeQuotaClassesTest-1533220218-project-admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:01.040295 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d622e-5b44-4d49-bd6f-4493f711cbc7 tempest-VolumeQuotaClassesTest-1533220218 tempest-VolumeQuotaClassesTest-1533220218-project-admin] PATH_INFO: `/v3/projects/e01e81e1cb334e4a853cde6c82926568` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:01.041481 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285d622e-5b44-4d49-bd6f-4493f711cbc7 tempest-VolumeQuotaClassesTest-1533220218 tempest-VolumeQuotaClassesTest-1533220218-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e01e81e1cb334e4a853cde6c82926568)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:01.043428 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285d622e-5b44-4d49-bd6f-4493f711cbc7 tempest-VolumeQuotaClassesTest-1533220218 tempest-VolumeQuotaClassesTest-1533220218-project-admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:01.074249 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:01.092025 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-285d622e-5b44-4d49-bd6f-4493f711cbc7 tempest-VolumeQuotaClassesTest-1533220218 tempest-VolumeQuotaClassesTest-1533220218-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e01e81e1cb334e4a853cde6c82926568', 'request_id': 'req-285d622e-5b44-4d49-bd6f-4493f711cbc7'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:01.092460 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1218/2438] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 20:57:01.097680 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-285d622e-5b44-4d49-bd6f-4493f711cbc7 tempest-VolumeQuotaClassesTest-1533220218 tempest-VolumeQuotaClassesTest-1533220218-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e01e81e1cb334e4a853cde6c82926568', 'request_id': 'req-285d622e-5b44-4d49-bd6f-4493f711cbc7'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:01.099964 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ffdcb-330f-4d68-b7ca-0bc908c189f2 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:01.100261 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ffdcb-330f-4d68-b7ca-0bc908c189f2 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:01.100548 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ffdcb-330f-4d68-b7ca-0bc908c189f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:01.107211 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-285d622e-5b44-4d49-bd6f-4493f711cbc7 tempest-VolumeQuotaClassesTest-1533220218 tempest-VolumeQuotaClassesTest-1533220218-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e01e81e1cb334e4a853cde6c82926568', 'request_id': 'req-285d622e-5b44-4d49-bd6f-4493f711cbc7'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:01.120068 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-285d622e-5b44-4d49-bd6f-4493f711cbc7 tempest-VolumeQuotaClassesTest-1533220218 tempest-VolumeQuotaClassesTest-1533220218-project-admin] The token cache is being invalidate because project e01e81e1cb334e4a853cde6c82926568 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:57:01.120433 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-285d622e-5b44-4d49-bd6f-4493f711cbc7 tempest-VolumeQuotaClassesTest-1533220218 tempest-VolumeQuotaClassesTest-1533220218-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:01.121238 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-285d622e-5b44-4d49-bd6f-4493f711cbc7 tempest-VolumeQuotaClassesTest-1533220218 tempest-VolumeQuotaClassesTest-1533220218-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:01.121389 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-6e4ffdcb-330f-4d68-b7ca-0bc908c189f2 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:01.122544 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6e4ffdcb-330f-4d68-b7ca-0bc908c189f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:01.123409 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1221/2439] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:57:00 2022] DELETE /identity/v3/projects/e01e81e1cb334e4a853cde6c82926568 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:57:01.188534 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1219/2440] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 20:57:01.192771 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285d622e-5b44-4d49-bd6f-4493f711cbc7 tempest-VolumeQuotaClassesTest-1533220218 tempest-VolumeQuotaClassesTest-1533220218-project-admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:01.203895 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285d622e-5b44-4d49-bd6f-4493f711cbc7 tempest-VolumeQuotaClassesTest-1533220218 tempest-VolumeQuotaClassesTest-1533220218-project-admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:01.209290 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6bee8e-1595-465e-b040-cca03ee5cd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:01.209950 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bee8e-1595-465e-b040-cca03ee5cd41 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:01.210238 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bee8e-1595-465e-b040-cca03ee5cd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:01.210517 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bee8e-1595-465e-b040-cca03ee5cd41 admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:01.211254 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6bee8e-1595-465e-b040-cca03ee5cd41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:57:01.211569 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6bee8e-1595-465e-b040-cca03ee5cd41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:01.213449 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6bee8e-1595-465e-b040-cca03ee5cd41 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:01.227570 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1222/2441] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:57:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:57:01.231897 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ffdcb-330f-4d68-b7ca-0bc908c189f2 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:01.237882 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:01.241901 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ffdcb-330f-4d68-b7ca-0bc908c189f2 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:01.253884 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2ab49-7e22-4b33-99e8-f8aa30a33ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:01.254369 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2ab49-7e22-4b33-99e8-f8aa30a33ea7 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:01.254665 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2ab49-7e22-4b33-99e8-f8aa30a33ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:01.254951 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2ab49-7e22-4b33-99e8-f8aa30a33ea7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:01.255682 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa2ab49-7e22-4b33-99e8-f8aa30a33ea7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:01.259168 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa2ab49-7e22-4b33-99e8-f8aa30a33ea7 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:01.290734 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1220/2442] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:57:01 2022] POST /identity/v3/projects => generated 401 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:57:01.294822 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6bee8e-1595-465e-b040-cca03ee5cd41 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:01.306297 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6bee8e-1595-465e-b040-cca03ee5cd41 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:01.356657 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2ab49-7e22-4b33-99e8-f8aa30a33ea7 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:01.358441 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8aa2ab49-7e22-4b33-99e8-f8aa30a33ea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:01.367454 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65469d-5e8e-43f1-aee6-2df9499c17be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:01.368164 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65469d-5e8e-43f1-aee6-2df9499c17be admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:01.368454 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65469d-5e8e-43f1-aee6-2df9499c17be admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:01.369037 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65469d-5e8e-43f1-aee6-2df9499c17be admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:01.369440 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c65469d-5e8e-43f1-aee6-2df9499c17be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:01.372100 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c65469d-5e8e-43f1-aee6-2df9499c17be admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:01.394420 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1223/2443] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:57:01 2022] POST /identity/v3/users => generated 301 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 20:57:01.398258 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65469d-5e8e-43f1-aee6-2df9499c17be admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:01.409199 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65469d-5e8e-43f1-aee6-2df9499c17be admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:01.414610 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ec10c8-df2b-4d92-a539-dfc7a270ba4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:01.415813 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec10c8-df2b-4d92-a539-dfc7a270ba4b admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:01.416197 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec10c8-df2b-4d92-a539-dfc7a270ba4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:01.416597 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec10c8-df2b-4d92-a539-dfc7a270ba4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:01.417528 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ec10c8-df2b-4d92-a539-dfc7a270ba4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:01.419222 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ec10c8-df2b-4d92-a539-dfc7a270ba4b admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:01.427150 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2ab49-7e22-4b33-99e8-f8aa30a33ea7 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:01.429921 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1224/2444] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 20:57:01.433927 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348ccc8-7b57-4f91-8915-346355630fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:01.434250 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ec10c8-df2b-4d92-a539-dfc7a270ba4b admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:01.434944 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348ccc8-7b57-4f91-8915-346355630fb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:01.435297 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348ccc8-7b57-4f91-8915-346355630fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:01.435649 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348ccc8-7b57-4f91-8915-346355630fb1 admin admin] PATH_INFO: `/v3/users/f1ae112e72584a3fa2b1405001065681` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:01.436888 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3348ccc8-7b57-4f91-8915-346355630fb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1ae112e72584a3fa2b1405001065681)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:01.438827 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3348ccc8-7b57-4f91-8915-346355630fb1 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:01.444366 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ec10c8-df2b-4d92-a539-dfc7a270ba4b admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:01.449614 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02bf4dd-d0b1-413a-a197-9e8bb77fbcb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:01.450606 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02bf4dd-d0b1-413a-a197-9e8bb77fbcb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:01.450606 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02bf4dd-d0b1-413a-a197-9e8bb77fbcb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:01.450854 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02bf4dd-d0b1-413a-a197-9e8bb77fbcb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:01.451502 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02bf4dd-d0b1-413a-a197-9e8bb77fbcb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:01.453093 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02bf4dd-d0b1-413a-a197-9e8bb77fbcb2 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:01.462765 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1225/2445] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 20:57:01.467487 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02bf4dd-d0b1-413a-a197-9e8bb77fbcb2 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:01.478301 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02bf4dd-d0b1-413a-a197-9e8bb77fbcb2 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:01.483077 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3576709-81bc-4b22-a0a5-b5201720c719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:01.483972 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3576709-81bc-4b22-a0a5-b5201720c719 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:01.484267 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3576709-81bc-4b22-a0a5-b5201720c719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:01.484552 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3576709-81bc-4b22-a0a5-b5201720c719 admin admin] PATH_INFO: `/v3/projects/0c954a1fe2884d6f83e276f08fa532bc/users/9dcb78e62b5044eea3fd91cf1235a03c/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:01.489084 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3348ccc8-7b57-4f91-8915-346355630fb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1ae112e72584a3fa2b1405001065681'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:01.489801 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3348ccc8-7b57-4f91-8915-346355630fb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1ae112e72584a3fa2b1405001065681'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:01.490469 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3348ccc8-7b57-4f91-8915-346355630fb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1ae112e72584a3fa2b1405001065681'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:01.501083 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3576709-81bc-4b22-a0a5-b5201720c719 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c954a1fe2884d6f83e276f08fa532bc, user_id=9dcb78e62b5044eea3fd91cf1235a03c, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:01.503248 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3348ccc8-7b57-4f91-8915-346355630fb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1ae112e72584a3fa2b1405001065681'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:01.503728 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3576709-81bc-4b22-a0a5-b5201720c719 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:01.511415 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3348ccc8-7b57-4f91-8915-346355630fb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1ae112e72584a3fa2b1405001065681'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:01.518504 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1226/2446] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:57:01 2022] PUT /identity/v3/projects/0c954a1fe2884d6f83e276f08fa532bc/users/9dcb78e62b5044eea3fd91cf1235a03c/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:57:01.528671 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d8713-713b-4588-aea9-dd0b0a5268cd None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:01.528993 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d8713-713b-4588-aea9-dd0b0a5268cd None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:01.529274 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d8713-713b-4588-aea9-dd0b0a5268cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:01.529883 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1221/2447] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:57:01 2022] DELETE /identity/v3/users/f1ae112e72584a3fa2b1405001065681 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:57:01.533931 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63219b78-d759-4015-8159-a23e926a5d62 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:01.534218 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63219b78-d759-4015-8159-a23e926a5d62 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:01.535127 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63219b78-d759-4015-8159-a23e926a5d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:01.553280 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-63219b78-d759-4015-8159-a23e926a5d62 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:01.554488 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-63219b78-d759-4015-8159-a23e926a5d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:01.554999 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-495d8713-713b-4588-aea9-dd0b0a5268cd None None] MFA Rules not processed for user `9dcb78e62b5044eea3fd91cf1235a03c`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:01.556260 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-495d8713-713b-4588-aea9-dd0b0a5268cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:01.590185 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:01.616965 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1222/2448] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 20:57:01.624908 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1227/2449] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:01 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:57:01.627848 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63219b78-d759-4015-8159-a23e926a5d62 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:01.629315 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-63219b78-d759-4015-8159-a23e926a5d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:01.634340 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d8713-713b-4588-aea9-dd0b0a5268cd None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:01.634545 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:01.635866 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-495d8713-713b-4588-aea9-dd0b0a5268cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:01.649599 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d8713-713b-4588-aea9-dd0b0a5268cd None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:01.654179 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee864c64-ec56-4b65-a862-10ed9dfbea26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:01.654837 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee864c64-ec56-4b65-a862-10ed9dfbea26 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:01.655122 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee864c64-ec56-4b65-a862-10ed9dfbea26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:01.655400 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee864c64-ec56-4b65-a862-10ed9dfbea26 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:01.656121 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee864c64-ec56-4b65-a862-10ed9dfbea26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:01.658012 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee864c64-ec56-4b65-a862-10ed9dfbea26 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:01.687694 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1228/2450] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:57:01 2022] POST /identity/v3/projects => generated 397 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:57:01.688877 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee864c64-ec56-4b65-a862-10ed9dfbea26 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:01.690406 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63219b78-d759-4015-8159-a23e926a5d62 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:01.740547 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cc355f-43a9-4966-9483-2b05289f92e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:01.741524 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc355f-43a9-4966-9483-2b05289f92e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:01.741809 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc355f-43a9-4966-9483-2b05289f92e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:01.742088 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc355f-43a9-4966-9483-2b05289f92e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:01.751483 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee864c64-ec56-4b65-a862-10ed9dfbea26 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:01.751726 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cc355f-43a9-4966-9483-2b05289f92e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:01.753186 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cc355f-43a9-4966-9483-2b05289f92e4 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:01.756249 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b682e01-254f-4085-a6fa-b6416f12cb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:01.756922 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b682e01-254f-4085-a6fa-b6416f12cb93 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:01.757214 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b682e01-254f-4085-a6fa-b6416f12cb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:01.757497 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b682e01-254f-4085-a6fa-b6416f12cb93 admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:01.758225 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b682e01-254f-4085-a6fa-b6416f12cb93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:01.760167 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b682e01-254f-4085-a6fa-b6416f12cb93 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:01.762893 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1223/2451] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:57:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:57:01.783371 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1229/2452] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:57:01 2022] POST /identity/v3/users => generated 305 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:57:01.787553 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cc355f-43a9-4966-9483-2b05289f92e4 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:01.797998 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cc355f-43a9-4966-9483-2b05289f92e4 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:01.803188 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d228a2-0b99-4761-8b30-b5f511adfaa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:01.803975 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d228a2-0b99-4761-8b30-b5f511adfaa1 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:01.804263 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d228a2-0b99-4761-8b30-b5f511adfaa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:01.804541 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d228a2-0b99-4761-8b30-b5f511adfaa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:01.805282 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d228a2-0b99-4761-8b30-b5f511adfaa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:01.806850 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d228a2-0b99-4761-8b30-b5f511adfaa1 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:01.818748 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1224/2453] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:57:01.822706 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b682e01-254f-4085-a6fa-b6416f12cb93 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:01.833280 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b682e01-254f-4085-a6fa-b6416f12cb93 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:01.839961 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a7b02-cd98-43e2-b5e4-ab0ecfbebbc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:01.841309 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a7b02-cd98-43e2-b5e4-ab0ecfbebbc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:01.841808 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a7b02-cd98-43e2-b5e4-ab0ecfbebbc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:01.842244 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a7b02-cd98-43e2-b5e4-ab0ecfbebbc8 admin admin] PATH_INFO: `/v3/projects/c9c5fad639a6451aaf0c0de61080908c/users/76f4ccf4264a433cb40c8c9f06a70fd3/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:01.859360 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a7b02-cd98-43e2-b5e4-ab0ecfbebbc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9c5fad639a6451aaf0c0de61080908c, user_id=76f4ccf4264a433cb40c8c9f06a70fd3, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:01.862242 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a7b02-cd98-43e2-b5e4-ab0ecfbebbc8 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:01.879122 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1230/2454] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:57:01 2022] PUT /identity/v3/projects/c9c5fad639a6451aaf0c0de61080908c/users/76f4ccf4264a433cb40c8c9f06a70fd3/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:57:01.883566 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d228a2-0b99-4761-8b30-b5f511adfaa1 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:01.898011 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d228a2-0b99-4761-8b30-b5f511adfaa1 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:01.971498 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e2b88-f49a-45ac-be83-91374c140e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:01.972212 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e2b88-f49a-45ac-be83-91374c140e07 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:01.973002 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e2b88-f49a-45ac-be83-91374c140e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:01.973296 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e2b88-f49a-45ac-be83-91374c140e07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:01.974033 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753e2b88-f49a-45ac-be83-91374c140e07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:01.975844 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753e2b88-f49a-45ac-be83-91374c140e07 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:01.986945 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1225/2455] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:57:01.991005 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a7b02-cd98-43e2-b5e4-ab0ecfbebbc8 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:02.001796 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a7b02-cd98-43e2-b5e4-ab0ecfbebbc8 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:02.006527 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccfceb5-51fa-42a9-99ec-e3d04b0a5b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:02.007411 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccfceb5-51fa-42a9-99ec-e3d04b0a5b79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:02.007697 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccfceb5-51fa-42a9-99ec-e3d04b0a5b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:02.008002 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccfceb5-51fa-42a9-99ec-e3d04b0a5b79 admin admin] PATH_INFO: `/v3/projects/c9c5fad639a6451aaf0c0de61080908c/users/76f4ccf4264a433cb40c8c9f06a70fd3/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:02.009945 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccfceb5-51fa-42a9-99ec-e3d04b0a5b79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9c5fad639a6451aaf0c0de61080908c, user_id=76f4ccf4264a433cb40c8c9f06a70fd3, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:02.012661 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccfceb5-51fa-42a9-99ec-e3d04b0a5b79 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:02.023387 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1231/2456] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:57:01 2022] PUT /identity/v3/projects/c9c5fad639a6451aaf0c0de61080908c/users/76f4ccf4264a433cb40c8c9f06a70fd3/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:57:02.035104 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b4f3c-e0cd-49e4-a152-dbf657b744dd None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:02.035402 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b4f3c-e0cd-49e4-a152-dbf657b744dd None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:02.035691 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b4f3c-e0cd-49e4-a152-dbf657b744dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:02.048803 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccfceb5-51fa-42a9-99ec-e3d04b0a5b79 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:02.050625 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-4ccfceb5-51fa-42a9-99ec-e3d04b0a5b79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:02.072487 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-485b4f3c-e0cd-49e4-a152-dbf657b744dd None None] MFA Rules not processed for user `76f4ccf4264a433cb40c8c9f06a70fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:02.073846 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-485b4f3c-e0cd-49e4-a152-dbf657b744dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:02.109863 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:02.122218 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccfceb5-51fa-42a9-99ec-e3d04b0a5b79 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:02.126906 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058c169-3fbd-451f-9808-035be036ad36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:02.127775 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058c169-3fbd-451f-9808-035be036ad36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:02.128091 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058c169-3fbd-451f-9808-035be036ad36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:02.128370 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058c169-3fbd-451f-9808-035be036ad36 admin admin] PATH_INFO: `/v3/projects/39ad4d08d7ac478bbf7d36028f05bd78` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:02.129566 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e058c169-3fbd-451f-9808-035be036ad36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39ad4d08d7ac478bbf7d36028f05bd78)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:02.131471 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e058c169-3fbd-451f-9808-035be036ad36 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:02.138199 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:02.149311 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1226/2457] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:02 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:57:02.160804 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b4f3c-e0cd-49e4-a152-dbf657b744dd None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:02.162499 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-485b4f3c-e0cd-49e4-a152-dbf657b744dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:02.188048 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-e058c169-3fbd-451f-9808-035be036ad36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39ad4d08d7ac478bbf7d36028f05bd78', 'request_id': 'req-e058c169-3fbd-451f-9808-035be036ad36'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:02.193792 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-e058c169-3fbd-451f-9808-035be036ad36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39ad4d08d7ac478bbf7d36028f05bd78', 'request_id': 'req-e058c169-3fbd-451f-9808-035be036ad36'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:02.201950 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-e058c169-3fbd-451f-9808-035be036ad36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39ad4d08d7ac478bbf7d36028f05bd78', 'request_id': 'req-e058c169-3fbd-451f-9808-035be036ad36'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:02.215587 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-e058c169-3fbd-451f-9808-035be036ad36 admin admin] The token cache is being invalidate because project 39ad4d08d7ac478bbf7d36028f05bd78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:57:02.215932 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-e058c169-3fbd-451f-9808-035be036ad36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:02.216601 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-e058c169-3fbd-451f-9808-035be036ad36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:02.218179 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1232/2458] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:57:02 2022] DELETE /identity/v3/projects/39ad4d08d7ac478bbf7d36028f05bd78 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:57:02.221126 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b4f3c-e0cd-49e4-a152-dbf657b744dd None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:02.222077 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058c169-3fbd-451f-9808-035be036ad36 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:02.223354 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-e058c169-3fbd-451f-9808-035be036ad36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:02.269683 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15cc39a-2011-48d6-b37f-f460d8285fb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:02.270325 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15cc39a-2011-48d6-b37f-f460d8285fb2 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:02.270606 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15cc39a-2011-48d6-b37f-f460d8285fb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:02.270888 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15cc39a-2011-48d6-b37f-f460d8285fb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:02.272668 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b15cc39a-2011-48d6-b37f-f460d8285fb2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:02.286754 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058c169-3fbd-451f-9808-035be036ad36 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:02.291509 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0543ca-aa74-43c2-a353-412f69cbdac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:02.292999 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0543ca-aa74-43c2-a353-412f69cbdac7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:02.293288 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0543ca-aa74-43c2-a353-412f69cbdac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:02.293651 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0543ca-aa74-43c2-a353-412f69cbdac7 admin admin] PATH_INFO: `/v3/users/bc030391d7524c72971d526749817535` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:02.294770 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0543ca-aa74-43c2-a353-412f69cbdac7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc030391d7524c72971d526749817535)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:02.296731 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0543ca-aa74-43c2-a353-412f69cbdac7 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:02.339307 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15cc39a-2011-48d6-b37f-f460d8285fb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:02.340955 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15cc39a-2011-48d6-b37f-f460d8285fb2 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:02.344549 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-9c0543ca-aa74-43c2-a353-412f69cbdac7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc030391d7524c72971d526749817535'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:02.345210 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-9c0543ca-aa74-43c2-a353-412f69cbdac7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc030391d7524c72971d526749817535'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:02.351547 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1227/2459] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:57:02 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 20:57:02.354279 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-9c0543ca-aa74-43c2-a353-412f69cbdac7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc030391d7524c72971d526749817535'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:02.367547 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-9c0543ca-aa74-43c2-a353-412f69cbdac7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc030391d7524c72971d526749817535'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:02.368430 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-9c0543ca-aa74-43c2-a353-412f69cbdac7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc030391d7524c72971d526749817535'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:02.381461 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1233/2460] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:57:02 2022] DELETE /identity/v3/users/bc030391d7524c72971d526749817535 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:57:02.422979 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15cc39a-2011-48d6-b37f-f460d8285fb2 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:02.424466 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b15cc39a-2011-48d6-b37f-f460d8285fb2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:02.435643 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15cc39a-2011-48d6-b37f-f460d8285fb2 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:02.473611 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:02.490760 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e2d0b7-77a6-4609-8da3-f3c1f8f35c7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:02.491417 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2d0b7-77a6-4609-8da3-f3c1f8f35c7a service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:02.491703 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2d0b7-77a6-4609-8da3-f3c1f8f35c7a service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:02.492014 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2d0b7-77a6-4609-8da3-f3c1f8f35c7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:02.493932 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-35e2d0b7-77a6-4609-8da3-f3c1f8f35c7a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:02.556360 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e2d0b7-77a6-4609-8da3-f3c1f8f35c7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:02.557783 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e2d0b7-77a6-4609-8da3-f3c1f8f35c7a service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:02.566726 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1228/2461] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:57:02 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:57:02.660726 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0543ca-aa74-43c2-a353-412f69cbdac7 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:02.662300 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-9c0543ca-aa74-43c2-a353-412f69cbdac7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:02.679320 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:02.754359 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0543ca-aa74-43c2-a353-412f69cbdac7 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:02.761401 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6521b6c8-ac6f-486d-9032-817b2f7b87d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:02.762410 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521b6c8-ac6f-486d-9032-817b2f7b87d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:02.762768 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521b6c8-ac6f-486d-9032-817b2f7b87d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:02.763155 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521b6c8-ac6f-486d-9032-817b2f7b87d8 admin admin] PATH_INFO: `/v3/projects/b9ff0f998db34bdc8065d780bf77d461` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:02.764475 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6521b6c8-ac6f-486d-9032-817b2f7b87d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9ff0f998db34bdc8065d780bf77d461)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:02.766844 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6521b6c8-ac6f-486d-9032-817b2f7b87d8 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:02.817247 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-6521b6c8-ac6f-486d-9032-817b2f7b87d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9ff0f998db34bdc8065d780bf77d461', 'request_id': 'req-6521b6c8-ac6f-486d-9032-817b2f7b87d8'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:02.824341 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-6521b6c8-ac6f-486d-9032-817b2f7b87d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9ff0f998db34bdc8065d780bf77d461', 'request_id': 'req-6521b6c8-ac6f-486d-9032-817b2f7b87d8'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:02.833324 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-6521b6c8-ac6f-486d-9032-817b2f7b87d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9ff0f998db34bdc8065d780bf77d461', 'request_id': 'req-6521b6c8-ac6f-486d-9032-817b2f7b87d8'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:02.850284 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-6521b6c8-ac6f-486d-9032-817b2f7b87d8 admin admin] The token cache is being invalidate because project b9ff0f998db34bdc8065d780bf77d461 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:57:02.850702 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-6521b6c8-ac6f-486d-9032-817b2f7b87d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:02.851454 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-6521b6c8-ac6f-486d-9032-817b2f7b87d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:02.855982 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1234/2462] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:57:02 2022] DELETE /identity/v3/projects/b9ff0f998db34bdc8065d780bf77d461 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:57:02.858485 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc07e0-5139-40a6-9569-616057c6ab53 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:02.858636 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc07e0-5139-40a6-9569-616057c6ab53 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:02.858923 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc07e0-5139-40a6-9569-616057c6ab53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:02.878274 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-1bbc07e0-5139-40a6-9569-616057c6ab53 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:02.880452 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1bbc07e0-5139-40a6-9569-616057c6ab53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:02.950346 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1229/2463] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:57:02.958417 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea13da-be5c-4a3a-8d39-29b49a8b7342 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:02.958716 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea13da-be5c-4a3a-8d39-29b49a8b7342 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:02.959036 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea13da-be5c-4a3a-8d39-29b49a8b7342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:02.978734 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-58ea13da-be5c-4a3a-8d39-29b49a8b7342 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:02.979986 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-58ea13da-be5c-4a3a-8d39-29b49a8b7342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:02.988323 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1235/2464] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:57:02.992894 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc07e0-5139-40a6-9569-616057c6ab53 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:03.003231 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc07e0-5139-40a6-9569-616057c6ab53 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:03.007837 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967388e8-596a-4f57-bd2a-79117c84f882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:03.008535 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967388e8-596a-4f57-bd2a-79117c84f882 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:03.008819 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967388e8-596a-4f57-bd2a-79117c84f882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:03.009097 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967388e8-596a-4f57-bd2a-79117c84f882 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:03.009822 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967388e8-596a-4f57-bd2a-79117c84f882 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:57:03.010154 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967388e8-596a-4f57-bd2a-79117c84f882 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:03.012423 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967388e8-596a-4f57-bd2a-79117c84f882 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:03.023709 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1230/2465] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:57:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:57:03.028240 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea13da-be5c-4a3a-8d39-29b49a8b7342 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:03.037725 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea13da-be5c-4a3a-8d39-29b49a8b7342 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:03.043074 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44928787-66e6-469e-8915-cfbe890527a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:03.043886 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44928787-66e6-469e-8915-cfbe890527a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:03.044273 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44928787-66e6-469e-8915-cfbe890527a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:03.044624 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44928787-66e6-469e-8915-cfbe890527a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:03.045391 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44928787-66e6-469e-8915-cfbe890527a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:03.047273 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44928787-66e6-469e-8915-cfbe890527a4 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:03.078072 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1236/2466] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:57:03 2022] POST /identity/v3/projects => generated 391 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:57:03.079516 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967388e8-596a-4f57-bd2a-79117c84f882 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:03.089553 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967388e8-596a-4f57-bd2a-79117c84f882 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:03.147076 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86fd79f-1fba-49e4-a9ca-ebdb13a64ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:03.147751 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86fd79f-1fba-49e4-a9ca-ebdb13a64ebd admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:03.148075 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86fd79f-1fba-49e4-a9ca-ebdb13a64ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:03.148378 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86fd79f-1fba-49e4-a9ca-ebdb13a64ebd admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:03.149068 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86fd79f-1fba-49e4-a9ca-ebdb13a64ebd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:03.150982 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86fd79f-1fba-49e4-a9ca-ebdb13a64ebd admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:03.170987 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1231/2467] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:57:03 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:57:03.175008 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44928787-66e6-469e-8915-cfbe890527a4 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:03.186478 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44928787-66e6-469e-8915-cfbe890527a4 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:03.191309 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e0f276-eb35-4d66-960f-1d62ae82298c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:03.192050 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0f276-eb35-4d66-960f-1d62ae82298c admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:03.192422 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0f276-eb35-4d66-960f-1d62ae82298c admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:03.192778 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0f276-eb35-4d66-960f-1d62ae82298c admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:03.193534 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e0f276-eb35-4d66-960f-1d62ae82298c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:03.195107 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e0f276-eb35-4d66-960f-1d62ae82298c admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:03.205870 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1237/2468] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:57:03.209901 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86fd79f-1fba-49e4-a9ca-ebdb13a64ebd admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:03.219965 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86fd79f-1fba-49e4-a9ca-ebdb13a64ebd admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:03.224615 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e0038-09e6-4dcb-9890-9835367c8c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:03.225271 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e0038-09e6-4dcb-9890-9835367c8c9f admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:03.225561 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e0038-09e6-4dcb-9890-9835367c8c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:03.225846 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e0038-09e6-4dcb-9890-9835367c8c9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:03.226578 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19e0038-09e6-4dcb-9890-9835367c8c9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:03.228205 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19e0038-09e6-4dcb-9890-9835367c8c9f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:03.230867 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:03.240568 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1232/2469] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:57:03.244804 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e0f276-eb35-4d66-960f-1d62ae82298c admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:03.255338 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e0f276-eb35-4d66-960f-1d62ae82298c admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:03.260143 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a764203-8639-46f4-b2f5-dca646add639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:03.261694 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a764203-8639-46f4-b2f5-dca646add639 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:03.261984 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a764203-8639-46f4-b2f5-dca646add639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:03.262455 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a764203-8639-46f4-b2f5-dca646add639 admin admin] PATH_INFO: `/v3/projects/109dbe2386aa40ff93265a16dcc71d7d/users/d07c2fbe669e49ddbbc07dda543912d3/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:03.277441 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a764203-8639-46f4-b2f5-dca646add639 admin admin] RBAC: Authorizing `identity:create_grant(project_id=109dbe2386aa40ff93265a16dcc71d7d, user_id=d07c2fbe669e49ddbbc07dda543912d3, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:03.280165 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a764203-8639-46f4-b2f5-dca646add639 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:03.294241 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1238/2470] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:57:03 2022] PUT /identity/v3/projects/109dbe2386aa40ff93265a16dcc71d7d/users/d07c2fbe669e49ddbbc07dda543912d3/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:57:03.304851 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44109e1-5535-4f2c-aac9-f65084ea4848 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:03.305147 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44109e1-5535-4f2c-aac9-f65084ea4848 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:03.305430 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44109e1-5535-4f2c-aac9-f65084ea4848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:03.331310 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-b44109e1-5535-4f2c-aac9-f65084ea4848 None None] MFA Rules not processed for user `d07c2fbe669e49ddbbc07dda543912d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:03.332558 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b44109e1-5535-4f2c-aac9-f65084ea4848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:03.395965 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1233/2471] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:57:03.400648 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a764203-8639-46f4-b2f5-dca646add639 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:03.448941 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:03.470527 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a764203-8639-46f4-b2f5-dca646add639 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:03.475696 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3aef3f-1c65-4c2e-b5ca-e5bc8b4be9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:03.476645 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3aef3f-1c65-4c2e-b5ca-e5bc8b4be9e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:03.477097 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3aef3f-1c65-4c2e-b5ca-e5bc8b4be9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:03.477478 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3aef3f-1c65-4c2e-b5ca-e5bc8b4be9e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:03.478322 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3aef3f-1c65-4c2e-b5ca-e5bc8b4be9e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:03.481047 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3aef3f-1c65-4c2e-b5ca-e5bc8b4be9e7 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:03.508226 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1239/2472] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:57:03 2022] POST /identity/v3/projects => generated 393 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:57:03.512526 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44109e1-5535-4f2c-aac9-f65084ea4848 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:03.524047 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44109e1-5535-4f2c-aac9-f65084ea4848 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:03.580840 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c7d43-524c-4205-ad34-5ea48c1d5939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:03.581512 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c7d43-524c-4205-ad34-5ea48c1d5939 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:03.581804 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c7d43-524c-4205-ad34-5ea48c1d5939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:03.582088 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c7d43-524c-4205-ad34-5ea48c1d5939 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:03.582789 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1c7d43-524c-4205-ad34-5ea48c1d5939 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:03.584756 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1c7d43-524c-4205-ad34-5ea48c1d5939 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:03.605779 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1234/2473] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:57:03 2022] POST /identity/v3/users => generated 303 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:57:03.609191 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3aef3f-1c65-4c2e-b5ca-e5bc8b4be9e7 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:03.619391 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3aef3f-1c65-4c2e-b5ca-e5bc8b4be9e7 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:03.624043 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02529b-5f0b-4919-969c-35d1e832b41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:03.624703 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02529b-5f0b-4919-969c-35d1e832b41e admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:03.624994 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02529b-5f0b-4919-969c-35d1e832b41e admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:03.625277 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02529b-5f0b-4919-969c-35d1e832b41e admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:03.626016 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c02529b-5f0b-4919-969c-35d1e832b41e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:03.627878 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c02529b-5f0b-4919-969c-35d1e832b41e admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:03.638298 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1240/2474] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:57:03.642242 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c7d43-524c-4205-ad34-5ea48c1d5939 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:03.652536 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c7d43-524c-4205-ad34-5ea48c1d5939 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:03.657089 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12927d98-c6ee-4cc6-806c-919c54c39a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:03.657962 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12927d98-c6ee-4cc6-806c-919c54c39a34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:03.658245 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12927d98-c6ee-4cc6-806c-919c54c39a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:03.658521 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12927d98-c6ee-4cc6-806c-919c54c39a34 admin admin] PATH_INFO: `/v3/projects/7e1c78b7ef794d6f8f89c4720572e623/users/b8dba7d3dde94ee7a3bcbaf186c71e10/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:03.673787 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12927d98-c6ee-4cc6-806c-919c54c39a34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e1c78b7ef794d6f8f89c4720572e623, user_id=b8dba7d3dde94ee7a3bcbaf186c71e10, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:03.676742 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12927d98-c6ee-4cc6-806c-919c54c39a34 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:03.690389 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1235/2475] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:57:03 2022] PUT /identity/v3/projects/7e1c78b7ef794d6f8f89c4720572e623/users/b8dba7d3dde94ee7a3bcbaf186c71e10/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:57:03.694397 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02529b-5f0b-4919-969c-35d1e832b41e admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:03.704339 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02529b-5f0b-4919-969c-35d1e832b41e admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:03.759981 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac6ee5-14b8-4858-8c8f-c2885a2a54ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:03.760588 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac6ee5-14b8-4858-8c8f-c2885a2a54ca admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:03.760875 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac6ee5-14b8-4858-8c8f-c2885a2a54ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:03.761154 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac6ee5-14b8-4858-8c8f-c2885a2a54ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:03.761879 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bac6ee5-14b8-4858-8c8f-c2885a2a54ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:03.763461 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bac6ee5-14b8-4858-8c8f-c2885a2a54ca admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:03.772996 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1241/2476] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:57:03.777707 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12927d98-c6ee-4cc6-806c-919c54c39a34 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:03.794494 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12927d98-c6ee-4cc6-806c-919c54c39a34 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:03.799071 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a72db41-47df-4da8-ac77-f64571b2fc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:03.799983 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a72db41-47df-4da8-ac77-f64571b2fc04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:03.800273 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a72db41-47df-4da8-ac77-f64571b2fc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:03.800555 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a72db41-47df-4da8-ac77-f64571b2fc04 admin admin] PATH_INFO: `/v3/projects/7e1c78b7ef794d6f8f89c4720572e623/users/b8dba7d3dde94ee7a3bcbaf186c71e10/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:03.802782 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a72db41-47df-4da8-ac77-f64571b2fc04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e1c78b7ef794d6f8f89c4720572e623, user_id=b8dba7d3dde94ee7a3bcbaf186c71e10, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:03.805450 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a72db41-47df-4da8-ac77-f64571b2fc04 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:03.815544 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1236/2477] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:57:03 2022] PUT /identity/v3/projects/7e1c78b7ef794d6f8f89c4720572e623/users/b8dba7d3dde94ee7a3bcbaf186c71e10/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:57:03.827330 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4939b28-699b-46b6-bb34-77eaca0e8cdc None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:03.827685 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4939b28-699b-46b6-bb34-77eaca0e8cdc None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:03.828010 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4939b28-699b-46b6-bb34-77eaca0e8cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:03.855452 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-b4939b28-699b-46b6-bb34-77eaca0e8cdc None None] MFA Rules not processed for user `b8dba7d3dde94ee7a3bcbaf186c71e10`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:03.856698 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-b4939b28-699b-46b6-bb34-77eaca0e8cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:03.927862 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1242/2478] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:03 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 20:57:03.941356 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a72db41-47df-4da8-ac77-f64571b2fc04 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:03.943077 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4a72db41-47df-4da8-ac77-f64571b2fc04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:03.987740 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:04.002674 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a72db41-47df-4da8-ac77-f64571b2fc04 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:04.006268 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e2d29-af78-4e4c-8b2e-7bcd8693b7a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:04.006912 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e2d29-af78-4e4c-8b2e-7bcd8693b7a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:04.007196 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e2d29-af78-4e4c-8b2e-7bcd8693b7a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:04.007476 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e2d29-af78-4e4c-8b2e-7bcd8693b7a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:04.017046 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06e2d29-af78-4e4c-8b2e-7bcd8693b7a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:04.018463 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06e2d29-af78-4e4c-8b2e-7bcd8693b7a0 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:04.028374 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1237/2479] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:57:03 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:57:04.086959 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4939b28-699b-46b6-bb34-77eaca0e8cdc None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:04.088388 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-b4939b28-699b-46b6-bb34-77eaca0e8cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:04.100728 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4939b28-699b-46b6-bb34-77eaca0e8cdc None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:04.104348 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e440b93-d8ca-40a1-9899-224015261402 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:04.104986 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e440b93-d8ca-40a1-9899-224015261402 service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:04.105268 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e440b93-d8ca-40a1-9899-224015261402 service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:04.105544 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e440b93-d8ca-40a1-9899-224015261402 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:04.137536 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:04.162654 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e440b93-d8ca-40a1-9899-224015261402 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:04.164111 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e440b93-d8ca-40a1-9899-224015261402 service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:04.172887 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1243/2480] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:57:04 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:57:05.190166 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e2d29-af78-4e4c-8b2e-7bcd8693b7a0 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:05.191657 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b06e2d29-af78-4e4c-8b2e-7bcd8693b7a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:05.266465 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e2d29-af78-4e4c-8b2e-7bcd8693b7a0 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:05.271320 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1926a880-f213-49c3-8880-d5c2240bf8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:05.272245 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926a880-f213-49c3-8880-d5c2240bf8ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:05.272532 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926a880-f213-49c3-8880-d5c2240bf8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:05.272808 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926a880-f213-49c3-8880-d5c2240bf8ad admin admin] PATH_INFO: `/v3/users/d1bc5127fe8f4a16ad458a6eaec12252` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:05.274154 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1926a880-f213-49c3-8880-d5c2240bf8ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1bc5127fe8f4a16ad458a6eaec12252)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:05.276134 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1926a880-f213-49c3-8880-d5c2240bf8ad admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:05.323105 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1926a880-f213-49c3-8880-d5c2240bf8ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1bc5127fe8f4a16ad458a6eaec12252'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:05.324003 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1926a880-f213-49c3-8880-d5c2240bf8ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1bc5127fe8f4a16ad458a6eaec12252'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:05.324568 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1926a880-f213-49c3-8880-d5c2240bf8ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1bc5127fe8f4a16ad458a6eaec12252'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:05.336619 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1926a880-f213-49c3-8880-d5c2240bf8ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1bc5127fe8f4a16ad458a6eaec12252'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:05.343395 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1926a880-f213-49c3-8880-d5c2240bf8ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1bc5127fe8f4a16ad458a6eaec12252'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:05.356645 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1238/2481] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:57:05 2022] DELETE /identity/v3/users/d1bc5127fe8f4a16ad458a6eaec12252 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:57:05.361113 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b4459-6683-437c-9dda-370d982203cf None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:05.361627 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b4459-6683-437c-9dda-370d982203cf None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:05.361706 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b4459-6683-437c-9dda-370d982203cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:05.379571 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-384b4459-6683-437c-9dda-370d982203cf None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:05.380760 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-384b4459-6683-437c-9dda-370d982203cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:05.440792 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1244/2482] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:57:05.450758 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1926a880-f213-49c3-8880-d5c2240bf8ad admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:05.452219 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1926a880-f213-49c3-8880-d5c2240bf8ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:05.511307 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1926a880-f213-49c3-8880-d5c2240bf8ad admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:05.515622 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12691d0a-2b94-438d-8e24-206afcd2294c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:05.516309 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12691d0a-2b94-438d-8e24-206afcd2294c service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:05.516600 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12691d0a-2b94-438d-8e24-206afcd2294c service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:05.516936 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12691d0a-2b94-438d-8e24-206afcd2294c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:05.526088 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12691d0a-2b94-438d-8e24-206afcd2294c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:05.527588 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12691d0a-2b94-438d-8e24-206afcd2294c service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:05.543313 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1239/2483] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:57:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:57:05.861142 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b4459-6683-437c-9dda-370d982203cf None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:05.862770 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-384b4459-6683-437c-9dda-370d982203cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:05.885399 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b4459-6683-437c-9dda-370d982203cf None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:05.891454 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cabef1a-2dd2-4b5c-b3c8-b1a8931d441f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:05.892379 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabef1a-2dd2-4b5c-b3c8-b1a8931d441f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:05.892682 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabef1a-2dd2-4b5c-b3c8-b1a8931d441f admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:05.892966 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabef1a-2dd2-4b5c-b3c8-b1a8931d441f admin admin] PATH_INFO: `/v3/projects/871d69ec855b4de9b81cf06d1e8182be` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:05.894164 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cabef1a-2dd2-4b5c-b3c8-b1a8931d441f admin admin] RBAC: Authorizing `identity:delete_project(project_id=871d69ec855b4de9b81cf06d1e8182be)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:05.896128 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cabef1a-2dd2-4b5c-b3c8-b1a8931d441f admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:05.948746 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-1cabef1a-2dd2-4b5c-b3c8-b1a8931d441f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '871d69ec855b4de9b81cf06d1e8182be', 'request_id': 'req-1cabef1a-2dd2-4b5c-b3c8-b1a8931d441f'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:05.955204 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-1cabef1a-2dd2-4b5c-b3c8-b1a8931d441f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '871d69ec855b4de9b81cf06d1e8182be', 'request_id': 'req-1cabef1a-2dd2-4b5c-b3c8-b1a8931d441f'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:05.963262 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-1cabef1a-2dd2-4b5c-b3c8-b1a8931d441f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '871d69ec855b4de9b81cf06d1e8182be', 'request_id': 'req-1cabef1a-2dd2-4b5c-b3c8-b1a8931d441f'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:05.974660 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-1cabef1a-2dd2-4b5c-b3c8-b1a8931d441f admin admin] The token cache is being invalidate because project 871d69ec855b4de9b81cf06d1e8182be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:57:05.974958 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-1cabef1a-2dd2-4b5c-b3c8-b1a8931d441f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:05.975660 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-1cabef1a-2dd2-4b5c-b3c8-b1a8931d441f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:05.977511 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1245/2484] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:57:05 2022] DELETE /identity/v3/projects/871d69ec855b4de9b81cf06d1e8182be => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:57:05.981685 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12691d0a-2b94-438d-8e24-206afcd2294c service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:05.988765 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:06.006669 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12691d0a-2b94-438d-8e24-206afcd2294c service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:06.084675 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e6882-9516-48e2-a963-11adb1dec83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:06.085553 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e6882-9516-48e2-a963-11adb1dec83a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:06.085841 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e6882-9516-48e2-a963-11adb1dec83a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:06.086118 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e6882-9516-48e2-a963-11adb1dec83a admin admin] PATH_INFO: `/v3/users/46bd096750c84be6a32b51f413169ef6` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:06.087317 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3e6882-9516-48e2-a963-11adb1dec83a admin admin] RBAC: Authorizing `identity:delete_user(user_id=46bd096750c84be6a32b51f413169ef6)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:06.089761 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3e6882-9516-48e2-a963-11adb1dec83a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:06.144520 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6e3e6882-9516-48e2-a963-11adb1dec83a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46bd096750c84be6a32b51f413169ef6'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:06.145434 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6e3e6882-9516-48e2-a963-11adb1dec83a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46bd096750c84be6a32b51f413169ef6'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:06.146063 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6e3e6882-9516-48e2-a963-11adb1dec83a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46bd096750c84be6a32b51f413169ef6'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:06.160243 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6e3e6882-9516-48e2-a963-11adb1dec83a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46bd096750c84be6a32b51f413169ef6'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:06.169853 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6e3e6882-9516-48e2-a963-11adb1dec83a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46bd096750c84be6a32b51f413169ef6'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:06.186509 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1240/2485] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:57:05 2022] DELETE /identity/v3/users/46bd096750c84be6a32b51f413169ef6 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:57:06.910070 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cabef1a-2dd2-4b5c-b3c8-b1a8931d441f admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:06.912026 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-1cabef1a-2dd2-4b5c-b3c8-b1a8931d441f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:06.934324 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cabef1a-2dd2-4b5c-b3c8-b1a8931d441f admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:07.002986 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:07.011271 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3953e5e-7a0a-424f-924c-d96c5b852c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:07.012420 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3953e5e-7a0a-424f-924c-d96c5b852c56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:07.012911 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3953e5e-7a0a-424f-924c-d96c5b852c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:07.013379 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3953e5e-7a0a-424f-924c-d96c5b852c56 admin admin] PATH_INFO: `/v3/projects/5238a36d892d49179ed075524b4f2529` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:07.014900 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3953e5e-7a0a-424f-924c-d96c5b852c56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5238a36d892d49179ed075524b4f2529)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:07.017013 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3953e5e-7a0a-424f-924c-d96c5b852c56 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:07.070609 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-b3953e5e-7a0a-424f-924c-d96c5b852c56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5238a36d892d49179ed075524b4f2529', 'request_id': 'req-b3953e5e-7a0a-424f-924c-d96c5b852c56'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:07.076336 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-b3953e5e-7a0a-424f-924c-d96c5b852c56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5238a36d892d49179ed075524b4f2529', 'request_id': 'req-b3953e5e-7a0a-424f-924c-d96c5b852c56'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:07.084111 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-b3953e5e-7a0a-424f-924c-d96c5b852c56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5238a36d892d49179ed075524b4f2529', 'request_id': 'req-b3953e5e-7a0a-424f-924c-d96c5b852c56'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:07.095638 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-b3953e5e-7a0a-424f-924c-d96c5b852c56 admin admin] The token cache is being invalidate because project 5238a36d892d49179ed075524b4f2529 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:57:07.095942 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-b3953e5e-7a0a-424f-924c-d96c5b852c56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:07.096576 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-b3953e5e-7a0a-424f-924c-d96c5b852c56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:07.098530 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1246/2486] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:57:06 2022] DELETE /identity/v3/projects/5238a36d892d49179ed075524b4f2529 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:57:07.103514 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650a339-a565-4ddf-b39d-bc8ff40743ac None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:07.104173 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650a339-a565-4ddf-b39d-bc8ff40743ac None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:07.104363 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650a339-a565-4ddf-b39d-bc8ff40743ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:07.124573 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-7650a339-a565-4ddf-b39d-bc8ff40743ac None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:07.125780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7650a339-a565-4ddf-b39d-bc8ff40743ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:07.182709 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1241/2487] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 20:57:07.191781 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e49e5a-9c64-4f09-83c5-f7f9578a1da1 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:07.192097 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e49e5a-9c64-4f09-83c5-f7f9578a1da1 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:07.192383 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e49e5a-9c64-4f09-83c5-f7f9578a1da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:07.212862 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-f5e49e5a-9c64-4f09-83c5-f7f9578a1da1 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:07.214112 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-f5e49e5a-9c64-4f09-83c5-f7f9578a1da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:07.222798 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1247/2488] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:57:07.226999 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7650a339-a565-4ddf-b39d-bc8ff40743ac None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:07.237312 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7650a339-a565-4ddf-b39d-bc8ff40743ac None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:07.241845 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954194c4-e6df-4d92-9e51-2b223bc9f5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:07.242503 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954194c4-e6df-4d92-9e51-2b223bc9f5f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:07.242793 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954194c4-e6df-4d92-9e51-2b223bc9f5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:07.243076 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954194c4-e6df-4d92-9e51-2b223bc9f5f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:07.243810 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954194c4-e6df-4d92-9e51-2b223bc9f5f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:57:07.244165 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954194c4-e6df-4d92-9e51-2b223bc9f5f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:07.245769 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954194c4-e6df-4d92-9e51-2b223bc9f5f6 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:07.257261 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1242/2489] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:57:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:57:07.261255 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e49e5a-9c64-4f09-83c5-f7f9578a1da1 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:07.270219 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e49e5a-9c64-4f09-83c5-f7f9578a1da1 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:07.274746 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a66f1e-7b4a-4003-8a90-099b3e392c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:07.275386 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a66f1e-7b4a-4003-8a90-099b3e392c62 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:07.275670 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a66f1e-7b4a-4003-8a90-099b3e392c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:07.275970 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a66f1e-7b4a-4003-8a90-099b3e392c62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:07.276662 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a66f1e-7b4a-4003-8a90-099b3e392c62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:07.279068 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a66f1e-7b4a-4003-8a90-099b3e392c62 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:07.305204 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1248/2490] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:57:07 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:57:07.309081 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954194c4-e6df-4d92-9e51-2b223bc9f5f6 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:07.318987 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954194c4-e6df-4d92-9e51-2b223bc9f5f6 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:07.326645 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:07.377088 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06244c7c-ed81-4ade-9f44-9d9e558262f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:07.377749 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06244c7c-ed81-4ade-9f44-9d9e558262f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:07.378035 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06244c7c-ed81-4ade-9f44-9d9e558262f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:07.378315 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06244c7c-ed81-4ade-9f44-9d9e558262f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:07.379034 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06244c7c-ed81-4ade-9f44-9d9e558262f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:07.381006 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06244c7c-ed81-4ade-9f44-9d9e558262f3 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:07.399649 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1243/2491] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:57:07 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:57:07.404225 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a66f1e-7b4a-4003-8a90-099b3e392c62 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:07.414448 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a66f1e-7b4a-4003-8a90-099b3e392c62 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:07.419634 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c379c3-3477-47b9-9bac-3213ab2cefac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:07.420337 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c379c3-3477-47b9-9bac-3213ab2cefac admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:07.420633 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c379c3-3477-47b9-9bac-3213ab2cefac admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:07.420920 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c379c3-3477-47b9-9bac-3213ab2cefac admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:07.421650 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c379c3-3477-47b9-9bac-3213ab2cefac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:07.423238 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c379c3-3477-47b9-9bac-3213ab2cefac admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:07.433761 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1249/2492] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:57:07.437286 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06244c7c-ed81-4ade-9f44-9d9e558262f3 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:07.447054 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06244c7c-ed81-4ade-9f44-9d9e558262f3 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:07.451657 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b81f1-3f75-4e52-8103-a0dadefc81f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:07.452345 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b81f1-3f75-4e52-8103-a0dadefc81f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:07.452632 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b81f1-3f75-4e52-8103-a0dadefc81f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:07.452914 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b81f1-3f75-4e52-8103-a0dadefc81f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:07.453639 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624b81f1-3f75-4e52-8103-a0dadefc81f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:07.455210 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624b81f1-3f75-4e52-8103-a0dadefc81f7 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:07.465485 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1244/2493] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:57:07.469361 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c379c3-3477-47b9-9bac-3213ab2cefac admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:07.479795 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c379c3-3477-47b9-9bac-3213ab2cefac admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:07.485129 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845bc1f2-d3c1-4c7a-a56e-ca4728292c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:07.486009 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845bc1f2-d3c1-4c7a-a56e-ca4728292c87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:07.486293 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845bc1f2-d3c1-4c7a-a56e-ca4728292c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:07.486571 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845bc1f2-d3c1-4c7a-a56e-ca4728292c87 admin admin] PATH_INFO: `/v3/projects/5149d63ffb0e4f1e8ededfee2cb04397/users/e2e853ed0fd946da8b1204b2d0727c2b/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:07.504822 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845bc1f2-d3c1-4c7a-a56e-ca4728292c87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5149d63ffb0e4f1e8ededfee2cb04397, user_id=e2e853ed0fd946da8b1204b2d0727c2b, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:07.507559 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845bc1f2-d3c1-4c7a-a56e-ca4728292c87 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:07.521649 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1250/2494] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:57:07 2022] PUT /identity/v3/projects/5149d63ffb0e4f1e8ededfee2cb04397/users/e2e853ed0fd946da8b1204b2d0727c2b/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:57:07.532589 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709ff58-de40-4d9e-aafd-c39ed21daf4c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:07.532886 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709ff58-de40-4d9e-aafd-c39ed21daf4c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:07.533171 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709ff58-de40-4d9e-aafd-c39ed21daf4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:07.559829 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-d709ff58-de40-4d9e-aafd-c39ed21daf4c None None] MFA Rules not processed for user `e2e853ed0fd946da8b1204b2d0727c2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:07.561087 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d709ff58-de40-4d9e-aafd-c39ed21daf4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:07.637606 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1245/2495] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:57:07.639585 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845bc1f2-d3c1-4c7a-a56e-ca4728292c87 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:07.669419 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d709ff58-de40-4d9e-aafd-c39ed21daf4c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:07.671679 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d709ff58-de40-4d9e-aafd-c39ed21daf4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:07.725565 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845bc1f2-d3c1-4c7a-a56e-ca4728292c87 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:07.731171 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b4d5a8-a138-4cd8-9d22-6bd1853f5b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:07.731908 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4d5a8-a138-4cd8-9d22-6bd1853f5b07 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:07.732280 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4d5a8-a138-4cd8-9d22-6bd1853f5b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:07.732629 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4d5a8-a138-4cd8-9d22-6bd1853f5b07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:07.733399 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b4d5a8-a138-4cd8-9d22-6bd1853f5b07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:07.735360 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b4d5a8-a138-4cd8-9d22-6bd1853f5b07 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:07.746001 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d709ff58-de40-4d9e-aafd-c39ed21daf4c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:07.752009 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db224565-affd-4151-8c47-c9dcbb8edecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:07.753103 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db224565-affd-4151-8c47-c9dcbb8edecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:07.753496 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db224565-affd-4151-8c47-c9dcbb8edecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:07.753957 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db224565-affd-4151-8c47-c9dcbb8edecc admin admin] PATH_INFO: `/v3/users/d07c2fbe669e49ddbbc07dda543912d3` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:07.755303 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db224565-affd-4151-8c47-c9dcbb8edecc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d07c2fbe669e49ddbbc07dda543912d3)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:07.757450 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db224565-affd-4151-8c47-c9dcbb8edecc admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:07.764027 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1251/2496] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:57:07 2022] POST /identity/v3/projects => generated 383 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:57:07.768267 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b4d5a8-a138-4cd8-9d22-6bd1853f5b07 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:07.779301 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:07.791646 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:07.820822 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-db224565-affd-4151-8c47-c9dcbb8edecc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd07c2fbe669e49ddbbc07dda543912d3'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:07.821491 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-db224565-affd-4151-8c47-c9dcbb8edecc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd07c2fbe669e49ddbbc07dda543912d3'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:07.822276 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-db224565-affd-4151-8c47-c9dcbb8edecc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd07c2fbe669e49ddbbc07dda543912d3'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:07.834725 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-db224565-affd-4151-8c47-c9dcbb8edecc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd07c2fbe669e49ddbbc07dda543912d3'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:07.841118 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b4d5a8-a138-4cd8-9d22-6bd1853f5b07 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:07.844939 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-db224565-affd-4151-8c47-c9dcbb8edecc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd07c2fbe669e49ddbbc07dda543912d3'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:07.846889 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c9c894-ebd0-44ef-ba3f-4fd1e6bad499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:07.848007 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9c894-ebd0-44ef-ba3f-4fd1e6bad499 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:07.848303 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9c894-ebd0-44ef-ba3f-4fd1e6bad499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:07.848587 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9c894-ebd0-44ef-ba3f-4fd1e6bad499 admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:07.849294 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c9c894-ebd0-44ef-ba3f-4fd1e6bad499 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:07.851222 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c9c894-ebd0-44ef-ba3f-4fd1e6bad499 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:07.858269 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1246/2497] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:57:07 2022] DELETE /identity/v3/users/d07c2fbe669e49ddbbc07dda543912d3 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:57:07.859309 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db224565-affd-4151-8c47-c9dcbb8edecc admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:07.860666 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-db224565-affd-4151-8c47-c9dcbb8edecc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:07.874566 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1252/2498] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:57:07 2022] POST /identity/v3/users => generated 298 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 20:57:07.876025 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d156a544-4fcf-42a1-96bd-602c09c097c9 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:07.876323 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d156a544-4fcf-42a1-96bd-602c09c097c9 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:07.876740 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d156a544-4fcf-42a1-96bd-602c09c097c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:07.894240 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-d156a544-4fcf-42a1-96bd-602c09c097c9 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:07.895448 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-d156a544-4fcf-42a1-96bd-602c09c097c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:07.927214 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db224565-affd-4151-8c47-c9dcbb8edecc admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:07.931897 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f301492-cb82-46ac-b85f-e45d83045d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:07.932799 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f301492-cb82-46ac-b85f-e45d83045d99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:07.933078 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f301492-cb82-46ac-b85f-e45d83045d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:07.933890 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f301492-cb82-46ac-b85f-e45d83045d99 admin admin] PATH_INFO: `/v3/users/9dcb78e62b5044eea3fd91cf1235a03c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:07.935076 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f301492-cb82-46ac-b85f-e45d83045d99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dcb78e62b5044eea3fd91cf1235a03c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:07.937011 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f301492-cb82-46ac-b85f-e45d83045d99 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:07.962790 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1253/2499] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:57:07.962790 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d156a544-4fcf-42a1-96bd-602c09c097c9 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:07.962790 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-d156a544-4fcf-42a1-96bd-602c09c097c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:07.977372 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d156a544-4fcf-42a1-96bd-602c09c097c9 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:07.983074 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ea2fe-e16a-4c84-93ef-c3083151640c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:07.983741 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ea2fe-e16a-4c84-93ef-c3083151640c admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:07.984062 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ea2fe-e16a-4c84-93ef-c3083151640c admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:07.984680 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ea2fe-e16a-4c84-93ef-c3083151640c admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:07.985515 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740ea2fe-e16a-4c84-93ef-c3083151640c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:07.987232 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740ea2fe-e16a-4c84-93ef-c3083151640c admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:07.997856 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8f301492-cb82-46ac-b85f-e45d83045d99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dcb78e62b5044eea3fd91cf1235a03c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:07.998577 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8f301492-cb82-46ac-b85f-e45d83045d99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dcb78e62b5044eea3fd91cf1235a03c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:07.999257 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8f301492-cb82-46ac-b85f-e45d83045d99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dcb78e62b5044eea3fd91cf1235a03c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:08.003711 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1254/2500] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:57:08.003711 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ea2fe-e16a-4c84-93ef-c3083151640c admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:08.003711 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-740ea2fe-e16a-4c84-93ef-c3083151640c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:08.013491 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8f301492-cb82-46ac-b85f-e45d83045d99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dcb78e62b5044eea3fd91cf1235a03c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:08.021815 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8f301492-cb82-46ac-b85f-e45d83045d99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dcb78e62b5044eea3fd91cf1235a03c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:08.037490 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1247/2501] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:57:07 2022] DELETE /identity/v3/users/9dcb78e62b5044eea3fd91cf1235a03c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:57:08.041822 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f301492-cb82-46ac-b85f-e45d83045d99 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:08.043395 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8f301492-cb82-46ac-b85f-e45d83045d99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:08.067960 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:08.074898 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ea2fe-e16a-4c84-93ef-c3083151640c admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:08.121844 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f301492-cb82-46ac-b85f-e45d83045d99 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:08.124445 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:08.126908 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc91ad0-5e5a-4c84-a3c9-b3bc8603050e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:08.127902 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc91ad0-5e5a-4c84-a3c9-b3bc8603050e admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:08.128242 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc91ad0-5e5a-4c84-a3c9-b3bc8603050e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:08.128525 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc91ad0-5e5a-4c84-a3c9-b3bc8603050e admin admin] PATH_INFO: `/v3/projects/82cb5e79975846219df6e3b2a836fbe8/users/b7e510c642e34cef85a3d9995591bcbc/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:08.133284 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b418a8a9-d3af-40d6-86b6-3da4dedcd52a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:08.133983 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b418a8a9-d3af-40d6-86b6-3da4dedcd52a service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:08.134502 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b418a8a9-d3af-40d6-86b6-3da4dedcd52a service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:08.134924 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b418a8a9-d3af-40d6-86b6-3da4dedcd52a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:08.137347 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-b418a8a9-d3af-40d6-86b6-3da4dedcd52a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:08.143631 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc91ad0-5e5a-4c84-a3c9-b3bc8603050e admin admin] RBAC: Authorizing `identity:create_grant(project_id=82cb5e79975846219df6e3b2a836fbe8, user_id=b7e510c642e34cef85a3d9995591bcbc, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:08.146315 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc91ad0-5e5a-4c84-a3c9-b3bc8603050e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:08.149348 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b418a8a9-d3af-40d6-86b6-3da4dedcd52a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:08.150955 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b418a8a9-d3af-40d6-86b6-3da4dedcd52a service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:08.159206 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1248/2502] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:57:08 2022] PUT /identity/v3/projects/82cb5e79975846219df6e3b2a836fbe8/users/b7e510c642e34cef85a3d9995591bcbc/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:57:08.162339 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b5705-e692-4958-b8b9-22bb1a8ff904 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:08.162339 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b5705-e692-4958-b8b9-22bb1a8ff904 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:08.162339 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b5705-e692-4958-b8b9-22bb1a8ff904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:08.162580 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1255/2503] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:57:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:57:08.163073 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b418a8a9-d3af-40d6-86b6-3da4dedcd52a service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:08.172299 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b418a8a9-d3af-40d6-86b6-3da4dedcd52a service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:08.180460 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-9f6b5705-e692-4958-b8b9-22bb1a8ff904 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:08.181679 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9f6b5705-e692-4958-b8b9-22bb1a8ff904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:08.246804 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f264eade-0c9b-4f43-a28c-e84faa0ed107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:08.247510 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264eade-0c9b-4f43-a28c-e84faa0ed107 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:08.247847 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264eade-0c9b-4f43-a28c-e84faa0ed107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:08.248158 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264eade-0c9b-4f43-a28c-e84faa0ed107 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:08.248915 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f264eade-0c9b-4f43-a28c-e84faa0ed107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:08.250565 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f264eade-0c9b-4f43-a28c-e84faa0ed107 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:08.251962 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1249/2504] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:57:08.263674 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b5705-e692-4958-b8b9-22bb1a8ff904 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:08.265496 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9f6b5705-e692-4958-b8b9-22bb1a8ff904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:08.267618 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1256/2505] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 20:57:08.271562 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f264eade-0c9b-4f43-a28c-e84faa0ed107 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:08.283161 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f264eade-0c9b-4f43-a28c-e84faa0ed107 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:08.289290 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005568cf-2f8c-4505-9f20-5b2827fd92ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:08.290452 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005568cf-2f8c-4505-9f20-5b2827fd92ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:08.290769 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005568cf-2f8c-4505-9f20-5b2827fd92ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:08.291169 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005568cf-2f8c-4505-9f20-5b2827fd92ff admin admin] PATH_INFO: `/v3/projects/82cb5e79975846219df6e3b2a836fbe8/users/b7e510c642e34cef85a3d9995591bcbc/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:08.294027 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005568cf-2f8c-4505-9f20-5b2827fd92ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=82cb5e79975846219df6e3b2a836fbe8, user_id=b7e510c642e34cef85a3d9995591bcbc, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:08.297474 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005568cf-2f8c-4505-9f20-5b2827fd92ff admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:08.315217 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1257/2506] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:57:08 2022] PUT /identity/v3/projects/82cb5e79975846219df6e3b2a836fbe8/users/b7e510c642e34cef85a3d9995591bcbc/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:57:08.326466 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6defb-e13b-4fa7-a67f-f1c04e91cddf None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:08.327403 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6defb-e13b-4fa7-a67f-f1c04e91cddf None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:08.327403 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6defb-e13b-4fa7-a67f-f1c04e91cddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:08.351245 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b5705-e692-4958-b8b9-22bb1a8ff904 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:08.356430 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-7fb6defb-e13b-4fa7-a67f-f1c04e91cddf None None] MFA Rules not processed for user `b7e510c642e34cef85a3d9995591bcbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:08.357776 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-7fb6defb-e13b-4fa7-a67f-f1c04e91cddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:08.413722 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab515c58-53e0-4b51-ae1c-f34bb41eef73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:08.414383 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab515c58-53e0-4b51-ae1c-f34bb41eef73 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:08.414667 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab515c58-53e0-4b51-ae1c-f34bb41eef73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:08.415038 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab515c58-53e0-4b51-ae1c-f34bb41eef73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:08.426836 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:08.446687 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1258/2507] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:08 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:57:08.460120 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6defb-e13b-4fa7-a67f-f1c04e91cddf None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:08.461948 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-7fb6defb-e13b-4fa7-a67f-f1c04e91cddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:08.492050 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab515c58-53e0-4b51-ae1c-f34bb41eef73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:08.494310 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab515c58-53e0-4b51-ae1c-f34bb41eef73 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:08.505316 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1250/2508] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:57:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 20:57:08.506242 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab515c58-53e0-4b51-ae1c-f34bb41eef73 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:08.507609 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ab515c58-53e0-4b51-ae1c-f34bb41eef73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:08.521228 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab515c58-53e0-4b51-ae1c-f34bb41eef73 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:08.525969 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa53732-0954-4cee-b0c7-b67910a358df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:08.526842 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa53732-0954-4cee-b0c7-b67910a358df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:08.527681 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa53732-0954-4cee-b0c7-b67910a358df admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:08.528003 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa53732-0954-4cee-b0c7-b67910a358df admin admin] PATH_INFO: `/v3/projects/109dbe2386aa40ff93265a16dcc71d7d` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:08.529200 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa53732-0954-4cee-b0c7-b67910a358df admin admin] RBAC: Authorizing `identity:delete_project(project_id=109dbe2386aa40ff93265a16dcc71d7d)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:08.531627 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa53732-0954-4cee-b0c7-b67910a358df admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:08.532706 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6defb-e13b-4fa7-a67f-f1c04e91cddf None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:08.536493 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d99b70b-50ed-4a49-9154-dfb134622ee5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:08.537218 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99b70b-50ed-4a49-9154-dfb134622ee5 service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:08.537574 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99b70b-50ed-4a49-9154-dfb134622ee5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:08.538059 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99b70b-50ed-4a49-9154-dfb134622ee5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:08.549992 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d99b70b-50ed-4a49-9154-dfb134622ee5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:08.551842 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d99b70b-50ed-4a49-9154-dfb134622ee5 service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:08.557744 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:08.567398 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1259/2509] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:57:08 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 20:57:08.588897 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0fa53732-0954-4cee-b0c7-b67910a358df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '109dbe2386aa40ff93265a16dcc71d7d', 'request_id': 'req-0fa53732-0954-4cee-b0c7-b67910a358df'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:08.598017 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0fa53732-0954-4cee-b0c7-b67910a358df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '109dbe2386aa40ff93265a16dcc71d7d', 'request_id': 'req-0fa53732-0954-4cee-b0c7-b67910a358df'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:08.606596 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0fa53732-0954-4cee-b0c7-b67910a358df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '109dbe2386aa40ff93265a16dcc71d7d', 'request_id': 'req-0fa53732-0954-4cee-b0c7-b67910a358df'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:08.619626 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0fa53732-0954-4cee-b0c7-b67910a358df admin admin] The token cache is being invalidate because project 109dbe2386aa40ff93265a16dcc71d7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:57:08.619913 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0fa53732-0954-4cee-b0c7-b67910a358df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:08.620618 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0fa53732-0954-4cee-b0c7-b67910a358df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:08.622771 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1251/2510] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:57:08 2022] DELETE /identity/v3/projects/109dbe2386aa40ff93265a16dcc71d7d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:57:08.626888 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d99b70b-50ed-4a49-9154-dfb134622ee5 service cinder] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:08.639085 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d99b70b-50ed-4a49-9154-dfb134622ee5 service cinder] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:08.654890 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa53732-0954-4cee-b0c7-b67910a358df admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:08.656548 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0fa53732-0954-4cee-b0c7-b67910a358df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:08.727144 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa53732-0954-4cee-b0c7-b67910a358df admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:08.732025 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bbb274-45de-4728-b372-3d19f6f6d91e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:08.732703 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbb274-45de-4728-b372-3d19f6f6d91e service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:08.732703 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbb274-45de-4728-b372-3d19f6f6d91e service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:08.732946 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbb274-45de-4728-b372-3d19f6f6d91e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:08.733729 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e0d6b7-f7f0-45ea-a6eb-39ccfb05c355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:08.734761 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0d6b7-f7f0-45ea-a6eb-39ccfb05c355 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:08.735065 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0d6b7-f7f0-45ea-a6eb-39ccfb05c355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:08.735405 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0d6b7-f7f0-45ea-a6eb-39ccfb05c355 admin admin] PATH_INFO: `/v3/users/b8dba7d3dde94ee7a3bcbaf186c71e10` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:08.736295 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-13bbb274-45de-4728-b372-3d19f6f6d91e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:08.736823 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e0d6b7-f7f0-45ea-a6eb-39ccfb05c355 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8dba7d3dde94ee7a3bcbaf186c71e10)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:08.738777 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e0d6b7-f7f0-45ea-a6eb-39ccfb05c355 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:08.803147 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:08.804994 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-88e0d6b7-f7f0-45ea-a6eb-39ccfb05c355 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8dba7d3dde94ee7a3bcbaf186c71e10'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:08.805959 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-88e0d6b7-f7f0-45ea-a6eb-39ccfb05c355 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8dba7d3dde94ee7a3bcbaf186c71e10'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:08.819378 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-88e0d6b7-f7f0-45ea-a6eb-39ccfb05c355 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8dba7d3dde94ee7a3bcbaf186c71e10'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:08.820138 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bbb274-45de-4728-b372-3d19f6f6d91e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:08.822004 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bbb274-45de-4728-b372-3d19f6f6d91e service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:08.832270 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1252/2511] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:57:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:57:08.833195 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bbb274-45de-4728-b372-3d19f6f6d91e service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:08.834559 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-13bbb274-45de-4728-b372-3d19f6f6d91e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:08.837723 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-88e0d6b7-f7f0-45ea-a6eb-39ccfb05c355 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8dba7d3dde94ee7a3bcbaf186c71e10'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:08.838565 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-88e0d6b7-f7f0-45ea-a6eb-39ccfb05c355 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8dba7d3dde94ee7a3bcbaf186c71e10'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:08.867653 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1260/2512] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:57:08 2022] DELETE /identity/v3/users/b8dba7d3dde94ee7a3bcbaf186c71e10 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:57:08.868663 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e0d6b7-f7f0-45ea-a6eb-39ccfb05c355 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:08.880567 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-88e0d6b7-f7f0-45ea-a6eb-39ccfb05c355 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:08.934905 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bbb274-45de-4728-b372-3d19f6f6d91e service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:08.967593 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e0d6b7-f7f0-45ea-a6eb-39ccfb05c355 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:08.974766 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6109fce1-9b56-426c-b188-59d65e688b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:08.975657 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109fce1-9b56-426c-b188-59d65e688b53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:08.975956 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109fce1-9b56-426c-b188-59d65e688b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:08.976292 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109fce1-9b56-426c-b188-59d65e688b53 admin admin] PATH_INFO: `/v3/projects/0c954a1fe2884d6f83e276f08fa532bc` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:08.977525 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6109fce1-9b56-426c-b188-59d65e688b53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c954a1fe2884d6f83e276f08fa532bc)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:08.979496 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6109fce1-9b56-426c-b188-59d65e688b53 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:09.010456 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:09.049290 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-6109fce1-9b56-426c-b188-59d65e688b53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c954a1fe2884d6f83e276f08fa532bc', 'request_id': 'req-6109fce1-9b56-426c-b188-59d65e688b53'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:09.060128 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-6109fce1-9b56-426c-b188-59d65e688b53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c954a1fe2884d6f83e276f08fa532bc', 'request_id': 'req-6109fce1-9b56-426c-b188-59d65e688b53'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:09.070093 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ed4a3-22ff-44e1-a876-1f0cbb469434 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3918fe05c8634bc39f3e295374701465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:09.070797 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ed4a3-22ff-44e1-a876-1f0cbb469434 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:09.071115 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ed4a3-22ff-44e1-a876-1f0cbb469434 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:09.071367 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ed4a3-22ff-44e1-a876-1f0cbb469434 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:09.072969 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-6109fce1-9b56-426c-b188-59d65e688b53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c954a1fe2884d6f83e276f08fa532bc', 'request_id': 'req-6109fce1-9b56-426c-b188-59d65e688b53'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:09.073420 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6b3ed4a3-22ff-44e1-a876-1f0cbb469434 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:09.090324 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-6109fce1-9b56-426c-b188-59d65e688b53 admin admin] The token cache is being invalidate because project 0c954a1fe2884d6f83e276f08fa532bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:57:09.091217 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-6109fce1-9b56-426c-b188-59d65e688b53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:09.092370 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-6109fce1-9b56-426c-b188-59d65e688b53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:09.094340 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1261/2513] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:57:08 2022] DELETE /identity/v3/projects/0c954a1fe2884d6f83e276f08fa532bc => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:57:09.099481 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6109fce1-9b56-426c-b188-59d65e688b53 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:09.101569 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-6109fce1-9b56-426c-b188-59d65e688b53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:09.190403 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3ed4a3-22ff-44e1-a876-1f0cbb469434 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:09.192140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3ed4a3-22ff-44e1-a876-1f0cbb469434 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:09.199872 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:09.224449 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1253/2514] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:57:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:57:09.225492 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ed4a3-22ff-44e1-a876-1f0cbb469434 service nova] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:09.227231 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6b3ed4a3-22ff-44e1-a876-1f0cbb469434 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:09.264229 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6109fce1-9b56-426c-b188-59d65e688b53 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:09.270351 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a788318-6ec5-4423-bf65-3fa0fe76e27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:09.271335 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a788318-6ec5-4423-bf65-3fa0fe76e27c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:09.272174 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a788318-6ec5-4423-bf65-3fa0fe76e27c admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:09.272174 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a788318-6ec5-4423-bf65-3fa0fe76e27c admin admin] PATH_INFO: `/v3/users/76f4ccf4264a433cb40c8c9f06a70fd3` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:09.273541 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a788318-6ec5-4423-bf65-3fa0fe76e27c admin admin] RBAC: Authorizing `identity:delete_user(user_id=76f4ccf4264a433cb40c8c9f06a70fd3)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:09.276355 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a788318-6ec5-4423-bf65-3fa0fe76e27c admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:09.282809 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ed4a3-22ff-44e1-a876-1f0cbb469434 service nova] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:09.298088 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57289b9-d254-4e4f-b50f-0d095f0f7952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:09.299297 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57289b9-d254-4e4f-b50f-0d095f0f7952 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:09.299851 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57289b9-d254-4e4f-b50f-0d095f0f7952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:09.300418 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57289b9-d254-4e4f-b50f-0d095f0f7952 admin admin] PATH_INFO: `/v3/projects/7e1c78b7ef794d6f8f89c4720572e623` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:09.302168 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57289b9-d254-4e4f-b50f-0d095f0f7952 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e1c78b7ef794d6f8f89c4720572e623)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:09.305053 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57289b9-d254-4e4f-b50f-0d095f0f7952 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:09.343507 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-4a788318-6ec5-4423-bf65-3fa0fe76e27c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76f4ccf4264a433cb40c8c9f06a70fd3'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:09.344538 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-4a788318-6ec5-4423-bf65-3fa0fe76e27c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76f4ccf4264a433cb40c8c9f06a70fd3'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:09.353601 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-4a788318-6ec5-4423-bf65-3fa0fe76e27c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76f4ccf4264a433cb40c8c9f06a70fd3'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:09.362005 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f57289b9-d254-4e4f-b50f-0d095f0f7952 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e1c78b7ef794d6f8f89c4720572e623', 'request_id': 'req-f57289b9-d254-4e4f-b50f-0d095f0f7952'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:09.369035 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-4a788318-6ec5-4423-bf65-3fa0fe76e27c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76f4ccf4264a433cb40c8c9f06a70fd3'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:09.369924 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-4a788318-6ec5-4423-bf65-3fa0fe76e27c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76f4ccf4264a433cb40c8c9f06a70fd3'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:09.370269 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f57289b9-d254-4e4f-b50f-0d095f0f7952 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e1c78b7ef794d6f8f89c4720572e623', 'request_id': 'req-f57289b9-d254-4e4f-b50f-0d095f0f7952'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:09.376260 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f57289b9-d254-4e4f-b50f-0d095f0f7952 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e1c78b7ef794d6f8f89c4720572e623', 'request_id': 'req-f57289b9-d254-4e4f-b50f-0d095f0f7952'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:09.384830 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1262/2515] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:57:09 2022] DELETE /identity/v3/users/76f4ccf4264a433cb40c8c9f06a70fd3 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:57:09.385885 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a788318-6ec5-4423-bf65-3fa0fe76e27c admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:09.387873 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-4a788318-6ec5-4423-bf65-3fa0fe76e27c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:09.393417 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f57289b9-d254-4e4f-b50f-0d095f0f7952 admin admin] The token cache is being invalidate because project 7e1c78b7ef794d6f8f89c4720572e623 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:57:09.393719 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f57289b9-d254-4e4f-b50f-0d095f0f7952 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:09.394604 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f57289b9-d254-4e4f-b50f-0d095f0f7952 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:09.397478 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1254/2516] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:57:09 2022] DELETE /identity/v3/projects/7e1c78b7ef794d6f8f89c4720572e623 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:57:09.403729 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b9325-ac57-40f6-bec8-73b899826095 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:09.404391 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b9325-ac57-40f6-bec8-73b899826095 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:09.404691 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b9325-ac57-40f6-bec8-73b899826095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:09.436130 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:09.438342 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-984b9325-ac57-40f6-bec8-73b899826095 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:09.440049 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-984b9325-ac57-40f6-bec8-73b899826095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:09.507713 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a788318-6ec5-4423-bf65-3fa0fe76e27c admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:09.513389 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1e614-3f00-405d-a05a-b085e318f93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:09.514334 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1e614-3f00-405d-a05a-b085e318f93b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:09.514771 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1e614-3f00-405d-a05a-b085e318f93b admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:09.515067 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1e614-3f00-405d-a05a-b085e318f93b admin admin] PATH_INFO: `/v3/users/e2e853ed0fd946da8b1204b2d0727c2b` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:09.516890 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c1e614-3f00-405d-a05a-b085e318f93b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2e853ed0fd946da8b1204b2d0727c2b)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:09.519417 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c1e614-3f00-405d-a05a-b085e318f93b admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:09.536088 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1255/2517] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 20:57:09.540346 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3968b-6ed4-431d-8cb7-4757a65d9bc9 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:09.540692 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3968b-6ed4-431d-8cb7-4757a65d9bc9 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:09.540884 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3968b-6ed4-431d-8cb7-4757a65d9bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:09.584069 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-85a3968b-6ed4-431d-8cb7-4757a65d9bc9 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:09.585342 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-85a3968b-6ed4-431d-8cb7-4757a65d9bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:09.595250 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1256/2518] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:57:09.600589 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a3968b-6ed4-431d-8cb7-4757a65d9bc9 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:09.612607 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a3968b-6ed4-431d-8cb7-4757a65d9bc9 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:09.614582 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-46c1e614-3f00-405d-a05a-b085e318f93b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2e853ed0fd946da8b1204b2d0727c2b'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:09.615141 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-46c1e614-3f00-405d-a05a-b085e318f93b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2e853ed0fd946da8b1204b2d0727c2b'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:09.629037 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b891cf93-8c11-4a5e-a190-921ea69829b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:09.629868 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891cf93-8c11-4a5e-a190-921ea69829b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:09.630244 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891cf93-8c11-4a5e-a190-921ea69829b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:09.630577 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891cf93-8c11-4a5e-a190-921ea69829b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:09.631679 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b891cf93-8c11-4a5e-a190-921ea69829b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:57:09.632154 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b891cf93-8c11-4a5e-a190-921ea69829b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:09.634231 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b891cf93-8c11-4a5e-a190-921ea69829b9 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:09.642678 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-46c1e614-3f00-405d-a05a-b085e318f93b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2e853ed0fd946da8b1204b2d0727c2b'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:09.647843 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1257/2519] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:57:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:57:09.652843 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b891cf93-8c11-4a5e-a190-921ea69829b9 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:09.654813 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b891cf93-8c11-4a5e-a190-921ea69829b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:09.671674 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b891cf93-8c11-4a5e-a190-921ea69829b9 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:09.677196 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-46c1e614-3f00-405d-a05a-b085e318f93b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2e853ed0fd946da8b1204b2d0727c2b'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:09.678936 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-46c1e614-3f00-405d-a05a-b085e318f93b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2e853ed0fd946da8b1204b2d0727c2b'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:09.679264 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca23cbf5-6a89-47d4-ba85-a30c6d5b2c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:09.681156 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23cbf5-6a89-47d4-ba85-a30c6d5b2c04 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:09.681643 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23cbf5-6a89-47d4-ba85-a30c6d5b2c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:09.682147 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23cbf5-6a89-47d4-ba85-a30c6d5b2c04 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:09.683841 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca23cbf5-6a89-47d4-ba85-a30c6d5b2c04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:09.686023 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca23cbf5-6a89-47d4-ba85-a30c6d5b2c04 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:09.705496 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1263/2520] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:57:09 2022] DELETE /identity/v3/users/e2e853ed0fd946da8b1204b2d0727c2b => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:57:09.709983 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698da8b-97b4-43d3-a561-803011e5c748 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:09.710534 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698da8b-97b4-43d3-a561-803011e5c748 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:09.711190 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698da8b-97b4-43d3-a561-803011e5c748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:09.736503 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1258/2521] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:57:09 2022] POST /identity/v3/projects => generated 371 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 20:57:09.737861 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca23cbf5-6a89-47d4-ba85-a30c6d5b2c04 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:09.739579 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ca23cbf5-6a89-47d4-ba85-a30c6d5b2c04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:09.740508 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-b698da8b-97b4-43d3-a561-803011e5c748 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:09.742094 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-b698da8b-97b4-43d3-a561-803011e5c748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:09.780612 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:09.813215 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1264/2522] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:57:09.813215 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b698da8b-97b4-43d3-a561-803011e5c748 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:09.819429 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca23cbf5-6a89-47d4-ba85-a30c6d5b2c04 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:09.820079 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b698da8b-97b4-43d3-a561-803011e5c748 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:09.824443 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c6148-28a5-438b-bdfc-d31c246dc988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:09.824653 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94144187-e63f-45c6-a3ac-387e3fe9f951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:09.825307 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94144187-e63f-45c6-a3ac-387e3fe9f951 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:09.825410 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c6148-28a5-438b-bdfc-d31c246dc988 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:09.825587 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c6148-28a5-438b-bdfc-d31c246dc988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:09.825708 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94144187-e63f-45c6-a3ac-387e3fe9f951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:09.825867 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94144187-e63f-45c6-a3ac-387e3fe9f951 admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:09.825961 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c6148-28a5-438b-bdfc-d31c246dc988 admin admin] PATH_INFO: `/v3/projects/c9c5fad639a6451aaf0c0de61080908c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:09.826550 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94144187-e63f-45c6-a3ac-387e3fe9f951 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:09.827043 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c6148-28a5-438b-bdfc-d31c246dc988 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9c5fad639a6451aaf0c0de61080908c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:09.828482 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94144187-e63f-45c6-a3ac-387e3fe9f951 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:09.829022 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c6148-28a5-438b-bdfc-d31c246dc988 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:09.851421 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1265/2523] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:57:09 2022] POST /identity/v3/users => generated 286 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:57:09.852276 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94144187-e63f-45c6-a3ac-387e3fe9f951 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:09.859032 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-94144187-e63f-45c6-a3ac-387e3fe9f951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:09.880954 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b63c6148-28a5-438b-bdfc-d31c246dc988 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9c5fad639a6451aaf0c0de61080908c', 'request_id': 'req-b63c6148-28a5-438b-bdfc-d31c246dc988'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:09.889198 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b63c6148-28a5-438b-bdfc-d31c246dc988 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9c5fad639a6451aaf0c0de61080908c', 'request_id': 'req-b63c6148-28a5-438b-bdfc-d31c246dc988'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:09.893540 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:09.896291 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b63c6148-28a5-438b-bdfc-d31c246dc988 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9c5fad639a6451aaf0c0de61080908c', 'request_id': 'req-b63c6148-28a5-438b-bdfc-d31c246dc988'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:09.907561 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b63c6148-28a5-438b-bdfc-d31c246dc988 admin admin] The token cache is being invalidate because project c9c5fad639a6451aaf0c0de61080908c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:57:09.907845 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b63c6148-28a5-438b-bdfc-d31c246dc988 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:09.908560 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b63c6148-28a5-438b-bdfc-d31c246dc988 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:09.910101 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1259/2524] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:57:09 2022] DELETE /identity/v3/projects/c9c5fad639a6451aaf0c0de61080908c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:57:09.910861 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c6148-28a5-438b-bdfc-d31c246dc988 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:09.912186 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b63c6148-28a5-438b-bdfc-d31c246dc988 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:09.923566 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94144187-e63f-45c6-a3ac-387e3fe9f951 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:09.973037 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8e0a8a-9792-4ac8-94e8-5cd9f2386ad4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:09.973726 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e0a8a-9792-4ac8-94e8-5cd9f2386ad4 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:09.974002 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e0a8a-9792-4ac8-94e8-5cd9f2386ad4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:09.974280 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e0a8a-9792-4ac8-94e8-5cd9f2386ad4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:09.976116 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-8d8e0a8a-9792-4ac8-94e8-5cd9f2386ad4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:09.978969 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c6148-28a5-438b-bdfc-d31c246dc988 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:09.984188 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebaa7c9-716f-4469-8689-cb69460965cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:09.984874 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebaa7c9-716f-4469-8689-cb69460965cd admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:09.985165 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebaa7c9-716f-4469-8689-cb69460965cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:09.985446 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebaa7c9-716f-4469-8689-cb69460965cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:09.986190 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebaa7c9-716f-4469-8689-cb69460965cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:09.987798 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebaa7c9-716f-4469-8689-cb69460965cd admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:09.989046 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8e0a8a-9792-4ac8-94e8-5cd9f2386ad4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:09.990557 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8e0a8a-9792-4ac8-94e8-5cd9f2386ad4 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:09.999603 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1260/2525] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:57:10.001244 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614ae55-90a2-4ef7-b55f-7465b0dbc235 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:10.001579 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614ae55-90a2-4ef7-b55f-7465b0dbc235 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:10.001929 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614ae55-90a2-4ef7-b55f-7465b0dbc235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:10.002718 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1266/2526] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:57:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:57:10.003551 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8e0a8a-9792-4ac8-94e8-5cd9f2386ad4 service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:10.014196 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8e0a8a-9792-4ac8-94e8-5cd9f2386ad4 service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:10.018900 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdb227c-af0b-487b-96ef-ffa60f25fa4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:10.019562 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb227c-af0b-487b-96ef-ffa60f25fa4d admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:10.019859 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb227c-af0b-487b-96ef-ffa60f25fa4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:10.020158 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb227c-af0b-487b-96ef-ffa60f25fa4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:10.020877 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdb227c-af0b-487b-96ef-ffa60f25fa4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:10.022466 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdb227c-af0b-487b-96ef-ffa60f25fa4d admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:10.025833 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-9614ae55-90a2-4ef7-b55f-7465b0dbc235 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:10.027533 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9614ae55-90a2-4ef7-b55f-7465b0dbc235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:10.036265 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1267/2527] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:57:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:57:10.040153 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdb227c-af0b-487b-96ef-ffa60f25fa4d admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:10.041840 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1261/2528] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:57:10.049864 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa3b84-da5c-4385-b582-195b85fc3936 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:10.049864 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa3b84-da5c-4385-b582-195b85fc3936 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:10.050326 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa3b84-da5c-4385-b582-195b85fc3936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:10.052579 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdb227c-af0b-487b-96ef-ffa60f25fa4d admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:10.058012 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc6a10-94ac-4c9d-b033-149bc804b70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:10.059609 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc6a10-94ac-4c9d-b033-149bc804b70d admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:10.060227 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc6a10-94ac-4c9d-b033-149bc804b70d admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:10.060227 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc6a10-94ac-4c9d-b033-149bc804b70d admin admin] PATH_INFO: `/v3/projects/16464e66cf9b45b690ea9e62bcdebc61/users/51459b15bc044d4a83ec46bdaa77b7bd/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:10.073846 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-67fa3b84-da5c-4385-b582-195b85fc3936 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:10.075108 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-67fa3b84-da5c-4385-b582-195b85fc3936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:10.078588 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc6a10-94ac-4c9d-b033-149bc804b70d admin admin] RBAC: Authorizing `identity:create_grant(project_id=16464e66cf9b45b690ea9e62bcdebc61, user_id=51459b15bc044d4a83ec46bdaa77b7bd, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:10.081782 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc6a10-94ac-4c9d-b033-149bc804b70d admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:10.085705 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1262/2529] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 20:57:10.090656 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa3b84-da5c-4385-b582-195b85fc3936 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:10.097509 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1268/2530] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:57:10 2022] PUT /identity/v3/projects/16464e66cf9b45b690ea9e62bcdebc61/users/51459b15bc044d4a83ec46bdaa77b7bd/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:57:10.102943 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e03c9-ec87-4357-94f5-91e0ce8336ee None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:10.103495 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e03c9-ec87-4357-94f5-91e0ce8336ee None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:10.104055 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e03c9-ec87-4357-94f5-91e0ce8336ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:10.104259 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa3b84-da5c-4385-b582-195b85fc3936 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:10.123818 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-a09e03c9-ec87-4357-94f5-91e0ce8336ee None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:10.125078 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-a09e03c9-ec87-4357-94f5-91e0ce8336ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:10.156525 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:10.180176 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9755aa-f482-4b76-8abb-7b5e556da0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:10.180392 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9755aa-f482-4b76-8abb-7b5e556da0e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:10.180680 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9755aa-f482-4b76-8abb-7b5e556da0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:10.181065 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9755aa-f482-4b76-8abb-7b5e556da0e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:10.182046 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9755aa-f482-4b76-8abb-7b5e556da0e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:57:10.182046 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9755aa-f482-4b76-8abb-7b5e556da0e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:10.184225 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9755aa-f482-4b76-8abb-7b5e556da0e9 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:10.199065 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1269/2531] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 20:57:10.199462 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1263/2532] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:57:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:57:10.206336 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9755aa-f482-4b76-8abb-7b5e556da0e9 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:10.209955 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09e03c9-ec87-4357-94f5-91e0ce8336ee None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:10.211457 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-a09e03c9-ec87-4357-94f5-91e0ce8336ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:10.219982 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9755aa-f482-4b76-8abb-7b5e556da0e9 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:10.225091 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e1faff-a0b9-4481-b6c6-d6ef9a6ed0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:10.225860 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1faff-a0b9-4481-b6c6-d6ef9a6ed0d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:10.226155 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1faff-a0b9-4481-b6c6-d6ef9a6ed0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:10.226437 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1faff-a0b9-4481-b6c6-d6ef9a6ed0d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:10.227164 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e1faff-a0b9-4481-b6c6-d6ef9a6ed0d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:10.229097 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e1faff-a0b9-4481-b6c6-d6ef9a6ed0d2 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:10.262270 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1264/2533] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:57:10 2022] POST /identity/v3/projects => generated 407 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:57:10.263577 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e1faff-a0b9-4481-b6c6-d6ef9a6ed0d2 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:10.276386 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09e03c9-ec87-4357-94f5-91e0ce8336ee None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:10.282141 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:10.340407 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce4dbf-5ed1-48b8-a3cd-edcce4413516 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:10.341309 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce4dbf-5ed1-48b8-a3cd-edcce4413516 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:10.341608 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce4dbf-5ed1-48b8-a3cd-edcce4413516 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:10.341893 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce4dbf-5ed1-48b8-a3cd-edcce4413516 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:10.345984 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e1faff-a0b9-4481-b6c6-d6ef9a6ed0d2 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:10.352267 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9759e540-02fb-4529-8cbf-bf1637fc25a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:10.352465 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ce4dbf-5ed1-48b8-a3cd-edcce4413516 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:10.352947 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759e540-02fb-4529-8cbf-bf1637fc25a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:10.353237 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759e540-02fb-4529-8cbf-bf1637fc25a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:10.353649 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759e540-02fb-4529-8cbf-bf1637fc25a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:10.354445 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9759e540-02fb-4529-8cbf-bf1637fc25a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:10.354992 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ce4dbf-5ed1-48b8-a3cd-edcce4413516 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:10.356548 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9759e540-02fb-4529-8cbf-bf1637fc25a6 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:10.368554 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1270/2534] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:57:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 20:57:10.369594 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce4dbf-5ed1-48b8-a3cd-edcce4413516 service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:10.371879 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-f6ce4dbf-5ed1-48b8-a3cd-edcce4413516 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:10.384756 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1265/2535] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:57:10 2022] POST /identity/v3/users => generated 304 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:57:10.387151 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9759e540-02fb-4529-8cbf-bf1637fc25a6 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:10.393640 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce4dbf-5ed1-48b8-a3cd-edcce4413516 service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:10.401287 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712d549-a8f2-44e2-b1a3-42700cfac084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:10.401805 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9759e540-02fb-4529-8cbf-bf1637fc25a6 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:10.402683 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712d549-a8f2-44e2-b1a3-42700cfac084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:10.403731 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712d549-a8f2-44e2-b1a3-42700cfac084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:10.403731 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712d549-a8f2-44e2-b1a3-42700cfac084 admin admin] PATH_INFO: `/v3/projects/5149d63ffb0e4f1e8ededfee2cb04397` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:10.405521 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712d549-a8f2-44e2-b1a3-42700cfac084 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5149d63ffb0e4f1e8ededfee2cb04397)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:10.407801 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712d549-a8f2-44e2-b1a3-42700cfac084 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:10.415038 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e80b7-73a3-4101-8b68-87a90af9b607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:10.416667 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e80b7-73a3-4101-8b68-87a90af9b607 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:10.416925 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e80b7-73a3-4101-8b68-87a90af9b607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:10.417274 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e80b7-73a3-4101-8b68-87a90af9b607 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:10.420533 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e80b7-73a3-4101-8b68-87a90af9b607 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:10.423278 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e80b7-73a3-4101-8b68-87a90af9b607 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:10.436450 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1266/2536] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:57:10 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:57:10.440707 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e80b7-73a3-4101-8b68-87a90af9b607 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:10.453488 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e80b7-73a3-4101-8b68-87a90af9b607 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:10.458855 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b9bd5-298f-4557-bc53-f448a2bb2013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:10.460173 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b9bd5-298f-4557-bc53-f448a2bb2013 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:10.460173 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b9bd5-298f-4557-bc53-f448a2bb2013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:10.460410 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b9bd5-298f-4557-bc53-f448a2bb2013 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:10.461024 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86b9bd5-298f-4557-bc53-f448a2bb2013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:10.462746 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86b9bd5-298f-4557-bc53-f448a2bb2013 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:10.474711 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1267/2537] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:57:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:57:10.479520 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b9bd5-298f-4557-bc53-f448a2bb2013 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:10.484576 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-6712d549-a8f2-44e2-b1a3-42700cfac084 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5149d63ffb0e4f1e8ededfee2cb04397', 'request_id': 'req-6712d549-a8f2-44e2-b1a3-42700cfac084'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:10.490290 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b9bd5-298f-4557-bc53-f448a2bb2013 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:10.492804 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-6712d549-a8f2-44e2-b1a3-42700cfac084 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5149d63ffb0e4f1e8ededfee2cb04397', 'request_id': 'req-6712d549-a8f2-44e2-b1a3-42700cfac084'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:10.503593 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-6712d549-a8f2-44e2-b1a3-42700cfac084 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5149d63ffb0e4f1e8ededfee2cb04397', 'request_id': 'req-6712d549-a8f2-44e2-b1a3-42700cfac084'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:10.517533 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-6712d549-a8f2-44e2-b1a3-42700cfac084 admin admin] The token cache is being invalidate because project 5149d63ffb0e4f1e8ededfee2cb04397 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:57:10.518285 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-6712d549-a8f2-44e2-b1a3-42700cfac084 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:10.519169 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-6712d549-a8f2-44e2-b1a3-42700cfac084 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:10.521965 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1271/2538] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:57:10 2022] DELETE /identity/v3/projects/5149d63ffb0e4f1e8ededfee2cb04397 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:57:10.526766 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712d549-a8f2-44e2-b1a3-42700cfac084 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:10.529411 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-6712d549-a8f2-44e2-b1a3-42700cfac084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:10.577499 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32054a-aac6-42cf-9215-bbb56585d963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:10.578404 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32054a-aac6-42cf-9215-bbb56585d963 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:10.578804 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32054a-aac6-42cf-9215-bbb56585d963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:10.579215 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32054a-aac6-42cf-9215-bbb56585d963 admin admin] PATH_INFO: `/v3/projects/6cb77e4ca234499bb6a4fa8d197a4cf3/users/6b5e19521096443eaf976e3a5d5805f7/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:10.595727 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce32054a-aac6-42cf-9215-bbb56585d963 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cb77e4ca234499bb6a4fa8d197a4cf3, user_id=6b5e19521096443eaf976e3a5d5805f7, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:10.598858 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce32054a-aac6-42cf-9215-bbb56585d963 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:10.613927 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1268/2539] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:57:10 2022] PUT /identity/v3/projects/6cb77e4ca234499bb6a4fa8d197a4cf3/users/6b5e19521096443eaf976e3a5d5805f7/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:57:10.617932 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712d549-a8f2-44e2-b1a3-42700cfac084 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:10.624934 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085a6e4-e6d9-43d5-aeca-56a6520c8158 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:10.625386 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085a6e4-e6d9-43d5-aeca-56a6520c8158 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:10.625709 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085a6e4-e6d9-43d5-aeca-56a6520c8158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:10.645148 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:10.655432 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-d085a6e4-e6d9-43d5-aeca-56a6520c8158 None None] MFA Rules not processed for user `6b5e19521096443eaf976e3a5d5805f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:10.657564 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d085a6e4-e6d9-43d5-aeca-56a6520c8158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:10.663898 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:10.692902 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb113c78-6ee6-4d6f-bc52-1f817753cc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:10.694200 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb113c78-6ee6-4d6f-bc52-1f817753cc9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:10.694621 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb113c78-6ee6-4d6f-bc52-1f817753cc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:10.695429 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb113c78-6ee6-4d6f-bc52-1f817753cc9a admin admin] PATH_INFO: `/v3/users/b7e510c642e34cef85a3d9995591bcbc` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:10.696870 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb113c78-6ee6-4d6f-bc52-1f817753cc9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7e510c642e34cef85a3d9995591bcbc)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:10.699475 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb113c78-6ee6-4d6f-bc52-1f817753cc9a admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:10.758975 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1269/2540] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:10 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 20:57:10.763267 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d085a6e4-e6d9-43d5-aeca-56a6520c8158 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:10.764992 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d085a6e4-e6d9-43d5-aeca-56a6520c8158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:10.791149 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-fb113c78-6ee6-4d6f-bc52-1f817753cc9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7e510c642e34cef85a3d9995591bcbc'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:10.793159 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-fb113c78-6ee6-4d6f-bc52-1f817753cc9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7e510c642e34cef85a3d9995591bcbc'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:10.797738 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d085a6e4-e6d9-43d5-aeca-56a6520c8158 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:10.807338 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-fb113c78-6ee6-4d6f-bc52-1f817753cc9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7e510c642e34cef85a3d9995591bcbc'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:10.814265 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0641d235-1669-479f-a839-3b03a5dbbe77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:10.814947 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641d235-1669-479f-a839-3b03a5dbbe77 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:10.815242 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641d235-1669-479f-a839-3b03a5dbbe77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:10.815534 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641d235-1669-479f-a839-3b03a5dbbe77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:10.816278 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0641d235-1669-479f-a839-3b03a5dbbe77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:10.818195 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0641d235-1669-479f-a839-3b03a5dbbe77 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:10.830752 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-fb113c78-6ee6-4d6f-bc52-1f817753cc9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7e510c642e34cef85a3d9995591bcbc'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:10.833835 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-fb113c78-6ee6-4d6f-bc52-1f817753cc9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7e510c642e34cef85a3d9995591bcbc'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:10.868378 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1270/2542] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:57:10 2022] POST /identity/v3/projects => generated 407 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 20:57:10.869286 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0641d235-1669-479f-a839-3b03a5dbbe77 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:10.871549 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0641d235-1669-479f-a839-3b03a5dbbe77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:10.872995 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1272/2542] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:57:10 2022] DELETE /identity/v3/users/b7e510c642e34cef85a3d9995591bcbc => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:57:10.956001 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0641d235-1669-479f-a839-3b03a5dbbe77 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:10.965657 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f662b6f9-d521-4c35-8989-298aa0ab47ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:10.967203 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662b6f9-d521-4c35-8989-298aa0ab47ea admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:10.967553 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662b6f9-d521-4c35-8989-298aa0ab47ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:10.967844 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662b6f9-d521-4c35-8989-298aa0ab47ea admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:10.968773 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f662b6f9-d521-4c35-8989-298aa0ab47ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:10.971328 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f662b6f9-d521-4c35-8989-298aa0ab47ea admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:11.003805 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1271/2543] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:57:10 2022] POST /identity/v3/users => generated 310 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:57:11.005266 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb113c78-6ee6-4d6f-bc52-1f817753cc9a admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:11.101509 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb113c78-6ee6-4d6f-bc52-1f817753cc9a admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:11.109718 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40cbca8-383d-4825-afee-f547d210f18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:11.110468 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cbca8-383d-4825-afee-f547d210f18c admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:11.110766 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cbca8-383d-4825-afee-f547d210f18c admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:11.111585 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cbca8-383d-4825-afee-f547d210f18c admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:11.112044 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40cbca8-383d-4825-afee-f547d210f18c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:11.113795 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40cbca8-383d-4825-afee-f547d210f18c admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:11.147441 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1273/2544] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:57:11.149443 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f662b6f9-d521-4c35-8989-298aa0ab47ea admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:11.165486 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc1265-efda-4a7a-b18a-b3d30b0674d6 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:11.165792 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc1265-efda-4a7a-b18a-b3d30b0674d6 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:11.166076 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc1265-efda-4a7a-b18a-b3d30b0674d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:11.171270 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f662b6f9-d521-4c35-8989-298aa0ab47ea admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:11.185370 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83583ca9-b717-416e-b870-07f4c45354ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:11.185966 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83583ca9-b717-416e-b870-07f4c45354ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:11.186253 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83583ca9-b717-416e-b870-07f4c45354ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:11.186596 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83583ca9-b717-416e-b870-07f4c45354ce admin admin] PATH_INFO: `/v3/projects/c008d3a7c9814cff8806366bc2ee88ea/users/7120fe9c4e6b4847925f3fd6660a5ab5/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:11.211721 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-1bcc1265-efda-4a7a-b18a-b3d30b0674d6 None None] MFA Rules not processed for user `51459b15bc044d4a83ec46bdaa77b7bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:11.212951 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-1bcc1265-efda-4a7a-b18a-b3d30b0674d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:11.223543 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83583ca9-b717-416e-b870-07f4c45354ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=c008d3a7c9814cff8806366bc2ee88ea, user_id=7120fe9c4e6b4847925f3fd6660a5ab5, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:11.226822 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83583ca9-b717-416e-b870-07f4c45354ce admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:11.247909 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1272/2545] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:57:11 2022] PUT /identity/v3/projects/c008d3a7c9814cff8806366bc2ee88ea/users/7120fe9c4e6b4847925f3fd6660a5ab5/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:57:11.249113 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83583ca9-b717-416e-b870-07f4c45354ce admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:11.252759 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-83583ca9-b717-416e-b870-07f4c45354ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:11.301846 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:11.328201 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:11.334494 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1274/2546] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:57:11.335456 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc1265-efda-4a7a-b18a-b3d30b0674d6 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:11.349146 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc1265-efda-4a7a-b18a-b3d30b0674d6 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:11.354874 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c4383-203b-40f0-8621-6cb7762d61fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:11.355407 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83583ca9-b717-416e-b870-07f4c45354ce admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:11.355734 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c4383-203b-40f0-8621-6cb7762d61fa admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:11.355929 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c4383-203b-40f0-8621-6cb7762d61fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:11.356237 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c4383-203b-40f0-8621-6cb7762d61fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:11.356969 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84c4383-203b-40f0-8621-6cb7762d61fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:11.358834 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84c4383-203b-40f0-8621-6cb7762d61fa admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:11.361365 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bafa319-dee5-42bf-b6f8-7b5712e857ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:11.362592 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bafa319-dee5-42bf-b6f8-7b5712e857ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:11.362832 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bafa319-dee5-42bf-b6f8-7b5712e857ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:11.363116 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bafa319-dee5-42bf-b6f8-7b5712e857ae admin admin] PATH_INFO: `/v3/projects/82cb5e79975846219df6e3b2a836fbe8` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:11.364371 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bafa319-dee5-42bf-b6f8-7b5712e857ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=82cb5e79975846219df6e3b2a836fbe8)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:11.367080 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bafa319-dee5-42bf-b6f8-7b5712e857ae admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:11.375632 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1275/2547] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:57:11.375632 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c4383-203b-40f0-8621-6cb7762d61fa admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:11.375632 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-b84c4383-203b-40f0-8621-6cb7762d61fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:11.391575 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c4383-203b-40f0-8621-6cb7762d61fa admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:11.396790 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b45e78-948e-4dd7-841f-22b8970fe0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:11.398037 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b45e78-948e-4dd7-841f-22b8970fe0aa admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:11.398388 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b45e78-948e-4dd7-841f-22b8970fe0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:11.398673 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b45e78-948e-4dd7-841f-22b8970fe0aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:11.399527 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b45e78-948e-4dd7-841f-22b8970fe0aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:11.401457 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b45e78-948e-4dd7-841f-22b8970fe0aa admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:11.434084 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1276/2548] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:57:11 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:57:11.435195 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b45e78-948e-4dd7-841f-22b8970fe0aa admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:11.438638 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3bafa319-dee5-42bf-b6f8-7b5712e857ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82cb5e79975846219df6e3b2a836fbe8', 'request_id': 'req-3bafa319-dee5-42bf-b6f8-7b5712e857ae'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:11.447822 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3bafa319-dee5-42bf-b6f8-7b5712e857ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82cb5e79975846219df6e3b2a836fbe8', 'request_id': 'req-3bafa319-dee5-42bf-b6f8-7b5712e857ae'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:11.456177 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3bafa319-dee5-42bf-b6f8-7b5712e857ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82cb5e79975846219df6e3b2a836fbe8', 'request_id': 'req-3bafa319-dee5-42bf-b6f8-7b5712e857ae'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:11.470894 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3bafa319-dee5-42bf-b6f8-7b5712e857ae admin admin] The token cache is being invalidate because project 82cb5e79975846219df6e3b2a836fbe8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:57:11.471183 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3bafa319-dee5-42bf-b6f8-7b5712e857ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:11.472197 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3bafa319-dee5-42bf-b6f8-7b5712e857ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:11.474713 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1273/2549] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:57:11 2022] DELETE /identity/v3/projects/82cb5e79975846219df6e3b2a836fbe8 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:57:11.475570 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bafa319-dee5-42bf-b6f8-7b5712e857ae admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:11.477432 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3bafa319-dee5-42bf-b6f8-7b5712e857ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:11.511719 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b45e78-948e-4dd7-841f-22b8970fe0aa admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:11.517409 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c89c2b5-1268-40b1-bfbe-2d5c4fc48114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:11.518387 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89c2b5-1268-40b1-bfbe-2d5c4fc48114 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:11.518683 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89c2b5-1268-40b1-bfbe-2d5c4fc48114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:11.518993 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89c2b5-1268-40b1-bfbe-2d5c4fc48114 admin admin] PATH_INFO: `/v3/projects/c008d3a7c9814cff8806366bc2ee88ea/users/7120fe9c4e6b4847925f3fd6660a5ab5/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:11.521174 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c89c2b5-1268-40b1-bfbe-2d5c4fc48114 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c008d3a7c9814cff8806366bc2ee88ea, user_id=7120fe9c4e6b4847925f3fd6660a5ab5, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:11.524946 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c89c2b5-1268-40b1-bfbe-2d5c4fc48114 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:11.547810 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1277/2550] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:57:11 2022] PUT /identity/v3/projects/c008d3a7c9814cff8806366bc2ee88ea/users/7120fe9c4e6b4847925f3fd6660a5ab5/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:57:11.547810 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fdb65-eaaa-4527-8d2b-00d03f75ed34 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:11.547810 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fdb65-eaaa-4527-8d2b-00d03f75ed34 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:11.547810 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fdb65-eaaa-4527-8d2b-00d03f75ed34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:11.561288 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bafa319-dee5-42bf-b6f8-7b5712e857ae admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:11.568850 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-657fdb65-eaaa-4527-8d2b-00d03f75ed34 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:11.570237 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-657fdb65-eaaa-4527-8d2b-00d03f75ed34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:11.619763 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c24860d-93c2-4e9f-a5d1-f49579ae191d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:11.620457 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24860d-93c2-4e9f-a5d1-f49579ae191d admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:11.620807 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24860d-93c2-4e9f-a5d1-f49579ae191d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:11.621091 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24860d-93c2-4e9f-a5d1-f49579ae191d admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:11.621809 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c24860d-93c2-4e9f-a5d1-f49579ae191d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:11.623713 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c24860d-93c2-4e9f-a5d1-f49579ae191d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:11.630728 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1278/2551] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:57:11.632271 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2856f-3582-4958-8d0b-e217777deada None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:11.632574 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2856f-3582-4958-8d0b-e217777deada None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:11.632854 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2856f-3582-4958-8d0b-e217777deada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:11.647198 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1274/2552] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:57:11 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:57:11.652637 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c24860d-93c2-4e9f-a5d1-f49579ae191d admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:11.664494 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c24860d-93c2-4e9f-a5d1-f49579ae191d admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:11.667162 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-61f2856f-3582-4958-8d0b-e217777deada None None] MFA Rules not processed for user `7120fe9c4e6b4847925f3fd6660a5ab5`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:11.668539 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-61f2856f-3582-4958-8d0b-e217777deada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:11.670103 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e063bb-a314-4b6d-bead-563734503456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:11.670965 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e063bb-a314-4b6d-bead-563734503456 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:11.671325 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e063bb-a314-4b6d-bead-563734503456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:11.671672 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e063bb-a314-4b6d-bead-563734503456 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:11.672563 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e063bb-a314-4b6d-bead-563734503456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:11.674279 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e063bb-a314-4b6d-bead-563734503456 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:11.677220 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:11.693078 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1275/2553] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 20:57:11.694976 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ec9b9-061f-4663-b275-c4ae4bacd289 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:11.695273 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ec9b9-061f-4663-b275-c4ae4bacd289 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:11.695559 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ec9b9-061f-4663-b275-c4ae4bacd289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:11.714080 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-da6ec9b9-061f-4663-b275-c4ae4bacd289 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:11.715329 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-da6ec9b9-061f-4663-b275-c4ae4bacd289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:11.715990 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:11.724527 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1276/2554] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:57:11.725329 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ec9b9-061f-4663-b275-c4ae4bacd289 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:11.734860 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ec9b9-061f-4663-b275-c4ae4bacd289 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:11.739741 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f0494-8666-42b5-8deb-beeda4bb5e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:11.740648 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f0494-8666-42b5-8deb-beeda4bb5e73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:11.740934 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f0494-8666-42b5-8deb-beeda4bb5e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:11.741211 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f0494-8666-42b5-8deb-beeda4bb5e73 admin admin] PATH_INFO: `/v3/projects/68c26c5a4610479bbed75a3f7d57a8d3/users/c1069f77d85c43cd8dfb2c9413d7d98f/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:11.753541 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1279/2555] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:11 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:57:11.754382 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2856f-3582-4958-8d0b-e217777deada None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:11.760045 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f0494-8666-42b5-8deb-beeda4bb5e73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68c26c5a4610479bbed75a3f7d57a8d3, user_id=c1069f77d85c43cd8dfb2c9413d7d98f, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:11.763731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f0494-8666-42b5-8deb-beeda4bb5e73 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:11.765425 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2856f-3582-4958-8d0b-e217777deada None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:11.770210 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60fb5c-e1dd-4823-904e-855bfff5b9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:11.770892 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60fb5c-e1dd-4823-904e-855bfff5b9b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:11.771259 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60fb5c-e1dd-4823-904e-855bfff5b9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:11.771490 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60fb5c-e1dd-4823-904e-855bfff5b9b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:11.772259 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae60fb5c-e1dd-4823-904e-855bfff5b9b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:57:11.772571 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae60fb5c-e1dd-4823-904e-855bfff5b9b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:11.774244 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae60fb5c-e1dd-4823-904e-855bfff5b9b6 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:11.779999 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1277/2556] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:57:11 2022] PUT /identity/v3/projects/68c26c5a4610479bbed75a3f7d57a8d3/users/c1069f77d85c43cd8dfb2c9413d7d98f/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:57:11.783226 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f0494-8666-42b5-8deb-beeda4bb5e73 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:11.784876 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6d0f0494-8666-42b5-8deb-beeda4bb5e73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:11.786479 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1280/2557] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:57:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:57:11.787204 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60fb5c-e1dd-4823-904e-855bfff5b9b6 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:11.798982 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60fb5c-e1dd-4823-904e-855bfff5b9b6 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:11.856660 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f0494-8666-42b5-8deb-beeda4bb5e73 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:11.861764 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12741754-563b-49a9-8fc5-b715d915c2ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:11.862444 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12741754-563b-49a9-8fc5-b715d915c2ea service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:11.862731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12741754-563b-49a9-8fc5-b715d915c2ea service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:11.863014 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12741754-563b-49a9-8fc5-b715d915c2ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:11.881330 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e6899-af38-4955-aaac-86a776f11bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:11.882101 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e6899-af38-4955-aaac-86a776f11bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:11.882389 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e6899-af38-4955-aaac-86a776f11bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:11.882665 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e6899-af38-4955-aaac-86a776f11bf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:11.883568 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845e6899-af38-4955-aaac-86a776f11bf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:11.885072 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845e6899-af38-4955-aaac-86a776f11bf5 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:11.895377 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1281/2558] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:57:11.896215 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e6899-af38-4955-aaac-86a776f11bf5 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:11.906588 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e6899-af38-4955-aaac-86a776f11bf5 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:11.919883 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78a333f-1935-4c05-9eed-232cc3f855bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:11.920793 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a333f-1935-4c05-9eed-232cc3f855bb admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:11.921363 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a333f-1935-4c05-9eed-232cc3f855bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:11.921787 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a333f-1935-4c05-9eed-232cc3f855bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:11.922576 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78a333f-1935-4c05-9eed-232cc3f855bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:11.924540 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78a333f-1935-4c05-9eed-232cc3f855bb admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:11.934332 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12741754-563b-49a9-8fc5-b715d915c2ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:11.935838 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12741754-563b-49a9-8fc5-b715d915c2ea service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:11.946098 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1278/2559] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:57:11 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:57:11.947140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12741754-563b-49a9-8fc5-b715d915c2ea service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:11.953545 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1282/2560] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:57:11 2022] POST /identity/v3/projects => generated 359 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:57:11.958038 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78a333f-1935-4c05-9eed-232cc3f855bb admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:11.958979 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12741754-563b-49a9-8fc5-b715d915c2ea service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:12.039114 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d660c2d-cf8f-400f-93d3-8008f3f8729b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:12.040061 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d660c2d-cf8f-400f-93d3-8008f3f8729b admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:12.040380 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d660c2d-cf8f-400f-93d3-8008f3f8729b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:12.040664 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d660c2d-cf8f-400f-93d3-8008f3f8729b admin admin] PATH_INFO: `/v3/projects/68c26c5a4610479bbed75a3f7d57a8d3/users/c1069f77d85c43cd8dfb2c9413d7d98f/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:12.043500 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d660c2d-cf8f-400f-93d3-8008f3f8729b admin admin] RBAC: Authorizing `identity:create_grant(project_id=68c26c5a4610479bbed75a3f7d57a8d3, user_id=c1069f77d85c43cd8dfb2c9413d7d98f, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:12.044358 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78a333f-1935-4c05-9eed-232cc3f855bb admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:12.046676 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d660c2d-cf8f-400f-93d3-8008f3f8729b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:12.049887 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e85dd0-3d41-44ff-a9a9-91053dd321a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:12.050702 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e85dd0-3d41-44ff-a9a9-91053dd321a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:12.050977 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e85dd0-3d41-44ff-a9a9-91053dd321a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:12.051257 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e85dd0-3d41-44ff-a9a9-91053dd321a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:12.052165 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e85dd0-3d41-44ff-a9a9-91053dd321a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:12.054657 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e85dd0-3d41-44ff-a9a9-91053dd321a2 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:12.060914 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1279/2561] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:57:11 2022] PUT /identity/v3/projects/68c26c5a4610479bbed75a3f7d57a8d3/users/c1069f77d85c43cd8dfb2c9413d7d98f/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:57:12.077414 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1283/2562] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:57:11 2022] POST /identity/v3/users => generated 280 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 20:57:12.081956 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d660c2d-cf8f-400f-93d3-8008f3f8729b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:12.097049 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:12.133882 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e85dd0-3d41-44ff-a9a9-91053dd321a2 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:12.159607 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d660c2d-cf8f-400f-93d3-8008f3f8729b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:12.164827 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e009fabf-1337-46e7-940b-2e6079812457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:12.165867 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009fabf-1337-46e7-940b-2e6079812457 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:12.165867 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009fabf-1337-46e7-940b-2e6079812457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:12.166141 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009fabf-1337-46e7-940b-2e6079812457 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:12.166909 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e009fabf-1337-46e7-940b-2e6079812457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:12.168671 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e009fabf-1337-46e7-940b-2e6079812457 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:12.169476 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:12.179883 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1280/2563] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:57:12.184249 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e009fabf-1337-46e7-940b-2e6079812457 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:12.194957 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e009fabf-1337-46e7-940b-2e6079812457 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:12.200717 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005221d-5904-484a-880f-76b45603a9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:12.201417 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005221d-5904-484a-880f-76b45603a9e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:12.201707 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005221d-5904-484a-880f-76b45603a9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:12.202033 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005221d-5904-484a-880f-76b45603a9e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:12.202766 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a005221d-5904-484a-880f-76b45603a9e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:12.202885 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e85dd0-3d41-44ff-a9a9-91053dd321a2 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:12.204436 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a005221d-5904-484a-880f-76b45603a9e2 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:12.227287 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1281/2564] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:57:12.228353 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005221d-5904-484a-880f-76b45603a9e2 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:12.240972 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005221d-5904-484a-880f-76b45603a9e2 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:12.246589 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36197f69-6dbf-4678-aec9-5c12bc1b5f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:12.247496 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36197f69-6dbf-4678-aec9-5c12bc1b5f6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:12.247784 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36197f69-6dbf-4678-aec9-5c12bc1b5f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:12.248117 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36197f69-6dbf-4678-aec9-5c12bc1b5f6b admin admin] PATH_INFO: `/v3/projects/fb79fe572b2c4323b20b74fbe7047f2b/users/13f938a8d5474edd95a1efc1571c0e46/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:12.267197 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36197f69-6dbf-4678-aec9-5c12bc1b5f6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb79fe572b2c4323b20b74fbe7047f2b, user_id=13f938a8d5474edd95a1efc1571c0e46, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:12.268649 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6bf90b-b126-4051-8068-664fda66dec3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:12.269311 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6bf90b-b126-4051-8068-664fda66dec3 service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:12.269596 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6bf90b-b126-4051-8068-664fda66dec3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:12.270067 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6bf90b-b126-4051-8068-664fda66dec3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:12.270828 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36197f69-6dbf-4678-aec9-5c12bc1b5f6b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:12.272235 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-4e6bf90b-b126-4051-8068-664fda66dec3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:12.287688 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1282/2565] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:57:12 2022] PUT /identity/v3/projects/fb79fe572b2c4323b20b74fbe7047f2b/users/13f938a8d5474edd95a1efc1571c0e46/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:57:12.297718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3220471-1a11-41c3-9b69-c00984f7763c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:12.298013 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3220471-1a11-41c3-9b69-c00984f7763c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:12.298295 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3220471-1a11-41c3-9b69-c00984f7763c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:12.327568 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f3220471-1a11-41c3-9b69-c00984f7763c None None] MFA Rules not processed for user `13f938a8d5474edd95a1efc1571c0e46`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:12.328846 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f3220471-1a11-41c3-9b69-c00984f7763c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:12.360596 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6bf90b-b126-4051-8068-664fda66dec3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:12.362066 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6bf90b-b126-4051-8068-664fda66dec3 service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:12.373699 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1284/2566] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:57:12 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 20:57:12.403942 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1283/2567] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:12 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 20:57:12.456351 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6bf90b-b126-4051-8068-664fda66dec3 service cinder] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:12.461002 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-4e6bf90b-b126-4051-8068-664fda66dec3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:12.484198 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6bf90b-b126-4051-8068-664fda66dec3 service cinder] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:12.603413 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e756a-1404-4462-87a5-6bd44a2ea1f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:12.604483 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e756a-1404-4462-87a5-6bd44a2ea1f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:12.604991 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e756a-1404-4462-87a5-6bd44a2ea1f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:12.606412 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e756a-1404-4462-87a5-6bd44a2ea1f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:12.621358 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131e756a-1404-4462-87a5-6bd44a2ea1f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:12.624695 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131e756a-1404-4462-87a5-6bd44a2ea1f9 service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:12.660097 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1285/2568] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:57:12 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:57:12.680435 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3220471-1a11-41c3-9b69-c00984f7763c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:12.781633 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3220471-1a11-41c3-9b69-c00984f7763c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:12.793390 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8ffd09-d0b5-4c4f-a9ac-69f5c1ae9241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:12.794541 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ffd09-d0b5-4c4f-a9ac-69f5c1ae9241 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:12.794541 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ffd09-d0b5-4c4f-a9ac-69f5c1ae9241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:12.794820 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ffd09-d0b5-4c4f-a9ac-69f5c1ae9241 admin admin] PATH_INFO: `/v3/users/13f938a8d5474edd95a1efc1571c0e46` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:12.796562 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8ffd09-d0b5-4c4f-a9ac-69f5c1ae9241 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13f938a8d5474edd95a1efc1571c0e46)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:12.798883 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8ffd09-d0b5-4c4f-a9ac-69f5c1ae9241 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:12.808728 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:12.920286 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1f8ffd09-d0b5-4c4f-a9ac-69f5c1ae9241 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13f938a8d5474edd95a1efc1571c0e46'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:12.920970 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1f8ffd09-d0b5-4c4f-a9ac-69f5c1ae9241 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13f938a8d5474edd95a1efc1571c0e46'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:12.921777 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1f8ffd09-d0b5-4c4f-a9ac-69f5c1ae9241 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13f938a8d5474edd95a1efc1571c0e46'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:12.946502 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1f8ffd09-d0b5-4c4f-a9ac-69f5c1ae9241 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13f938a8d5474edd95a1efc1571c0e46'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:12.967031 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b61037-99f2-4c94-bcf9-ae47238650b5 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:12.967436 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b61037-99f2-4c94-bcf9-ae47238650b5 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:12.967870 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b61037-99f2-4c94-bcf9-ae47238650b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:12.969242 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1f8ffd09-d0b5-4c4f-a9ac-69f5c1ae9241 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13f938a8d5474edd95a1efc1571c0e46'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:13.004411 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1284/2569] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:57:12 2022] DELETE /identity/v3/users/13f938a8d5474edd95a1efc1571c0e46 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:57:13.008630 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-02b61037-99f2-4c94-bcf9-ae47238650b5 None None] MFA Rules not processed for user `c1069f77d85c43cd8dfb2c9413d7d98f`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:13.009287 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f462d7-cc3f-4d78-9f54-5f0e8f623090 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:13.009638 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f462d7-cc3f-4d78-9f54-5f0e8f623090 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:13.009922 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f462d7-cc3f-4d78-9f54-5f0e8f623090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:13.010171 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-02b61037-99f2-4c94-bcf9-ae47238650b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:13.038912 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-91f462d7-cc3f-4d78-9f54-5f0e8f623090 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:13.040643 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-91f462d7-cc3f-4d78-9f54-5f0e8f623090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:13.053296 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:13.107254 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1286/2570] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:12 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:57:13.119252 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1285/2571] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:57:13.121569 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b61037-99f2-4c94-bcf9-ae47238650b5 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:13.122999 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-02b61037-99f2-4c94-bcf9-ae47238650b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:13.126944 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f462d7-cc3f-4d78-9f54-5f0e8f623090 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:13.128429 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-91f462d7-cc3f-4d78-9f54-5f0e8f623090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:13.188851 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f462d7-cc3f-4d78-9f54-5f0e8f623090 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:13.191330 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b61037-99f2-4c94-bcf9-ae47238650b5 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:13.192602 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06cf56d-d46b-40b3-a110-fb5ef9d28c89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:13.193260 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06cf56d-d46b-40b3-a110-fb5ef9d28c89 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:13.193542 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06cf56d-d46b-40b3-a110-fb5ef9d28c89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:13.193826 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06cf56d-d46b-40b3-a110-fb5ef9d28c89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:13.195372 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465334c7-a9bd-4e73-b829-b765683d9d25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:13.196057 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465334c7-a9bd-4e73-b829-b765683d9d25 service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:13.196347 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465334c7-a9bd-4e73-b829-b765683d9d25 service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:13.196627 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465334c7-a9bd-4e73-b829-b765683d9d25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:13.198451 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-465334c7-a9bd-4e73-b829-b765683d9d25 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:13.203809 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06cf56d-d46b-40b3-a110-fb5ef9d28c89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:13.205272 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06cf56d-d46b-40b3-a110-fb5ef9d28c89 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:13.215496 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1286/2572] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:57:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:57:13.263677 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465334c7-a9bd-4e73-b829-b765683d9d25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:13.265325 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465334c7-a9bd-4e73-b829-b765683d9d25 service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:13.275035 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1287/2573] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:57:13 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:57:13.503435 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06cf56d-d46b-40b3-a110-fb5ef9d28c89 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:13.505004 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d06cf56d-d46b-40b3-a110-fb5ef9d28c89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:13.530685 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06cf56d-d46b-40b3-a110-fb5ef9d28c89 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:13.539096 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5fa9eb-740c-4567-9caf-b4710b3b2159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:13.540343 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5fa9eb-740c-4567-9caf-b4710b3b2159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:13.540793 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5fa9eb-740c-4567-9caf-b4710b3b2159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:13.541075 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5fa9eb-740c-4567-9caf-b4710b3b2159 admin admin] PATH_INFO: `/v3/projects/fb79fe572b2c4323b20b74fbe7047f2b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:13.542294 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5fa9eb-740c-4567-9caf-b4710b3b2159 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb79fe572b2c4323b20b74fbe7047f2b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:13.544973 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5fa9eb-740c-4567-9caf-b4710b3b2159 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:13.569611 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:13.607727 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0b5fa9eb-740c-4567-9caf-b4710b3b2159 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb79fe572b2c4323b20b74fbe7047f2b', 'request_id': 'req-0b5fa9eb-740c-4567-9caf-b4710b3b2159'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:13.619910 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0b5fa9eb-740c-4567-9caf-b4710b3b2159 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb79fe572b2c4323b20b74fbe7047f2b', 'request_id': 'req-0b5fa9eb-740c-4567-9caf-b4710b3b2159'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:13.625800 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0b5fa9eb-740c-4567-9caf-b4710b3b2159 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb79fe572b2c4323b20b74fbe7047f2b', 'request_id': 'req-0b5fa9eb-740c-4567-9caf-b4710b3b2159'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:13.639097 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0b5fa9eb-740c-4567-9caf-b4710b3b2159 admin admin] The token cache is being invalidate because project fb79fe572b2c4323b20b74fbe7047f2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:57:13.639388 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0b5fa9eb-740c-4567-9caf-b4710b3b2159 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:13.640162 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0b5fa9eb-740c-4567-9caf-b4710b3b2159 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:13.641759 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1287/2574] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:57:13 2022] DELETE /identity/v3/projects/fb79fe572b2c4323b20b74fbe7047f2b => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:57:13.647364 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c533761-bc22-473d-aa49-0d11b3cd59fc None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:13.647655 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c533761-bc22-473d-aa49-0d11b3cd59fc None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:13.647953 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c533761-bc22-473d-aa49-0d11b3cd59fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:13.667449 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-2c533761-bc22-473d-aa49-0d11b3cd59fc None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:13.668687 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-2c533761-bc22-473d-aa49-0d11b3cd59fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:13.728015 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1288/2575] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:57:13.735678 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047be6b0-fa3e-4434-af70-a7ea48b6e36a None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:13.735995 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047be6b0-fa3e-4434-af70-a7ea48b6e36a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:13.736276 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047be6b0-fa3e-4434-af70-a7ea48b6e36a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:13.755007 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-047be6b0-fa3e-4434-af70-a7ea48b6e36a None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:13.756233 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-047be6b0-fa3e-4434-af70-a7ea48b6e36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:13.764432 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1288/2576] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:57:13.768449 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c533761-bc22-473d-aa49-0d11b3cd59fc None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:13.778789 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c533761-bc22-473d-aa49-0d11b3cd59fc None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:13.783373 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34302263-cd90-453f-9928-5ef354854f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:13.784062 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34302263-cd90-453f-9928-5ef354854f65 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:13.784352 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34302263-cd90-453f-9928-5ef354854f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:13.784632 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34302263-cd90-453f-9928-5ef354854f65 admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:13.785362 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34302263-cd90-453f-9928-5ef354854f65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:57:13.785676 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34302263-cd90-453f-9928-5ef354854f65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:13.787270 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34302263-cd90-453f-9928-5ef354854f65 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:13.798816 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1289/2577] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:57:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:57:13.803111 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047be6b0-fa3e-4434-af70-a7ea48b6e36a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:13.812440 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047be6b0-fa3e-4434-af70-a7ea48b6e36a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:13.816974 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031b2ed-c1ff-480c-8488-6ca56c32274a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:13.817614 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031b2ed-c1ff-480c-8488-6ca56c32274a admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:13.817897 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031b2ed-c1ff-480c-8488-6ca56c32274a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:13.818171 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031b2ed-c1ff-480c-8488-6ca56c32274a admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:13.818859 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5031b2ed-c1ff-480c-8488-6ca56c32274a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:13.820765 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5031b2ed-c1ff-480c-8488-6ca56c32274a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:13.847328 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1289/2578] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:57:13 2022] POST /identity/v3/projects => generated 365 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 20:57:13.851209 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34302263-cd90-453f-9928-5ef354854f65 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:13.857522 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:13.861891 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34302263-cd90-453f-9928-5ef354854f65 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:13.919055 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8400ab-1792-4348-81b4-7018cbb09a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:13.919728 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8400ab-1792-4348-81b4-7018cbb09a5d admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:13.920057 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8400ab-1792-4348-81b4-7018cbb09a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:13.920340 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8400ab-1792-4348-81b4-7018cbb09a5d admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:13.921039 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8400ab-1792-4348-81b4-7018cbb09a5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:13.922964 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8400ab-1792-4348-81b4-7018cbb09a5d admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:13.943206 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1290/2579] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:57:13 2022] POST /identity/v3/users => generated 283 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:57:13.947393 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031b2ed-c1ff-480c-8488-6ca56c32274a admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:13.958131 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031b2ed-c1ff-480c-8488-6ca56c32274a admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:13.962683 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f858ff1-e5db-4f24-99d5-b0f668f4f2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:13.963336 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f858ff1-e5db-4f24-99d5-b0f668f4f2b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:13.963619 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f858ff1-e5db-4f24-99d5-b0f668f4f2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:13.963896 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f858ff1-e5db-4f24-99d5-b0f668f4f2b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:13.966202 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f858ff1-e5db-4f24-99d5-b0f668f4f2b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:13.967784 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f858ff1-e5db-4f24-99d5-b0f668f4f2b1 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:13.981253 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1290/2580] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:57:13.982350 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8400ab-1792-4348-81b4-7018cbb09a5d admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:13.992335 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8400ab-1792-4348-81b4-7018cbb09a5d admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:13.997514 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6879ec5c-a828-4236-8e19-34e6314c26c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:13.998164 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879ec5c-a828-4236-8e19-34e6314c26c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:13.998439 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879ec5c-a828-4236-8e19-34e6314c26c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:13.998720 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879ec5c-a828-4236-8e19-34e6314c26c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:13.999449 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6879ec5c-a828-4236-8e19-34e6314c26c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:14.001085 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6879ec5c-a828-4236-8e19-34e6314c26c0 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:14.011151 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1291/2581] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 20:57:14.017268 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f858ff1-e5db-4f24-99d5-b0f668f4f2b1 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:14.027877 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f858ff1-e5db-4f24-99d5-b0f668f4f2b1 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:14.032648 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb15e0b-301c-4a13-a934-07f9a640c41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:14.033654 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb15e0b-301c-4a13-a934-07f9a640c41f admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:14.033813 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb15e0b-301c-4a13-a934-07f9a640c41f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:14.034092 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb15e0b-301c-4a13-a934-07f9a640c41f admin admin] PATH_INFO: `/v3/projects/00d116dc29684db1896a9223a348736d/users/60d51054196a47cf93b69116706ebdb5/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:14.054750 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb15e0b-301c-4a13-a934-07f9a640c41f admin admin] RBAC: Authorizing `identity:create_grant(project_id=00d116dc29684db1896a9223a348736d, user_id=60d51054196a47cf93b69116706ebdb5, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:14.057687 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb15e0b-301c-4a13-a934-07f9a640c41f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:14.072854 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1291/2582] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:57:14 2022] PUT /identity/v3/projects/00d116dc29684db1896a9223a348736d/users/60d51054196a47cf93b69116706ebdb5/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:57:14.085925 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc3f8c-c222-46ed-b706-aca06959e4f5 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:14.086455 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc3f8c-c222-46ed-b706-aca06959e4f5 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:14.086527 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc3f8c-c222-46ed-b706-aca06959e4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:14.125068 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-a8fc3f8c-c222-46ed-b706-aca06959e4f5 None None] MFA Rules not processed for user `60d51054196a47cf93b69116706ebdb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:14.126748 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-a8fc3f8c-c222-46ed-b706-aca06959e4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:14.207495 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1292/2583] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:14 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:57:14.221234 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb15e0b-301c-4a13-a934-07f9a640c41f admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:14.223258 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-dbb15e0b-301c-4a13-a934-07f9a640c41f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:14.280515 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb15e0b-301c-4a13-a934-07f9a640c41f admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:14.284171 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c8da77-0893-42f0-92a9-cd7226ab0bb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:14.284810 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8da77-0893-42f0-92a9-cd7226ab0bb1 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:14.285094 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8da77-0893-42f0-92a9-cd7226ab0bb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:14.285370 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8da77-0893-42f0-92a9-cd7226ab0bb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:14.294075 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c8da77-0893-42f0-92a9-cd7226ab0bb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:14.295489 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c8da77-0893-42f0-92a9-cd7226ab0bb1 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:14.304450 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1292/2584] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:57:14 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:57:14.649181 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc3f8c-c222-46ed-b706-aca06959e4f5 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:14.650557 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-a8fc3f8c-c222-46ed-b706-aca06959e4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:14.662961 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc3f8c-c222-46ed-b706-aca06959e4f5 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:14.666510 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38979d1d-d62f-46b0-9a66-a163984c9911 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:14.667154 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38979d1d-d62f-46b0-9a66-a163984c9911 service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:14.667950 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38979d1d-d62f-46b0-9a66-a163984c9911 service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:14.668237 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38979d1d-d62f-46b0-9a66-a163984c9911 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:14.669949 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-38979d1d-d62f-46b0-9a66-a163984c9911 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:14.732604 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38979d1d-d62f-46b0-9a66-a163984c9911 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:14.734048 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38979d1d-d62f-46b0-9a66-a163984c9911 service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:14.743479 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1293/2585] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:57:14 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:57:15.176614 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c8da77-0893-42f0-92a9-cd7226ab0bb1 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:15.178001 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-40c8da77-0893-42f0-92a9-cd7226ab0bb1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:15.229361 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:15.234803 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c8da77-0893-42f0-92a9-cd7226ab0bb1 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:15.239379 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff15d1a3-ba8d-464e-9d8c-34fd6d94a5b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:15.240314 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff15d1a3-ba8d-464e-9d8c-34fd6d94a5b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:15.240762 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff15d1a3-ba8d-464e-9d8c-34fd6d94a5b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:15.241221 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff15d1a3-ba8d-464e-9d8c-34fd6d94a5b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:15.243002 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ff15d1a3-ba8d-464e-9d8c-34fd6d94a5b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:15.304131 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff15d1a3-ba8d-464e-9d8c-34fd6d94a5b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:15.305500 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff15d1a3-ba8d-464e-9d8c-34fd6d94a5b9 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:15.315253 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1293/2586] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:57:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:57:15.818922 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38979d1d-d62f-46b0-9a66-a163984c9911 service cinder] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:15.820438 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-38979d1d-d62f-46b0-9a66-a163984c9911 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:15.834286 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38979d1d-d62f-46b0-9a66-a163984c9911 service cinder] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:15.838814 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6aac47-2efa-4270-8d86-a5fcd0df9e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:15.839733 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6aac47-2efa-4270-8d86-a5fcd0df9e21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:15.840049 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6aac47-2efa-4270-8d86-a5fcd0df9e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:15.840331 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6aac47-2efa-4270-8d86-a5fcd0df9e21 admin admin] PATH_INFO: `/v3/users/6aa799462c6a4339ab0ab3fc1601534d` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:15.841534 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6aac47-2efa-4270-8d86-a5fcd0df9e21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6aa799462c6a4339ab0ab3fc1601534d)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:15.843472 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6aac47-2efa-4270-8d86-a5fcd0df9e21 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:15.845155 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:15.894372 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-ce6aac47-2efa-4270-8d86-a5fcd0df9e21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6aa799462c6a4339ab0ab3fc1601534d'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:15.895043 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-ce6aac47-2efa-4270-8d86-a5fcd0df9e21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6aa799462c6a4339ab0ab3fc1601534d'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:15.902866 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-ce6aac47-2efa-4270-8d86-a5fcd0df9e21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6aa799462c6a4339ab0ab3fc1601534d'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:15.915024 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-ce6aac47-2efa-4270-8d86-a5fcd0df9e21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6aa799462c6a4339ab0ab3fc1601534d'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:15.915786 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-ce6aac47-2efa-4270-8d86-a5fcd0df9e21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6aa799462c6a4339ab0ab3fc1601534d'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:15.928683 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1294/2587] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:57:15 2022] DELETE /identity/v3/users/6aa799462c6a4339ab0ab3fc1601534d => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:57:16.113913 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff15d1a3-ba8d-464e-9d8c-34fd6d94a5b9 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:16.127948 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff15d1a3-ba8d-464e-9d8c-34fd6d94a5b9 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:16.188902 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c506e1aa-7ac9-424e-b95e-d8be0bd0d43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:16.189789 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506e1aa-7ac9-424e-b95e-d8be0bd0d43c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:16.190076 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506e1aa-7ac9-424e-b95e-d8be0bd0d43c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:16.190359 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506e1aa-7ac9-424e-b95e-d8be0bd0d43c admin admin] PATH_INFO: `/v3/projects/c1c53ba1f3934403b578c85fbb2a128f` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:16.191536 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c506e1aa-7ac9-424e-b95e-d8be0bd0d43c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1c53ba1f3934403b578c85fbb2a128f)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:16.193455 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c506e1aa-7ac9-424e-b95e-d8be0bd0d43c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:16.239660 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c506e1aa-7ac9-424e-b95e-d8be0bd0d43c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1c53ba1f3934403b578c85fbb2a128f', 'request_id': 'req-c506e1aa-7ac9-424e-b95e-d8be0bd0d43c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:16.247182 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c506e1aa-7ac9-424e-b95e-d8be0bd0d43c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1c53ba1f3934403b578c85fbb2a128f', 'request_id': 'req-c506e1aa-7ac9-424e-b95e-d8be0bd0d43c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:16.253308 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c506e1aa-7ac9-424e-b95e-d8be0bd0d43c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1c53ba1f3934403b578c85fbb2a128f', 'request_id': 'req-c506e1aa-7ac9-424e-b95e-d8be0bd0d43c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:16.264446 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c506e1aa-7ac9-424e-b95e-d8be0bd0d43c admin admin] The token cache is being invalidate because project c1c53ba1f3934403b578c85fbb2a128f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:57:16.264738 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c506e1aa-7ac9-424e-b95e-d8be0bd0d43c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:16.265418 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c506e1aa-7ac9-424e-b95e-d8be0bd0d43c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:16.266972 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1294/2588] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:57:16 2022] DELETE /identity/v3/projects/c1c53ba1f3934403b578c85fbb2a128f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:57:16.271698 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151847e5-f2a4-4fba-9690-8a09f46fe288 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:16.272100 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151847e5-f2a4-4fba-9690-8a09f46fe288 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:16.272387 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151847e5-f2a4-4fba-9690-8a09f46fe288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:16.289998 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-151847e5-f2a4-4fba-9690-8a09f46fe288 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:16.291397 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-151847e5-f2a4-4fba-9690-8a09f46fe288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:16.352944 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1295/2589] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:57:16.361378 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ec295-ed0a-4c89-a699-3f6710c07059 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:16.361674 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ec295-ed0a-4c89-a699-3f6710c07059 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:16.361957 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ec295-ed0a-4c89-a699-3f6710c07059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:16.380417 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ff5ec295-ed0a-4c89-a699-3f6710c07059 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:16.381632 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ff5ec295-ed0a-4c89-a699-3f6710c07059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:16.389601 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1295/2590] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:57:16.393525 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151847e5-f2a4-4fba-9690-8a09f46fe288 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:16.403678 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151847e5-f2a4-4fba-9690-8a09f46fe288 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:16.408296 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74440c42-637a-47ab-ba43-c4f3338fd096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:16.408945 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74440c42-637a-47ab-ba43-c4f3338fd096 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:16.409233 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74440c42-637a-47ab-ba43-c4f3338fd096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:16.409574 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74440c42-637a-47ab-ba43-c4f3338fd096 admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:16.410369 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74440c42-637a-47ab-ba43-c4f3338fd096 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:57:16.410682 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74440c42-637a-47ab-ba43-c4f3338fd096 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:16.412318 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74440c42-637a-47ab-ba43-c4f3338fd096 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:16.424516 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1296/2591] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:57:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:57:16.428856 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ec295-ed0a-4c89-a699-3f6710c07059 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:16.438715 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ec295-ed0a-4c89-a699-3f6710c07059 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:16.443382 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a84f9-163a-40b5-a7d9-efedafb8c950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:16.444097 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a84f9-163a-40b5-a7d9-efedafb8c950 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:16.444411 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a84f9-163a-40b5-a7d9-efedafb8c950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:16.444692 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a84f9-163a-40b5-a7d9-efedafb8c950 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:16.445387 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0a84f9-163a-40b5-a7d9-efedafb8c950 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:16.447269 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0a84f9-163a-40b5-a7d9-efedafb8c950 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:16.466253 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:16.477032 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1296/2592] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:57:16 2022] POST /identity/v3/projects => generated 397 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:57:16.478041 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74440c42-637a-47ab-ba43-c4f3338fd096 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:16.487912 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74440c42-637a-47ab-ba43-c4f3338fd096 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:16.546119 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1175829-9ce8-47ab-aa9a-43ee67819e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:16.546841 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1175829-9ce8-47ab-aa9a-43ee67819e78 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:16.547161 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1175829-9ce8-47ab-aa9a-43ee67819e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:16.547439 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1175829-9ce8-47ab-aa9a-43ee67819e78 admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:16.548216 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1175829-9ce8-47ab-aa9a-43ee67819e78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:16.550161 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1175829-9ce8-47ab-aa9a-43ee67819e78 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:16.560586 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:16.572896 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1297/2593] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:57:16 2022] POST /identity/v3/users => generated 299 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:57:16.577511 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a84f9-163a-40b5-a7d9-efedafb8c950 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:16.588282 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a84f9-163a-40b5-a7d9-efedafb8c950 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:16.593462 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b437ff-dfb7-474a-8097-c31772cf01f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:16.594133 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b437ff-dfb7-474a-8097-c31772cf01f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:16.594422 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b437ff-dfb7-474a-8097-c31772cf01f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:16.594704 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b437ff-dfb7-474a-8097-c31772cf01f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:16.595435 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b437ff-dfb7-474a-8097-c31772cf01f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:16.597041 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b437ff-dfb7-474a-8097-c31772cf01f8 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:16.607669 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1297/2594] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:57:16.611679 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1175829-9ce8-47ab-aa9a-43ee67819e78 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:16.621666 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1175829-9ce8-47ab-aa9a-43ee67819e78 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:16.626380 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118f21c6-17f2-4f87-89ee-0a646d561286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:16.627071 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f21c6-17f2-4f87-89ee-0a646d561286 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:16.627355 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f21c6-17f2-4f87-89ee-0a646d561286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:16.627630 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f21c6-17f2-4f87-89ee-0a646d561286 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:16.628425 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118f21c6-17f2-4f87-89ee-0a646d561286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:16.630015 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118f21c6-17f2-4f87-89ee-0a646d561286 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:16.640352 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1298/2595] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:57:16.644207 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b437ff-dfb7-474a-8097-c31772cf01f8 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:16.654677 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b437ff-dfb7-474a-8097-c31772cf01f8 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:16.659404 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a00cd-088d-4701-9f42-4e25b75b84e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:16.660332 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a00cd-088d-4701-9f42-4e25b75b84e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:16.660614 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a00cd-088d-4701-9f42-4e25b75b84e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:16.660892 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a00cd-088d-4701-9f42-4e25b75b84e3 admin admin] PATH_INFO: `/v3/projects/09deb4ae4c1240599d20d44744799ef2/users/d719024e6c5e41a4a54003326575905d/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:16.675723 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268a00cd-088d-4701-9f42-4e25b75b84e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09deb4ae4c1240599d20d44744799ef2, user_id=d719024e6c5e41a4a54003326575905d, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:16.678427 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268a00cd-088d-4701-9f42-4e25b75b84e3 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:16.693092 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1298/2596] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:57:16 2022] PUT /identity/v3/projects/09deb4ae4c1240599d20d44744799ef2/users/d719024e6c5e41a4a54003326575905d/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:57:16.701963 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16362bc0-6392-496a-beaf-aa468df18f54 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:16.702281 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16362bc0-6392-496a-beaf-aa468df18f54 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:16.702566 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16362bc0-6392-496a-beaf-aa468df18f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:16.729977 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-16362bc0-6392-496a-beaf-aa468df18f54 None None] MFA Rules not processed for user `d719024e6c5e41a4a54003326575905d`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:16.731183 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-16362bc0-6392-496a-beaf-aa468df18f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:16.794358 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1299/2597] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:16 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:57:16.805939 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a00cd-088d-4701-9f42-4e25b75b84e3 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:16.807615 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-268a00cd-088d-4701-9f42-4e25b75b84e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:16.865082 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a00cd-088d-4701-9f42-4e25b75b84e3 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:16.869345 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30082aa5-ab65-4ceb-98cf-351a4d9dc6e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:16.870251 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30082aa5-ab65-4ceb-98cf-351a4d9dc6e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:16.871087 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30082aa5-ab65-4ceb-98cf-351a4d9dc6e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:16.871373 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30082aa5-ab65-4ceb-98cf-351a4d9dc6e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:16.879745 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30082aa5-ab65-4ceb-98cf-351a4d9dc6e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:16.881195 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30082aa5-ab65-4ceb-98cf-351a4d9dc6e8 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:16.889867 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1299/2598] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:57:16 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:57:26.791300 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=39 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:26.885878 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=42,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:27.274081 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16362bc0-6392-496a-beaf-aa468df18f54 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:27.275550 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-16362bc0-6392-496a-beaf-aa468df18f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:27.342370 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16362bc0-6392-496a-beaf-aa468df18f54 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:27.346838 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d3946c-fea3-4185-a223-3b4775fbc2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:27.347714 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3946c-fea3-4185-a223-3b4775fbc2a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:27.348079 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3946c-fea3-4185-a223-3b4775fbc2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:27.348360 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3946c-fea3-4185-a223-3b4775fbc2a8 admin admin] PATH_INFO: `/v3/users/6b5e19521096443eaf976e3a5d5805f7` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:27.349600 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d3946c-fea3-4185-a223-3b4775fbc2a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b5e19521096443eaf976e3a5d5805f7)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:27.351463 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d3946c-fea3-4185-a223-3b4775fbc2a8 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:27.396022 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-21d3946c-fea3-4185-a223-3b4775fbc2a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b5e19521096443eaf976e3a5d5805f7'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:27.396676 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-21d3946c-fea3-4185-a223-3b4775fbc2a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b5e19521096443eaf976e3a5d5805f7'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:27.404309 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-21d3946c-fea3-4185-a223-3b4775fbc2a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b5e19521096443eaf976e3a5d5805f7'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:27.416206 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-21d3946c-fea3-4185-a223-3b4775fbc2a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b5e19521096443eaf976e3a5d5805f7'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:27.416839 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-21d3946c-fea3-4185-a223-3b4775fbc2a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b5e19521096443eaf976e3a5d5805f7'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:27.429346 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1300/2599] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:57:27 2022] DELETE /identity/v3/users/6b5e19521096443eaf976e3a5d5805f7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:57:27.433873 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebf025-010b-49fc-922f-6a5a68842e50 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:27.434702 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebf025-010b-49fc-922f-6a5a68842e50 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:27.434978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebf025-010b-49fc-922f-6a5a68842e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:27.452131 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-5bebf025-010b-49fc-922f-6a5a68842e50 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:27.453327 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5bebf025-010b-49fc-922f-6a5a68842e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:27.509620 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1300/2600] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:57:27.519737 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d3946c-fea3-4185-a223-3b4775fbc2a8 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:27.521162 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-21d3946c-fea3-4185-a223-3b4775fbc2a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:27.577676 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d3946c-fea3-4185-a223-3b4775fbc2a8 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:27.581318 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6681f50b-d45e-43e9-b967-d1ae11499a27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:27.581961 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681f50b-d45e-43e9-b967-d1ae11499a27 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:27.582248 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681f50b-d45e-43e9-b967-d1ae11499a27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:27.582528 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681f50b-d45e-43e9-b967-d1ae11499a27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:27.592143 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6681f50b-d45e-43e9-b967-d1ae11499a27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:27.593591 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6681f50b-d45e-43e9-b967-d1ae11499a27 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:27.603472 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1301/2601] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:57:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:57:27.882478 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bebf025-010b-49fc-922f-6a5a68842e50 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:27.884067 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5bebf025-010b-49fc-922f-6a5a68842e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:27.920264 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bebf025-010b-49fc-922f-6a5a68842e50 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:27.925896 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7becc495-c33a-4d1b-8696-03a7db38bc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:27.926805 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7becc495-c33a-4d1b-8696-03a7db38bc72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:27.927084 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7becc495-c33a-4d1b-8696-03a7db38bc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:27.927424 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7becc495-c33a-4d1b-8696-03a7db38bc72 admin admin] PATH_INFO: `/v3/projects/6cb77e4ca234499bb6a4fa8d197a4cf3` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:27.928853 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7becc495-c33a-4d1b-8696-03a7db38bc72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cb77e4ca234499bb6a4fa8d197a4cf3)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:27.930744 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7becc495-c33a-4d1b-8696-03a7db38bc72 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:27.990645 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7becc495-c33a-4d1b-8696-03a7db38bc72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cb77e4ca234499bb6a4fa8d197a4cf3', 'request_id': 'req-7becc495-c33a-4d1b-8696-03a7db38bc72'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:28.000607 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7becc495-c33a-4d1b-8696-03a7db38bc72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cb77e4ca234499bb6a4fa8d197a4cf3', 'request_id': 'req-7becc495-c33a-4d1b-8696-03a7db38bc72'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:28.007944 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7becc495-c33a-4d1b-8696-03a7db38bc72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cb77e4ca234499bb6a4fa8d197a4cf3', 'request_id': 'req-7becc495-c33a-4d1b-8696-03a7db38bc72'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:28.022655 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7becc495-c33a-4d1b-8696-03a7db38bc72 admin admin] The token cache is being invalidate because project 6cb77e4ca234499bb6a4fa8d197a4cf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:57:28.023104 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7becc495-c33a-4d1b-8696-03a7db38bc72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:28.023823 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7becc495-c33a-4d1b-8696-03a7db38bc72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:28.025918 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1301/2602] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:57:27 2022] DELETE /identity/v3/projects/6cb77e4ca234499bb6a4fa8d197a4cf3 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:57:28.030276 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6681f50b-d45e-43e9-b967-d1ae11499a27 service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:28.042160 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6681f50b-d45e-43e9-b967-d1ae11499a27 service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:28.065787 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:28.126189 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb12e88-996a-4be8-905d-3bc857672f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:28.127085 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb12e88-996a-4be8-905d-3bc857672f00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:28.127376 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb12e88-996a-4be8-905d-3bc857672f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:28.127655 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb12e88-996a-4be8-905d-3bc857672f00 admin admin] PATH_INFO: `/v3/users/7120fe9c4e6b4847925f3fd6660a5ab5` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:28.128903 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb12e88-996a-4be8-905d-3bc857672f00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7120fe9c4e6b4847925f3fd6660a5ab5)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:28.130901 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb12e88-996a-4be8-905d-3bc857672f00 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:28.210183 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-cbb12e88-996a-4be8-905d-3bc857672f00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7120fe9c4e6b4847925f3fd6660a5ab5'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:28.211158 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-cbb12e88-996a-4be8-905d-3bc857672f00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7120fe9c4e6b4847925f3fd6660a5ab5'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:28.219402 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-cbb12e88-996a-4be8-905d-3bc857672f00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7120fe9c4e6b4847925f3fd6660a5ab5'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:28.237144 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-cbb12e88-996a-4be8-905d-3bc857672f00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7120fe9c4e6b4847925f3fd6660a5ab5'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:28.238128 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-cbb12e88-996a-4be8-905d-3bc857672f00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7120fe9c4e6b4847925f3fd6660a5ab5'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:28.254183 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1302/2603] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:57:28 2022] DELETE /identity/v3/users/7120fe9c4e6b4847925f3fd6660a5ab5 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:57:28.532148 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7becc495-c33a-4d1b-8696-03a7db38bc72 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:28.533656 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7becc495-c33a-4d1b-8696-03a7db38bc72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:28.548799 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7becc495-c33a-4d1b-8696-03a7db38bc72 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:28.606357 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052f2e6-121a-45b8-9c9c-4430ddb4b4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:28.607214 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052f2e6-121a-45b8-9c9c-4430ddb4b4d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:28.607565 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052f2e6-121a-45b8-9c9c-4430ddb4b4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:28.607981 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052f2e6-121a-45b8-9c9c-4430ddb4b4d9 admin admin] PATH_INFO: `/v3/projects/c008d3a7c9814cff8806366bc2ee88ea` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:28.609280 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6052f2e6-121a-45b8-9c9c-4430ddb4b4d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c008d3a7c9814cff8806366bc2ee88ea)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:28.611249 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6052f2e6-121a-45b8-9c9c-4430ddb4b4d9 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:28.641078 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:28.658005 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6052f2e6-121a-45b8-9c9c-4430ddb4b4d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c008d3a7c9814cff8806366bc2ee88ea', 'request_id': 'req-6052f2e6-121a-45b8-9c9c-4430ddb4b4d9'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:28.665087 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6052f2e6-121a-45b8-9c9c-4430ddb4b4d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c008d3a7c9814cff8806366bc2ee88ea', 'request_id': 'req-6052f2e6-121a-45b8-9c9c-4430ddb4b4d9'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:28.671083 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6052f2e6-121a-45b8-9c9c-4430ddb4b4d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c008d3a7c9814cff8806366bc2ee88ea', 'request_id': 'req-6052f2e6-121a-45b8-9c9c-4430ddb4b4d9'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:28.681885 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6052f2e6-121a-45b8-9c9c-4430ddb4b4d9 admin admin] The token cache is being invalidate because project c008d3a7c9814cff8806366bc2ee88ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:57:28.682169 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6052f2e6-121a-45b8-9c9c-4430ddb4b4d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:28.682788 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6052f2e6-121a-45b8-9c9c-4430ddb4b4d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:28.684901 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1302/2604] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:57:28 2022] DELETE /identity/v3/projects/c008d3a7c9814cff8806366bc2ee88ea => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:57:28.689863 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397281c-f1bd-4b99-af33-171762b5af0a None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:28.690153 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397281c-f1bd-4b99-af33-171762b5af0a None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:28.690430 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397281c-f1bd-4b99-af33-171762b5af0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:28.707416 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-1397281c-f1bd-4b99-af33-171762b5af0a None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:28.708637 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-1397281c-f1bd-4b99-af33-171762b5af0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:28.773504 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1303/2605] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:57:28.781666 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10aaeb5-73e1-47ae-bfb5-b31841d85651 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:28.782030 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10aaeb5-73e1-47ae-bfb5-b31841d85651 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:28.782372 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10aaeb5-73e1-47ae-bfb5-b31841d85651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:28.801175 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-d10aaeb5-73e1-47ae-bfb5-b31841d85651 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:28.802377 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d10aaeb5-73e1-47ae-bfb5-b31841d85651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:28.810649 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1303/2606] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:57:28.814811 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397281c-f1bd-4b99-af33-171762b5af0a None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:28.824631 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397281c-f1bd-4b99-af33-171762b5af0a None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:28.829470 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf137ce-617c-4373-a2fc-f50401e68712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:28.830127 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf137ce-617c-4373-a2fc-f50401e68712 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:28.830411 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf137ce-617c-4373-a2fc-f50401e68712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:28.830690 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf137ce-617c-4373-a2fc-f50401e68712 admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:28.831418 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf137ce-617c-4373-a2fc-f50401e68712 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:57:28.831743 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf137ce-617c-4373-a2fc-f50401e68712 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:28.833410 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf137ce-617c-4373-a2fc-f50401e68712 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:28.849099 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1304/2607] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:57:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:57:28.850294 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10aaeb5-73e1-47ae-bfb5-b31841d85651 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:28.860833 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10aaeb5-73e1-47ae-bfb5-b31841d85651 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:28.865558 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca46e37-8502-4881-b010-d55d879626b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:28.866230 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca46e37-8502-4881-b010-d55d879626b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:28.866503 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca46e37-8502-4881-b010-d55d879626b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:28.866799 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca46e37-8502-4881-b010-d55d879626b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:28.867846 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca46e37-8502-4881-b010-d55d879626b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:28.870206 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca46e37-8502-4881-b010-d55d879626b1 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:28.900707 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1304/2608] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:57:28 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:57:28.901775 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf137ce-617c-4373-a2fc-f50401e68712 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:28.912917 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf137ce-617c-4373-a2fc-f50401e68712 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:28.941669 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:28.975050 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a96424-56c9-4242-a073-923f1135bc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:28.975727 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a96424-56c9-4242-a073-923f1135bc93 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:28.976049 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a96424-56c9-4242-a073-923f1135bc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:28.976332 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a96424-56c9-4242-a073-923f1135bc93 admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:28.977381 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a96424-56c9-4242-a073-923f1135bc93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:28.978951 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a96424-56c9-4242-a073-923f1135bc93 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:29.005090 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1305/2609] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:57:28 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 20:57:29.007175 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca46e37-8502-4881-b010-d55d879626b1 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:29.020343 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca46e37-8502-4881-b010-d55d879626b1 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:29.026879 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9498ab-c71c-4887-9b8e-1a1e4d16d03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:29.029175 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9498ab-c71c-4887-9b8e-1a1e4d16d03e admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:29.029481 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9498ab-c71c-4887-9b8e-1a1e4d16d03e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:29.029863 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9498ab-c71c-4887-9b8e-1a1e4d16d03e admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:29.031369 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9498ab-c71c-4887-9b8e-1a1e4d16d03e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:29.033133 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9498ab-c71c-4887-9b8e-1a1e4d16d03e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:29.046275 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1305/2610] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:57:29.050541 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a96424-56c9-4242-a073-923f1135bc93 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:29.061241 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a96424-56c9-4242-a073-923f1135bc93 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:29.066269 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7a6989-d278-42f4-92a1-32f735852bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:29.066958 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a6989-d278-42f4-92a1-32f735852bb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:29.067229 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a6989-d278-42f4-92a1-32f735852bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:29.067505 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a6989-d278-42f4-92a1-32f735852bb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:29.068270 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7a6989-d278-42f4-92a1-32f735852bb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:29.069865 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7a6989-d278-42f4-92a1-32f735852bb9 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:29.081565 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1306/2611] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:57:29.085723 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9498ab-c71c-4887-9b8e-1a1e4d16d03e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:29.095636 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9498ab-c71c-4887-9b8e-1a1e4d16d03e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:29.100179 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b085725-749e-4bc1-b36b-8a024f2cf2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:29.101056 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b085725-749e-4bc1-b36b-8a024f2cf2cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:29.101341 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b085725-749e-4bc1-b36b-8a024f2cf2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:29.101613 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b085725-749e-4bc1-b36b-8a024f2cf2cc admin admin] PATH_INFO: `/v3/projects/f46a8ad2bae54f3589b95cd2901c0561/users/41bd61767a93417e89c4a53b82cfdd66/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:29.115991 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b085725-749e-4bc1-b36b-8a024f2cf2cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f46a8ad2bae54f3589b95cd2901c0561, user_id=41bd61767a93417e89c4a53b82cfdd66, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:29.118625 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b085725-749e-4bc1-b36b-8a024f2cf2cc admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:29.143266 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1306/2612] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:57:29 2022] PUT /identity/v3/projects/f46a8ad2bae54f3589b95cd2901c0561/users/41bd61767a93417e89c4a53b82cfdd66/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:57:29.174445 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7a6989-d278-42f4-92a1-32f735852bb9 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:29.176493 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-2e7a6989-d278-42f4-92a1-32f735852bb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:29.190589 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7a6989-d278-42f4-92a1-32f735852bb9 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:29.199121 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71f638-8a07-4522-a9cc-1a996a14eaf4 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:29.199121 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71f638-8a07-4522-a9cc-1a996a14eaf4 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:29.199418 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71f638-8a07-4522-a9cc-1a996a14eaf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:29.248604 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ae71f638-8a07-4522-a9cc-1a996a14eaf4 None None] MFA Rules not processed for user `41bd61767a93417e89c4a53b82cfdd66`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:29.250469 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ae71f638-8a07-4522-a9cc-1a996a14eaf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:29.274856 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a73a5-1bfd-4fef-bf8f-d53e90f7c7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:29.276137 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a73a5-1bfd-4fef-bf8f-d53e90f7c7e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:29.276987 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a73a5-1bfd-4fef-bf8f-d53e90f7c7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:29.277741 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a73a5-1bfd-4fef-bf8f-d53e90f7c7e1 admin admin] PATH_INFO: `/v3/users/d719024e6c5e41a4a54003326575905d` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:29.279283 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839a73a5-1bfd-4fef-bf8f-d53e90f7c7e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d719024e6c5e41a4a54003326575905d)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:29.281727 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839a73a5-1bfd-4fef-bf8f-d53e90f7c7e1 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:29.348101 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-839a73a5-1bfd-4fef-bf8f-d53e90f7c7e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd719024e6c5e41a4a54003326575905d'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:29.348819 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1307/2613] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:57:29.355074 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-839a73a5-1bfd-4fef-bf8f-d53e90f7c7e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd719024e6c5e41a4a54003326575905d'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:29.361828 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae71f638-8a07-4522-a9cc-1a996a14eaf4 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:29.364189 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ae71f638-8a07-4522-a9cc-1a996a14eaf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:29.371178 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-839a73a5-1bfd-4fef-bf8f-d53e90f7c7e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd719024e6c5e41a4a54003326575905d'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:29.385719 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-839a73a5-1bfd-4fef-bf8f-d53e90f7c7e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd719024e6c5e41a4a54003326575905d'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:29.386895 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-839a73a5-1bfd-4fef-bf8f-d53e90f7c7e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd719024e6c5e41a4a54003326575905d'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:29.404517 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1307/2614] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:57:29 2022] DELETE /identity/v3/users/d719024e6c5e41a4a54003326575905d => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:57:29.405945 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843233ae-f531-42ee-99d1-0bcd4c5a5c9f None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:29.406201 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843233ae-f531-42ee-99d1-0bcd4c5a5c9f None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:29.406484 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843233ae-f531-42ee-99d1-0bcd4c5a5c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:29.426815 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-843233ae-f531-42ee-99d1-0bcd4c5a5c9f None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:29.428401 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-843233ae-f531-42ee-99d1-0bcd4c5a5c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:29.431952 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:29.455247 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae71f638-8a07-4522-a9cc-1a996a14eaf4 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:29.466444 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:29.509583 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7a33c-b1ae-455c-9fcc-511bd66baaf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:29.510249 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7a33c-b1ae-455c-9fcc-511bd66baaf0 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:29.510529 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7a33c-b1ae-455c-9fcc-511bd66baaf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:29.510808 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7a33c-b1ae-455c-9fcc-511bd66baaf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:29.512819 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a7c7a33c-b1ae-455c-9fcc-511bd66baaf0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:29.523098 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1308/2615] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:57:29.534047 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843233ae-f531-42ee-99d1-0bcd4c5a5c9f None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:29.537041 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-843233ae-f531-42ee-99d1-0bcd4c5a5c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:29.598898 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c7a33c-b1ae-455c-9fcc-511bd66baaf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:29.602764 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c7a33c-b1ae-455c-9fcc-511bd66baaf0 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:29.634643 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1308/2616] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:57:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:57:29.654918 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843233ae-f531-42ee-99d1-0bcd4c5a5c9f None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:29.662232 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a659e46-f9f6-47fb-ae9a-8774b13a202d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:29.663131 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a659e46-f9f6-47fb-ae9a-8774b13a202d service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:29.663760 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a659e46-f9f6-47fb-ae9a-8774b13a202d service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:29.665387 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a659e46-f9f6-47fb-ae9a-8774b13a202d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:29.694827 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a659e46-f9f6-47fb-ae9a-8774b13a202d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:29.696886 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a659e46-f9f6-47fb-ae9a-8774b13a202d service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:29.722514 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1309/2617] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:57:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:57:30.203178 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7a33c-b1ae-455c-9fcc-511bd66baaf0 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:30.204842 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a7c7a33c-b1ae-455c-9fcc-511bd66baaf0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:30.243067 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7a33c-b1ae-455c-9fcc-511bd66baaf0 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:30.249953 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeec9ac-f847-450a-a049-a3d47ac6a7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:30.250993 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeec9ac-f847-450a-a049-a3d47ac6a7e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:30.251372 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeec9ac-f847-450a-a049-a3d47ac6a7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:30.251724 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeec9ac-f847-450a-a049-a3d47ac6a7e2 admin admin] PATH_INFO: `/v3/projects/09deb4ae4c1240599d20d44744799ef2` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:30.253822 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeec9ac-f847-450a-a049-a3d47ac6a7e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09deb4ae4c1240599d20d44744799ef2)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:30.255870 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeec9ac-f847-450a-a049-a3d47ac6a7e2 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:30.348513 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-cdeec9ac-f847-450a-a049-a3d47ac6a7e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09deb4ae4c1240599d20d44744799ef2', 'request_id': 'req-cdeec9ac-f847-450a-a049-a3d47ac6a7e2'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:30.358466 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-cdeec9ac-f847-450a-a049-a3d47ac6a7e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09deb4ae4c1240599d20d44744799ef2', 'request_id': 'req-cdeec9ac-f847-450a-a049-a3d47ac6a7e2'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:30.370417 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-cdeec9ac-f847-450a-a049-a3d47ac6a7e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09deb4ae4c1240599d20d44744799ef2', 'request_id': 'req-cdeec9ac-f847-450a-a049-a3d47ac6a7e2'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:30.386041 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-cdeec9ac-f847-450a-a049-a3d47ac6a7e2 admin admin] The token cache is being invalidate because project 09deb4ae4c1240599d20d44744799ef2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:57:30.386332 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-cdeec9ac-f847-450a-a049-a3d47ac6a7e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:30.387542 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-cdeec9ac-f847-450a-a049-a3d47ac6a7e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:30.389647 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1309/2618] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:57:30 2022] DELETE /identity/v3/projects/09deb4ae4c1240599d20d44744799ef2 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:57:39.711975 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=41 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:40.382543 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=77,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:43.180674 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a659e46-f9f6-47fb-ae9a-8774b13a202d service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:43.182195 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-1a659e46-f9f6-47fb-ae9a-8774b13a202d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:43.194500 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a659e46-f9f6-47fb-ae9a-8774b13a202d service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:43.242809 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474aafb-5f04-4022-a713-4f89c3a3144e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:43.243456 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474aafb-5f04-4022-a713-4f89c3a3144e service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:43.243742 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474aafb-5f04-4022-a713-4f89c3a3144e service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:43.244045 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474aafb-5f04-4022-a713-4f89c3a3144e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:43.245948 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-e474aafb-5f04-4022-a713-4f89c3a3144e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:43.312948 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e474aafb-5f04-4022-a713-4f89c3a3144e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:43.314449 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e474aafb-5f04-4022-a713-4f89c3a3144e service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:43.324794 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1310/2619] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:57:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:57:46.415547 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeec9ac-f847-450a-a049-a3d47ac6a7e2 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:46.418814 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-cdeec9ac-f847-450a-a049-a3d47ac6a7e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:46.433383 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeec9ac-f847-450a-a049-a3d47ac6a7e2 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:46.439088 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a05cc7-252b-4f88-ac44-b7aa7f1b7362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:46.440179 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a05cc7-252b-4f88-ac44-b7aa7f1b7362 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:46.440474 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a05cc7-252b-4f88-ac44-b7aa7f1b7362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:46.440757 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a05cc7-252b-4f88-ac44-b7aa7f1b7362 admin admin] PATH_INFO: `/v3/users/fc95af68a6d640699f788d5438cae607` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:46.444976 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a05cc7-252b-4f88-ac44-b7aa7f1b7362 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc95af68a6d640699f788d5438cae607)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:46.444976 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a05cc7-252b-4f88-ac44-b7aa7f1b7362 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:46.491610 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c4a05cc7-252b-4f88-ac44-b7aa7f1b7362 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc95af68a6d640699f788d5438cae607'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:46.492280 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c4a05cc7-252b-4f88-ac44-b7aa7f1b7362 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc95af68a6d640699f788d5438cae607'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:46.492889 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c4a05cc7-252b-4f88-ac44-b7aa7f1b7362 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc95af68a6d640699f788d5438cae607'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:46.505077 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c4a05cc7-252b-4f88-ac44-b7aa7f1b7362 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc95af68a6d640699f788d5438cae607'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:46.513171 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c4a05cc7-252b-4f88-ac44-b7aa7f1b7362 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc95af68a6d640699f788d5438cae607'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:46.526014 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1310/2620] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:57:46 2022] DELETE /identity/v3/users/fc95af68a6d640699f788d5438cae607 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:57:46.694810 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474aafb-5f04-4022-a713-4f89c3a3144e service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:46.705472 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474aafb-5f04-4022-a713-4f89c3a3144e service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:46.762775 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21882f7d-2daa-4e93-81c7-c45e98bd4584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:46.763631 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21882f7d-2daa-4e93-81c7-c45e98bd4584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:46.763912 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21882f7d-2daa-4e93-81c7-c45e98bd4584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:46.764219 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21882f7d-2daa-4e93-81c7-c45e98bd4584 admin admin] PATH_INFO: `/v3/projects/85f6a60140dd499abaae7cb7f0554921` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:46.765399 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21882f7d-2daa-4e93-81c7-c45e98bd4584 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85f6a60140dd499abaae7cb7f0554921)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:46.767288 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21882f7d-2daa-4e93-81c7-c45e98bd4584 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:46.812325 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-21882f7d-2daa-4e93-81c7-c45e98bd4584 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85f6a60140dd499abaae7cb7f0554921', 'request_id': 'req-21882f7d-2daa-4e93-81c7-c45e98bd4584'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:46.814204 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:46.819052 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-21882f7d-2daa-4e93-81c7-c45e98bd4584 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85f6a60140dd499abaae7cb7f0554921', 'request_id': 'req-21882f7d-2daa-4e93-81c7-c45e98bd4584'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:46.826456 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-21882f7d-2daa-4e93-81c7-c45e98bd4584 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85f6a60140dd499abaae7cb7f0554921', 'request_id': 'req-21882f7d-2daa-4e93-81c7-c45e98bd4584'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:46.837591 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-21882f7d-2daa-4e93-81c7-c45e98bd4584 admin admin] The token cache is being invalidate because project 85f6a60140dd499abaae7cb7f0554921 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:57:46.837880 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-21882f7d-2daa-4e93-81c7-c45e98bd4584 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:46.838508 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-21882f7d-2daa-4e93-81c7-c45e98bd4584 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:46.840561 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1311/2621] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:57:46 2022] DELETE /identity/v3/projects/85f6a60140dd499abaae7cb7f0554921 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:57:46.845473 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af51f2-1921-4545-9eb5-f9a420f58606 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:46.845923 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af51f2-1921-4545-9eb5-f9a420f58606 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:46.846236 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af51f2-1921-4545-9eb5-f9a420f58606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:46.865119 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-35af51f2-1921-4545-9eb5-f9a420f58606 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:46.866314 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-35af51f2-1921-4545-9eb5-f9a420f58606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:46.927063 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1311/2622] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 20:57:46.935851 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d937af-9471-423a-8f51-63482250f7cc None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:46.936168 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d937af-9471-423a-8f51-63482250f7cc None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:46.936442 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d937af-9471-423a-8f51-63482250f7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:46.954697 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-80d937af-9471-423a-8f51-63482250f7cc None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:46.955874 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-80d937af-9471-423a-8f51-63482250f7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:46.964105 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1312/2623] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:57:46.968757 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35af51f2-1921-4545-9eb5-f9a420f58606 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:46.978378 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35af51f2-1921-4545-9eb5-f9a420f58606 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:46.983097 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f152e7-5457-4a25-80ff-8f44ce8fe8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:46.983749 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f152e7-5457-4a25-80ff-8f44ce8fe8e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:46.984087 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f152e7-5457-4a25-80ff-8f44ce8fe8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:46.984385 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f152e7-5457-4a25-80ff-8f44ce8fe8e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:46.985107 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f152e7-5457-4a25-80ff-8f44ce8fe8e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:57:46.985412 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f152e7-5457-4a25-80ff-8f44ce8fe8e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:46.986985 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f152e7-5457-4a25-80ff-8f44ce8fe8e9 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:46.998279 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1312/2624] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:57:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:57:47.002393 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d937af-9471-423a-8f51-63482250f7cc None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:47.011464 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d937af-9471-423a-8f51-63482250f7cc None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:47.016632 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9296bff3-a0c3-4d78-9323-4d72faaab2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:47.017270 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296bff3-a0c3-4d78-9323-4d72faaab2d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:47.017553 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296bff3-a0c3-4d78-9323-4d72faaab2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:47.017828 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296bff3-a0c3-4d78-9323-4d72faaab2d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:47.018508 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9296bff3-a0c3-4d78-9323-4d72faaab2d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:47.020426 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9296bff3-a0c3-4d78-9323-4d72faaab2d0 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:47.046310 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1313/2625] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:57:47 2022] POST /identity/v3/projects => generated 403 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:57:47.050617 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f152e7-5457-4a25-80ff-8f44ce8fe8e9 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:47.060916 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f152e7-5457-4a25-80ff-8f44ce8fe8e9 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:47.132212 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda1eaf-5e53-4645-8e02-ca80bb30a67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:47.132970 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda1eaf-5e53-4645-8e02-ca80bb30a67a admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:47.133328 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda1eaf-5e53-4645-8e02-ca80bb30a67a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:47.133683 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda1eaf-5e53-4645-8e02-ca80bb30a67a admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:47.134394 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fda1eaf-5e53-4645-8e02-ca80bb30a67a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:47.136365 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fda1eaf-5e53-4645-8e02-ca80bb30a67a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:47.143157 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:47.161555 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1313/2626] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:57:47 2022] POST /identity/v3/users => generated 302 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 20:57:47.162693 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9296bff3-a0c3-4d78-9323-4d72faaab2d0 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:47.174217 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9296bff3-a0c3-4d78-9323-4d72faaab2d0 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:47.179809 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53873631-35c3-4661-98a7-6d0e543b17a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:47.180445 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53873631-35c3-4661-98a7-6d0e543b17a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:47.180728 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53873631-35c3-4661-98a7-6d0e543b17a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:47.181004 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53873631-35c3-4661-98a7-6d0e543b17a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:47.181739 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53873631-35c3-4661-98a7-6d0e543b17a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:47.183326 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53873631-35c3-4661-98a7-6d0e543b17a2 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:47.195570 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1314/2627] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:57:47.199453 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda1eaf-5e53-4645-8e02-ca80bb30a67a admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:47.209713 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda1eaf-5e53-4645-8e02-ca80bb30a67a admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:47.214395 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13728555-1f4a-4f69-81fe-dbb8545a0928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:47.215248 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13728555-1f4a-4f69-81fe-dbb8545a0928 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:47.215568 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13728555-1f4a-4f69-81fe-dbb8545a0928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:47.215855 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13728555-1f4a-4f69-81fe-dbb8545a0928 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:47.216629 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13728555-1f4a-4f69-81fe-dbb8545a0928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:47.218222 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13728555-1f4a-4f69-81fe-dbb8545a0928 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:47.228568 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1314/2628] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:57:47.233070 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53873631-35c3-4661-98a7-6d0e543b17a2 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:47.243093 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53873631-35c3-4661-98a7-6d0e543b17a2 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:47.248599 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c66c74-2617-49fd-b524-9ad52e05d1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:47.249501 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c66c74-2617-49fd-b524-9ad52e05d1ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:47.249784 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c66c74-2617-49fd-b524-9ad52e05d1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:47.250061 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c66c74-2617-49fd-b524-9ad52e05d1ca admin admin] PATH_INFO: `/v3/projects/c7bd04e8688143cca722359cf73f25ef/users/a5fdb245109d43bd8095a436d72a05f2/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:47.265525 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c66c74-2617-49fd-b524-9ad52e05d1ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7bd04e8688143cca722359cf73f25ef, user_id=a5fdb245109d43bd8095a436d72a05f2, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:47.268176 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c66c74-2617-49fd-b524-9ad52e05d1ca admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:47.285708 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1315/2629] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:57:47 2022] PUT /identity/v3/projects/c7bd04e8688143cca722359cf73f25ef/users/a5fdb245109d43bd8095a436d72a05f2/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:57:47.295367 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545fc14-6d2e-4786-879a-7b7e8c1b1a93 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:47.295693 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545fc14-6d2e-4786-879a-7b7e8c1b1a93 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:47.296025 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545fc14-6d2e-4786-879a-7b7e8c1b1a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:47.322483 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f545fc14-6d2e-4786-879a-7b7e8c1b1a93 None None] MFA Rules not processed for user `a5fdb245109d43bd8095a436d72a05f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:47.323689 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f545fc14-6d2e-4786-879a-7b7e8c1b1a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:47.388039 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1315/2630] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:47 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:57:47.392316 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c66c74-2617-49fd-b524-9ad52e05d1ca admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:47.453108 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c66c74-2617-49fd-b524-9ad52e05d1ca admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:47.457726 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ab789-2a8c-4149-a942-a41ae1884cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:47.458382 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ab789-2a8c-4149-a942-a41ae1884cae admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:47.458667 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ab789-2a8c-4149-a942-a41ae1884cae admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:47.458945 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ab789-2a8c-4149-a942-a41ae1884cae admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:47.459645 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506ab789-2a8c-4149-a942-a41ae1884cae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:47.461581 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506ab789-2a8c-4149-a942-a41ae1884cae admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:47.486039 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1316/2631] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:57:47 2022] POST /identity/v3/projects => generated 403 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 20:57:47.489910 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f545fc14-6d2e-4786-879a-7b7e8c1b1a93 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:47.500901 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f545fc14-6d2e-4786-879a-7b7e8c1b1a93 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:47.555481 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b86d3-566d-44bb-be49-b552b2163a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:47.556441 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b86d3-566d-44bb-be49-b552b2163a76 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:47.556641 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b86d3-566d-44bb-be49-b552b2163a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:47.556932 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b86d3-566d-44bb-be49-b552b2163a76 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:47.557628 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894b86d3-566d-44bb-be49-b552b2163a76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:47.560157 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894b86d3-566d-44bb-be49-b552b2163a76 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:47.583658 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1316/2632] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:57:47 2022] POST /identity/v3/users => generated 308 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:57:47.584830 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ab789-2a8c-4149-a942-a41ae1884cae admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:47.595300 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ab789-2a8c-4149-a942-a41ae1884cae admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:47.602636 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd264df-e588-4613-a75f-f0675c03d511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:47.612953 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd264df-e588-4613-a75f-f0675c03d511 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:47.613247 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd264df-e588-4613-a75f-f0675c03d511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:47.613532 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd264df-e588-4613-a75f-f0675c03d511 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:47.614277 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd264df-e588-4613-a75f-f0675c03d511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:47.616468 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd264df-e588-4613-a75f-f0675c03d511 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:47.630433 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1317/2633] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:57:47.634547 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b86d3-566d-44bb-be49-b552b2163a76 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:47.645283 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b86d3-566d-44bb-be49-b552b2163a76 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:47.650036 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340724a0-df8c-4d6c-a105-165a403cbd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:47.650920 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340724a0-df8c-4d6c-a105-165a403cbd95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:47.651209 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340724a0-df8c-4d6c-a105-165a403cbd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:47.651493 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340724a0-df8c-4d6c-a105-165a403cbd95 admin admin] PATH_INFO: `/v3/projects/d8e43535c0894bc3893b09ebf3efdeac/users/f7615e3f0d34478993d25a0f81436e47/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:47.666064 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340724a0-df8c-4d6c-a105-165a403cbd95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8e43535c0894bc3893b09ebf3efdeac, user_id=f7615e3f0d34478993d25a0f81436e47, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:47.668766 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340724a0-df8c-4d6c-a105-165a403cbd95 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:47.681307 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1317/2634] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:57:47 2022] PUT /identity/v3/projects/d8e43535c0894bc3893b09ebf3efdeac/users/f7615e3f0d34478993d25a0f81436e47/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:57:47.685849 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd264df-e588-4613-a75f-f0675c03d511 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:47.695647 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd264df-e588-4613-a75f-f0675c03d511 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:47.741551 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:47.753660 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc30659f-b449-4b6a-8709-436d33f0b5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:47.754334 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30659f-b449-4b6a-8709-436d33f0b5da admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:47.754623 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30659f-b449-4b6a-8709-436d33f0b5da admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:47.754907 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30659f-b449-4b6a-8709-436d33f0b5da admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:47.755640 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc30659f-b449-4b6a-8709-436d33f0b5da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:47.757287 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc30659f-b449-4b6a-8709-436d33f0b5da admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:47.767748 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1318/2635] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:57:47.771810 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340724a0-df8c-4d6c-a105-165a403cbd95 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:47.782023 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340724a0-df8c-4d6c-a105-165a403cbd95 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:47.786672 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aeff3d-05e0-4adb-94ae-aa9edda10f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:47.787581 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aeff3d-05e0-4adb-94ae-aa9edda10f90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:47.787868 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aeff3d-05e0-4adb-94ae-aa9edda10f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:47.788190 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aeff3d-05e0-4adb-94ae-aa9edda10f90 admin admin] PATH_INFO: `/v3/projects/d8e43535c0894bc3893b09ebf3efdeac/users/f7615e3f0d34478993d25a0f81436e47/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:47.790135 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aeff3d-05e0-4adb-94ae-aa9edda10f90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8e43535c0894bc3893b09ebf3efdeac, user_id=f7615e3f0d34478993d25a0f81436e47, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:47.792794 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aeff3d-05e0-4adb-94ae-aa9edda10f90 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:47.803014 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1318/2636] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:57:47 2022] PUT /identity/v3/projects/d8e43535c0894bc3893b09ebf3efdeac/users/f7615e3f0d34478993d25a0f81436e47/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:57:47.813169 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03121e96-9aac-4002-ac0a-d02c9dcbb73b None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:47.813462 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03121e96-9aac-4002-ac0a-d02c9dcbb73b None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:47.813746 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03121e96-9aac-4002-ac0a-d02c9dcbb73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:47.839833 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-03121e96-9aac-4002-ac0a-d02c9dcbb73b None None] MFA Rules not processed for user `f7615e3f0d34478993d25a0f81436e47`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:47.841089 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-03121e96-9aac-4002-ac0a-d02c9dcbb73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:47.910516 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1319/2637] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:47 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:57:47.921127 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aeff3d-05e0-4adb-94ae-aa9edda10f90 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:47.922829 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b5aeff3d-05e0-4adb-94ae-aa9edda10f90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:47.952171 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:47.997798 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aeff3d-05e0-4adb-94ae-aa9edda10f90 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:48.001384 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af4d14-7c8c-4407-b51f-8d452d568ac4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:48.002027 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af4d14-7c8c-4407-b51f-8d452d568ac4 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:48.002315 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af4d14-7c8c-4407-b51f-8d452d568ac4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:48.002596 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af4d14-7c8c-4407-b51f-8d452d568ac4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:48.012396 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af4d14-7c8c-4407-b51f-8d452d568ac4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:48.013819 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af4d14-7c8c-4407-b51f-8d452d568ac4 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:48.023106 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1319/2638] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:57:47 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:57:48.393463 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03121e96-9aac-4002-ac0a-d02c9dcbb73b None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:48.455839 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03121e96-9aac-4002-ac0a-d02c9dcbb73b None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:48.460358 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176ae72-809d-44c0-9471-eef0a1d61754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:48.461207 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176ae72-809d-44c0-9471-eef0a1d61754 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:48.461492 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176ae72-809d-44c0-9471-eef0a1d61754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:48.461768 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176ae72-809d-44c0-9471-eef0a1d61754 admin admin] PATH_INFO: `/v3/users/a5fdb245109d43bd8095a436d72a05f2` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:48.462941 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e176ae72-809d-44c0-9471-eef0a1d61754 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5fdb245109d43bd8095a436d72a05f2)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:48.465380 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e176ae72-809d-44c0-9471-eef0a1d61754 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:48.510160 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-e176ae72-809d-44c0-9471-eef0a1d61754 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5fdb245109d43bd8095a436d72a05f2'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:48.510794 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-e176ae72-809d-44c0-9471-eef0a1d61754 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5fdb245109d43bd8095a436d72a05f2'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:48.517490 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-e176ae72-809d-44c0-9471-eef0a1d61754 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5fdb245109d43bd8095a436d72a05f2'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:48.529719 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-e176ae72-809d-44c0-9471-eef0a1d61754 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5fdb245109d43bd8095a436d72a05f2'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:48.530355 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-e176ae72-809d-44c0-9471-eef0a1d61754 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5fdb245109d43bd8095a436d72a05f2'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:48.532527 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:48.544966 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1320/2639] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:57:48 2022] DELETE /identity/v3/users/a5fdb245109d43bd8095a436d72a05f2 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:57:48.549487 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324d036-b8e5-4081-b014-af8ba3a8013d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:48.550225 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324d036-b8e5-4081-b014-af8ba3a8013d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:48.550313 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324d036-b8e5-4081-b014-af8ba3a8013d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:48.567163 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-4324d036-b8e5-4081-b014-af8ba3a8013d None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:48.568388 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4324d036-b8e5-4081-b014-af8ba3a8013d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:48.625762 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1320/2640] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 20:57:48.635368 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176ae72-809d-44c0-9471-eef0a1d61754 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:48.636882 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-e176ae72-809d-44c0-9471-eef0a1d61754 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:48.715580 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176ae72-809d-44c0-9471-eef0a1d61754 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:48.719437 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842eac7e-8010-4935-af36-d0c7b32bb63a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:48.720122 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842eac7e-8010-4935-af36-d0c7b32bb63a service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:48.720428 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842eac7e-8010-4935-af36-d0c7b32bb63a service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:48.720705 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842eac7e-8010-4935-af36-d0c7b32bb63a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:48.729688 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842eac7e-8010-4935-af36-d0c7b32bb63a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:48.731683 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842eac7e-8010-4935-af36-d0c7b32bb63a service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:48.741062 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1321/2641] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:57:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:57:49.007174 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4324d036-b8e5-4081-b014-af8ba3a8013d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:49.008625 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4324d036-b8e5-4081-b014-af8ba3a8013d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:49.023677 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4324d036-b8e5-4081-b014-af8ba3a8013d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:49.030059 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1354308-5601-4e67-8faa-9e1ebc0ee36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:49.031477 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1354308-5601-4e67-8faa-9e1ebc0ee36d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:49.031798 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1354308-5601-4e67-8faa-9e1ebc0ee36d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:49.032155 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1354308-5601-4e67-8faa-9e1ebc0ee36d admin admin] PATH_INFO: `/v3/projects/c7bd04e8688143cca722359cf73f25ef` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:49.033331 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1354308-5601-4e67-8faa-9e1ebc0ee36d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7bd04e8688143cca722359cf73f25ef)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:49.035219 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1354308-5601-4e67-8faa-9e1ebc0ee36d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:49.081911 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a1354308-5601-4e67-8faa-9e1ebc0ee36d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7bd04e8688143cca722359cf73f25ef', 'request_id': 'req-a1354308-5601-4e67-8faa-9e1ebc0ee36d'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:49.088917 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a1354308-5601-4e67-8faa-9e1ebc0ee36d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7bd04e8688143cca722359cf73f25ef', 'request_id': 'req-a1354308-5601-4e67-8faa-9e1ebc0ee36d'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:49.094884 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a1354308-5601-4e67-8faa-9e1ebc0ee36d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7bd04e8688143cca722359cf73f25ef', 'request_id': 'req-a1354308-5601-4e67-8faa-9e1ebc0ee36d'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:49.105531 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a1354308-5601-4e67-8faa-9e1ebc0ee36d admin admin] The token cache is being invalidate because project c7bd04e8688143cca722359cf73f25ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:57:49.105807 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a1354308-5601-4e67-8faa-9e1ebc0ee36d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:49.106453 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a1354308-5601-4e67-8faa-9e1ebc0ee36d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:49.107994 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1321/2642] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:57:49 2022] DELETE /identity/v3/projects/c7bd04e8688143cca722359cf73f25ef => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:57:49.111822 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842eac7e-8010-4935-af36-d0c7b32bb63a service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:49.121225 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842eac7e-8010-4935-af36-d0c7b32bb63a service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:49.177414 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4da5ba-81b0-4f80-a450-97336d95ba85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:49.178392 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4da5ba-81b0-4f80-a450-97336d95ba85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:49.178681 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4da5ba-81b0-4f80-a450-97336d95ba85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:49.178965 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4da5ba-81b0-4f80-a450-97336d95ba85 admin admin] PATH_INFO: `/v3/users/f7615e3f0d34478993d25a0f81436e47` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:49.180184 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4da5ba-81b0-4f80-a450-97336d95ba85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7615e3f0d34478993d25a0f81436e47)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:49.182120 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4da5ba-81b0-4f80-a450-97336d95ba85 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:49.236257 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-bd4da5ba-81b0-4f80-a450-97336d95ba85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7615e3f0d34478993d25a0f81436e47'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:49.236931 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-bd4da5ba-81b0-4f80-a450-97336d95ba85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7615e3f0d34478993d25a0f81436e47'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:49.249417 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-bd4da5ba-81b0-4f80-a450-97336d95ba85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7615e3f0d34478993d25a0f81436e47'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:49.268181 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-bd4da5ba-81b0-4f80-a450-97336d95ba85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7615e3f0d34478993d25a0f81436e47'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:49.268832 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-bd4da5ba-81b0-4f80-a450-97336d95ba85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7615e3f0d34478993d25a0f81436e47'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:49.273765 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:49.289557 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1322/2643] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:57:49 2022] DELETE /identity/v3/users/f7615e3f0d34478993d25a0f81436e47 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:57:49.589589 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1354308-5601-4e67-8faa-9e1ebc0ee36d admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:49.591745 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a1354308-5601-4e67-8faa-9e1ebc0ee36d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:49.617320 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1354308-5601-4e67-8faa-9e1ebc0ee36d admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:49.668490 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:49.703310 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14091494-b49a-4dcd-9ad7-cfa3893b4f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:49.704238 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14091494-b49a-4dcd-9ad7-cfa3893b4f1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:49.704526 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14091494-b49a-4dcd-9ad7-cfa3893b4f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:49.704809 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14091494-b49a-4dcd-9ad7-cfa3893b4f1a admin admin] PATH_INFO: `/v3/projects/d8e43535c0894bc3893b09ebf3efdeac` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:49.706017 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14091494-b49a-4dcd-9ad7-cfa3893b4f1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8e43535c0894bc3893b09ebf3efdeac)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:49.707906 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14091494-b49a-4dcd-9ad7-cfa3893b4f1a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:49.758780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-14091494-b49a-4dcd-9ad7-cfa3893b4f1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8e43535c0894bc3893b09ebf3efdeac', 'request_id': 'req-14091494-b49a-4dcd-9ad7-cfa3893b4f1a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:49.766662 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-14091494-b49a-4dcd-9ad7-cfa3893b4f1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8e43535c0894bc3893b09ebf3efdeac', 'request_id': 'req-14091494-b49a-4dcd-9ad7-cfa3893b4f1a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:49.772579 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-14091494-b49a-4dcd-9ad7-cfa3893b4f1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8e43535c0894bc3893b09ebf3efdeac', 'request_id': 'req-14091494-b49a-4dcd-9ad7-cfa3893b4f1a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:49.784716 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-14091494-b49a-4dcd-9ad7-cfa3893b4f1a admin admin] The token cache is being invalidate because project d8e43535c0894bc3893b09ebf3efdeac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:57:49.785012 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-14091494-b49a-4dcd-9ad7-cfa3893b4f1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:49.785655 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-14091494-b49a-4dcd-9ad7-cfa3893b4f1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:49.787201 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1322/2644] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:57:49 2022] DELETE /identity/v3/projects/d8e43535c0894bc3893b09ebf3efdeac => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:57:49.792003 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66881cf-9ad5-4d9c-8260-9e41f3cf48d4 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:49.792870 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66881cf-9ad5-4d9c-8260-9e41f3cf48d4 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:49.793436 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66881cf-9ad5-4d9c-8260-9e41f3cf48d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:49.814127 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-c66881cf-9ad5-4d9c-8260-9e41f3cf48d4 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:49.815359 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-c66881cf-9ad5-4d9c-8260-9e41f3cf48d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:49.895786 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1323/2645] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:57:49.905930 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca72ff1-3536-4af0-a86f-e0ba468a8ed6 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:49.906246 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca72ff1-3536-4af0-a86f-e0ba468a8ed6 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:49.906524 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca72ff1-3536-4af0-a86f-e0ba468a8ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:49.931616 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-1ca72ff1-3536-4af0-a86f-e0ba468a8ed6 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:49.933030 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1ca72ff1-3536-4af0-a86f-e0ba468a8ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:49.946703 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1323/2646] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:57:49.948044 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66881cf-9ad5-4d9c-8260-9e41f3cf48d4 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:49.968695 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66881cf-9ad5-4d9c-8260-9e41f3cf48d4 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:49.973383 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb6f08-a46f-4490-b695-c9ff4c95a32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:49.974085 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb6f08-a46f-4490-b695-c9ff4c95a32b admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:49.974357 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb6f08-a46f-4490-b695-c9ff4c95a32b admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:49.974657 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb6f08-a46f-4490-b695-c9ff4c95a32b admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:49.975382 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedb6f08-a46f-4490-b695-c9ff4c95a32b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:57:49.975791 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedb6f08-a46f-4490-b695-c9ff4c95a32b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:49.977763 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedb6f08-a46f-4490-b695-c9ff4c95a32b admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:49.998245 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1324/2647] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:57:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:57:49.999962 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca72ff1-3536-4af0-a86f-e0ba468a8ed6 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:50.010083 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca72ff1-3536-4af0-a86f-e0ba468a8ed6 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:50.015625 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1987f66a-d9c5-4853-8bfc-8a73a6c48d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:50.016402 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987f66a-d9c5-4853-8bfc-8a73a6c48d19 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:50.016815 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987f66a-d9c5-4853-8bfc-8a73a6c48d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:50.017101 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987f66a-d9c5-4853-8bfc-8a73a6c48d19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:50.017803 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1987f66a-d9c5-4853-8bfc-8a73a6c48d19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:50.019770 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1987f66a-d9c5-4853-8bfc-8a73a6c48d19 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:50.056997 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1324/2648] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:57:49 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 20:57:50.059009 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb6f08-a46f-4490-b695-c9ff4c95a32b admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:50.070185 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb6f08-a46f-4490-b695-c9ff4c95a32b admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:50.134928 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a36b8-f601-4c56-822c-e38749e91591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:50.135958 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a36b8-f601-4c56-822c-e38749e91591 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:50.139508 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a36b8-f601-4c56-822c-e38749e91591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:50.139508 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a36b8-f601-4c56-822c-e38749e91591 admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:50.139508 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a36b8-f601-4c56-822c-e38749e91591 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:50.140608 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a36b8-f601-4c56-822c-e38749e91591 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:50.163657 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1325/2649] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:57:50 2022] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 20:57:50.167406 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1987f66a-d9c5-4853-8bfc-8a73a6c48d19 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:50.178138 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1987f66a-d9c5-4853-8bfc-8a73a6c48d19 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:50.182732 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510bc764-bffc-4159-a53d-35f48b5c9c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:50.184194 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510bc764-bffc-4159-a53d-35f48b5c9c89 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:50.184408 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510bc764-bffc-4159-a53d-35f48b5c9c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:50.184501 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510bc764-bffc-4159-a53d-35f48b5c9c89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:50.185217 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510bc764-bffc-4159-a53d-35f48b5c9c89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:50.186915 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510bc764-bffc-4159-a53d-35f48b5c9c89 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:50.203990 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1325/2650] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:57:50.205175 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a36b8-f601-4c56-822c-e38749e91591 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:50.215822 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a36b8-f601-4c56-822c-e38749e91591 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:50.220589 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb87ace8-414f-49b4-abee-e9441b16c890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:50.221255 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87ace8-414f-49b4-abee-e9441b16c890 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:50.221545 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87ace8-414f-49b4-abee-e9441b16c890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:50.222413 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87ace8-414f-49b4-abee-e9441b16c890 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:50.222672 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb87ace8-414f-49b4-abee-e9441b16c890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:50.224305 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb87ace8-414f-49b4-abee-e9441b16c890 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:50.235644 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1326/2651] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:57:50.239650 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510bc764-bffc-4159-a53d-35f48b5c9c89 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:50.249713 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510bc764-bffc-4159-a53d-35f48b5c9c89 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:50.255775 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d341c538-1ac8-4526-9ecb-9482e9325e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:50.256808 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341c538-1ac8-4526-9ecb-9482e9325e6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:50.257094 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341c538-1ac8-4526-9ecb-9482e9325e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:50.257374 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341c538-1ac8-4526-9ecb-9482e9325e6b admin admin] PATH_INFO: `/v3/projects/ba8eee4aa31c4278a7c7282fd02cfbd4/users/1b08f2f4d7d94a6ab5e9a583daf390a4/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:50.273285 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d341c538-1ac8-4526-9ecb-9482e9325e6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba8eee4aa31c4278a7c7282fd02cfbd4, user_id=1b08f2f4d7d94a6ab5e9a583daf390a4, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:50.276654 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d341c538-1ac8-4526-9ecb-9482e9325e6b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:50.302384 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1326/2652] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:57:50 2022] PUT /identity/v3/projects/ba8eee4aa31c4278a7c7282fd02cfbd4/users/1b08f2f4d7d94a6ab5e9a583daf390a4/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:57:50.312962 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c307d-4e1b-478e-b60c-0f04f356dbe1 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:50.313260 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c307d-4e1b-478e-b60c-0f04f356dbe1 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:50.313548 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c307d-4e1b-478e-b60c-0f04f356dbe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:50.341510 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-fe6c307d-4e1b-478e-b60c-0f04f356dbe1 None None] MFA Rules not processed for user `1b08f2f4d7d94a6ab5e9a583daf390a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:50.342753 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-fe6c307d-4e1b-478e-b60c-0f04f356dbe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:50.390749 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:50.412164 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1327/2653] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:57:50.416689 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d341c538-1ac8-4526-9ecb-9482e9325e6b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:50.486611 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d341c538-1ac8-4526-9ecb-9482e9325e6b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:50.496668 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f085890d-edb8-41d3-9ba6-0ea5a222d7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:50.497342 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085890d-edb8-41d3-9ba6-0ea5a222d7f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:50.497633 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085890d-edb8-41d3-9ba6-0ea5a222d7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:50.497910 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085890d-edb8-41d3-9ba6-0ea5a222d7f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:50.498661 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f085890d-edb8-41d3-9ba6-0ea5a222d7f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:50.500513 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f085890d-edb8-41d3-9ba6-0ea5a222d7f0 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:50.504862 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:50.547511 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1327/2654] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:57:50 2022] POST /identity/v3/projects => generated 371 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:57:50.551728 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c307d-4e1b-478e-b60c-0f04f356dbe1 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:50.562881 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c307d-4e1b-478e-b60c-0f04f356dbe1 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:50.621917 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b94b8e-eaa1-46d4-a926-1cfc9a213a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:50.622597 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b94b8e-eaa1-46d4-a926-1cfc9a213a84 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:50.622886 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b94b8e-eaa1-46d4-a926-1cfc9a213a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:50.623174 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b94b8e-eaa1-46d4-a926-1cfc9a213a84 admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:50.623864 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b94b8e-eaa1-46d4-a926-1cfc9a213a84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:50.625798 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b94b8e-eaa1-46d4-a926-1cfc9a213a84 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:50.645518 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1328/2655] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:57:50 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:57:50.649798 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f085890d-edb8-41d3-9ba6-0ea5a222d7f0 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:50.660837 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f085890d-edb8-41d3-9ba6-0ea5a222d7f0 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:50.666799 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f0385-7681-4754-afee-f61a128e4747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:50.667512 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f0385-7681-4754-afee-f61a128e4747 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:50.667840 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f0385-7681-4754-afee-f61a128e4747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:50.668129 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f0385-7681-4754-afee-f61a128e4747 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:50.668867 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2f0385-7681-4754-afee-f61a128e4747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:50.670514 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2f0385-7681-4754-afee-f61a128e4747 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:50.682148 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1328/2656] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:57:50.686987 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b94b8e-eaa1-46d4-a926-1cfc9a213a84 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:50.710194 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b94b8e-eaa1-46d4-a926-1cfc9a213a84 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:50.715270 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3baccb-158c-4d7a-a337-527dca0fd97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:50.716294 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3baccb-158c-4d7a-a337-527dca0fd97f admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:50.716468 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3baccb-158c-4d7a-a337-527dca0fd97f admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:50.716743 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3baccb-158c-4d7a-a337-527dca0fd97f admin admin] PATH_INFO: `/v3/projects/5d7e02c3fe354267b1298be8ef0d7432/users/61f279fb499d4a0cb795c619272b3f78/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:50.732635 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3baccb-158c-4d7a-a337-527dca0fd97f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d7e02c3fe354267b1298be8ef0d7432, user_id=61f279fb499d4a0cb795c619272b3f78, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:50.735267 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3baccb-158c-4d7a-a337-527dca0fd97f admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:50.763380 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1329/2657] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:57:50 2022] PUT /identity/v3/projects/5d7e02c3fe354267b1298be8ef0d7432/users/61f279fb499d4a0cb795c619272b3f78/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:57:50.767256 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f0385-7681-4754-afee-f61a128e4747 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:50.777484 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f0385-7681-4754-afee-f61a128e4747 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:50.844086 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a967d485-c213-47a7-ace0-89e6c644b73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:50.844865 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967d485-c213-47a7-ace0-89e6c644b73f admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:50.845293 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967d485-c213-47a7-ace0-89e6c644b73f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:50.845598 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967d485-c213-47a7-ace0-89e6c644b73f admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:50.846319 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a967d485-c213-47a7-ace0-89e6c644b73f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:50.847942 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a967d485-c213-47a7-ace0-89e6c644b73f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:50.861741 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1329/2658] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 20:57:50.865849 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3baccb-158c-4d7a-a337-527dca0fd97f admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:50.877177 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3baccb-158c-4d7a-a337-527dca0fd97f admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:50.881803 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571dd17-3a98-41cb-aec8-7edf24a30f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:50.882687 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571dd17-3a98-41cb-aec8-7edf24a30f8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:50.882975 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571dd17-3a98-41cb-aec8-7edf24a30f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:50.883248 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571dd17-3a98-41cb-aec8-7edf24a30f8b admin admin] PATH_INFO: `/v3/projects/5d7e02c3fe354267b1298be8ef0d7432/users/61f279fb499d4a0cb795c619272b3f78/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:50.885232 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a571dd17-3a98-41cb-aec8-7edf24a30f8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d7e02c3fe354267b1298be8ef0d7432, user_id=61f279fb499d4a0cb795c619272b3f78, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:50.888495 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a571dd17-3a98-41cb-aec8-7edf24a30f8b admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:50.899027 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1330/2659] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:57:50 2022] PUT /identity/v3/projects/5d7e02c3fe354267b1298be8ef0d7432/users/61f279fb499d4a0cb795c619272b3f78/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:57:50.909092 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71dd439-ecdb-47a1-8f19-550adc6c8dd6 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:50.909390 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71dd439-ecdb-47a1-8f19-550adc6c8dd6 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:50.909678 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71dd439-ecdb-47a1-8f19-550adc6c8dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:50.936169 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-d71dd439-ecdb-47a1-8f19-550adc6c8dd6 None None] MFA Rules not processed for user `61f279fb499d4a0cb795c619272b3f78`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:50.937382 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d71dd439-ecdb-47a1-8f19-550adc6c8dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:51.004188 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1330/2660] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:50 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 20:57:51.016309 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571dd17-3a98-41cb-aec8-7edf24a30f8b admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:51.018004 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-a571dd17-3a98-41cb-aec8-7edf24a30f8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:51.074856 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571dd17-3a98-41cb-aec8-7edf24a30f8b admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:51.078451 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab140b10-b1d1-4c83-b230-4521c4222e14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:51.079083 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab140b10-b1d1-4c83-b230-4521c4222e14 service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:51.079368 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab140b10-b1d1-4c83-b230-4521c4222e14 service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:51.079648 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab140b10-b1d1-4c83-b230-4521c4222e14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:51.088387 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab140b10-b1d1-4c83-b230-4521c4222e14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:51.090406 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab140b10-b1d1-4c83-b230-4521c4222e14 service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:51.099582 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1331/2661] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:57:51 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:57:51.481317 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71dd439-ecdb-47a1-8f19-550adc6c8dd6 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:51.540695 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:51.546430 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71dd439-ecdb-47a1-8f19-550adc6c8dd6 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:51.551712 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4824ea2-861e-4a1b-a53b-fce47e0b6ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:51.552793 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4824ea2-861e-4a1b-a53b-fce47e0b6ea3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:51.553085 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4824ea2-861e-4a1b-a53b-fce47e0b6ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:51.553371 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4824ea2-861e-4a1b-a53b-fce47e0b6ea3 admin admin] PATH_INFO: `/v3/users/1b08f2f4d7d94a6ab5e9a583daf390a4` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:51.554748 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4824ea2-861e-4a1b-a53b-fce47e0b6ea3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b08f2f4d7d94a6ab5e9a583daf390a4)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:51.556944 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4824ea2-861e-4a1b-a53b-fce47e0b6ea3 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:51.605065 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a4824ea2-861e-4a1b-a53b-fce47e0b6ea3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b08f2f4d7d94a6ab5e9a583daf390a4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:51.606283 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a4824ea2-861e-4a1b-a53b-fce47e0b6ea3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b08f2f4d7d94a6ab5e9a583daf390a4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:51.606882 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a4824ea2-861e-4a1b-a53b-fce47e0b6ea3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b08f2f4d7d94a6ab5e9a583daf390a4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:51.621656 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a4824ea2-861e-4a1b-a53b-fce47e0b6ea3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b08f2f4d7d94a6ab5e9a583daf390a4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:51.629770 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a4824ea2-861e-4a1b-a53b-fce47e0b6ea3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b08f2f4d7d94a6ab5e9a583daf390a4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:51.643561 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1331/2662] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:57:51 2022] DELETE /identity/v3/users/1b08f2f4d7d94a6ab5e9a583daf390a4 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:57:51.648276 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea0377-5dfd-4b57-acf5-ec24e9ea6f2e None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:51.648692 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea0377-5dfd-4b57-acf5-ec24e9ea6f2e None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:51.648993 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea0377-5dfd-4b57-acf5-ec24e9ea6f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:51.676692 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-3cea0377-5dfd-4b57-acf5-ec24e9ea6f2e None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:51.676692 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-3cea0377-5dfd-4b57-acf5-ec24e9ea6f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:51.716478 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:51.736957 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1332/2663] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 20:57:51.747098 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4824ea2-861e-4a1b-a53b-fce47e0b6ea3 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:51.748611 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a4824ea2-861e-4a1b-a53b-fce47e0b6ea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:51.814858 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4824ea2-861e-4a1b-a53b-fce47e0b6ea3 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:51.818573 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1100474-3d68-4099-9075-ccd707292e43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:51.819226 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1100474-3d68-4099-9075-ccd707292e43 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:51.819510 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1100474-3d68-4099-9075-ccd707292e43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:51.819789 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1100474-3d68-4099-9075-ccd707292e43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:51.830222 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1100474-3d68-4099-9075-ccd707292e43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:51.831831 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1100474-3d68-4099-9075-ccd707292e43 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:51.843514 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1332/2664] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:57:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:57:52.327053 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea0377-5dfd-4b57-acf5-ec24e9ea6f2e None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:52.329179 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-3cea0377-5dfd-4b57-acf5-ec24e9ea6f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:52.344767 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea0377-5dfd-4b57-acf5-ec24e9ea6f2e None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:52.350537 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7f3b6-b103-4455-bff4-c1cdc4c4e894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:52.351678 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7f3b6-b103-4455-bff4-c1cdc4c4e894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:52.351993 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7f3b6-b103-4455-bff4-c1cdc4c4e894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:52.352277 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7f3b6-b103-4455-bff4-c1cdc4c4e894 admin admin] PATH_INFO: `/v3/projects/ba8eee4aa31c4278a7c7282fd02cfbd4` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:52.353525 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc7f3b6-b103-4455-bff4-c1cdc4c4e894 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba8eee4aa31c4278a7c7282fd02cfbd4)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:52.355519 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc7f3b6-b103-4455-bff4-c1cdc4c4e894 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:52.423627 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-2dc7f3b6-b103-4455-bff4-c1cdc4c4e894 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba8eee4aa31c4278a7c7282fd02cfbd4', 'request_id': 'req-2dc7f3b6-b103-4455-bff4-c1cdc4c4e894'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:52.433138 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-2dc7f3b6-b103-4455-bff4-c1cdc4c4e894 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba8eee4aa31c4278a7c7282fd02cfbd4', 'request_id': 'req-2dc7f3b6-b103-4455-bff4-c1cdc4c4e894'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:52.444499 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-2dc7f3b6-b103-4455-bff4-c1cdc4c4e894 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba8eee4aa31c4278a7c7282fd02cfbd4', 'request_id': 'req-2dc7f3b6-b103-4455-bff4-c1cdc4c4e894'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:52.465488 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-2dc7f3b6-b103-4455-bff4-c1cdc4c4e894 admin admin] The token cache is being invalidate because project ba8eee4aa31c4278a7c7282fd02cfbd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:57:52.466018 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-2dc7f3b6-b103-4455-bff4-c1cdc4c4e894 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:52.467067 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-2dc7f3b6-b103-4455-bff4-c1cdc4c4e894 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:52.469741 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1333/2665] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:57:52 2022] DELETE /identity/v3/projects/ba8eee4aa31c4278a7c7282fd02cfbd4 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:57:52.473995 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1100474-3d68-4099-9075-ccd707292e43 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:52.483838 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1100474-3d68-4099-9075-ccd707292e43 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:52.541621 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f1d33-2eb0-4684-84ac-567d5fdd5f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:52.542503 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f1d33-2eb0-4684-84ac-567d5fdd5f9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:52.543325 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f1d33-2eb0-4684-84ac-567d5fdd5f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:52.543606 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f1d33-2eb0-4684-84ac-567d5fdd5f9c admin admin] PATH_INFO: `/v3/users/61f279fb499d4a0cb795c619272b3f78` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:52.544839 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95f1d33-2eb0-4684-84ac-567d5fdd5f9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=61f279fb499d4a0cb795c619272b3f78)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:52.546741 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95f1d33-2eb0-4684-84ac-567d5fdd5f9c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:52.569132 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:52.596547 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a95f1d33-2eb0-4684-84ac-567d5fdd5f9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61f279fb499d4a0cb795c619272b3f78'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:52.597288 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a95f1d33-2eb0-4684-84ac-567d5fdd5f9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61f279fb499d4a0cb795c619272b3f78'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:52.597958 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a95f1d33-2eb0-4684-84ac-567d5fdd5f9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61f279fb499d4a0cb795c619272b3f78'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:52.610919 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a95f1d33-2eb0-4684-84ac-567d5fdd5f9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61f279fb499d4a0cb795c619272b3f78'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:52.618521 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a95f1d33-2eb0-4684-84ac-567d5fdd5f9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61f279fb499d4a0cb795c619272b3f78'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:52.631736 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1333/2666] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:57:52 2022] DELETE /identity/v3/users/61f279fb499d4a0cb795c619272b3f78 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:57:52.705527 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7f3b6-b103-4455-bff4-c1cdc4c4e894 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:52.707672 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-2dc7f3b6-b103-4455-bff4-c1cdc4c4e894 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:52.728981 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7f3b6-b103-4455-bff4-c1cdc4c4e894 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:52.790529 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f794a85-1b53-40b5-b32d-6a08fbf156e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:52.791411 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f794a85-1b53-40b5-b32d-6a08fbf156e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:52.791699 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f794a85-1b53-40b5-b32d-6a08fbf156e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:52.792006 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f794a85-1b53-40b5-b32d-6a08fbf156e1 admin admin] PATH_INFO: `/v3/users/51459b15bc044d4a83ec46bdaa77b7bd` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:52.793753 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f794a85-1b53-40b5-b32d-6a08fbf156e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51459b15bc044d4a83ec46bdaa77b7bd)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:52.796806 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f794a85-1b53-40b5-b32d-6a08fbf156e1 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:52.863654 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-1f794a85-1b53-40b5-b32d-6a08fbf156e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51459b15bc044d4a83ec46bdaa77b7bd'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:52.864353 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-1f794a85-1b53-40b5-b32d-6a08fbf156e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51459b15bc044d4a83ec46bdaa77b7bd'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:52.873602 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-1f794a85-1b53-40b5-b32d-6a08fbf156e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51459b15bc044d4a83ec46bdaa77b7bd'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:52.885444 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:52.887168 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-1f794a85-1b53-40b5-b32d-6a08fbf156e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51459b15bc044d4a83ec46bdaa77b7bd'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:52.888119 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-1f794a85-1b53-40b5-b32d-6a08fbf156e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51459b15bc044d4a83ec46bdaa77b7bd'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:52.904437 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1334/2667] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:57:52 2022] DELETE /identity/v3/users/51459b15bc044d4a83ec46bdaa77b7bd => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:57:52.945807 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f1d33-2eb0-4684-84ac-567d5fdd5f9c admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:52.948047 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a95f1d33-2eb0-4684-84ac-567d5fdd5f9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:52.963115 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f1d33-2eb0-4684-84ac-567d5fdd5f9c admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:53.022042 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86075a4-bd36-47f1-beb8-ca53c5a648ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:53.022909 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86075a4-bd36-47f1-beb8-ca53c5a648ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:53.023190 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86075a4-bd36-47f1-beb8-ca53c5a648ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:53.023463 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86075a4-bd36-47f1-beb8-ca53c5a648ec admin admin] PATH_INFO: `/v3/projects/5d7e02c3fe354267b1298be8ef0d7432` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:53.024645 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86075a4-bd36-47f1-beb8-ca53c5a648ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d7e02c3fe354267b1298be8ef0d7432)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:53.026531 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86075a4-bd36-47f1-beb8-ca53c5a648ec admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:53.086933 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c86075a4-bd36-47f1-beb8-ca53c5a648ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d7e02c3fe354267b1298be8ef0d7432', 'request_id': 'req-c86075a4-bd36-47f1-beb8-ca53c5a648ec'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:53.095932 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c86075a4-bd36-47f1-beb8-ca53c5a648ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d7e02c3fe354267b1298be8ef0d7432', 'request_id': 'req-c86075a4-bd36-47f1-beb8-ca53c5a648ec'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:53.101422 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f794a85-1b53-40b5-b32d-6a08fbf156e1 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:53.104295 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-1f794a85-1b53-40b5-b32d-6a08fbf156e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:53.105243 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c86075a4-bd36-47f1-beb8-ca53c5a648ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d7e02c3fe354267b1298be8ef0d7432', 'request_id': 'req-c86075a4-bd36-47f1-beb8-ca53c5a648ec'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:53.116715 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c86075a4-bd36-47f1-beb8-ca53c5a648ec admin admin] The token cache is being invalidate because project 5d7e02c3fe354267b1298be8ef0d7432 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:57:53.116994 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c86075a4-bd36-47f1-beb8-ca53c5a648ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:53.117726 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c86075a4-bd36-47f1-beb8-ca53c5a648ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:53.119269 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1334/2668] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:57:52 2022] DELETE /identity/v3/projects/5d7e02c3fe354267b1298be8ef0d7432 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:57:53.120279 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f794a85-1b53-40b5-b32d-6a08fbf156e1 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:53.124383 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30107d-18e2-46c1-a4a3-1b519935faa4 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:53.124674 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30107d-18e2-46c1-a4a3-1b519935faa4 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:53.124954 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30107d-18e2-46c1-a4a3-1b519935faa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:53.143292 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ae30107d-18e2-46c1-a4a3-1b519935faa4 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:53.144523 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ae30107d-18e2-46c1-a4a3-1b519935faa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:53.169742 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:53.187778 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932f4139-48d9-4322-b1be-8f9797fa81f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:53.189325 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f4139-48d9-4322-b1be-8f9797fa81f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:53.189770 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f4139-48d9-4322-b1be-8f9797fa81f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:53.190370 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f4139-48d9-4322-b1be-8f9797fa81f8 admin admin] PATH_INFO: `/v3/projects/16464e66cf9b45b690ea9e62bcdebc61` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:53.191869 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932f4139-48d9-4322-b1be-8f9797fa81f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16464e66cf9b45b690ea9e62bcdebc61)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:53.193820 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932f4139-48d9-4322-b1be-8f9797fa81f8 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:53.212339 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1335/2669] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 20:57:53.244485 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-932f4139-48d9-4322-b1be-8f9797fa81f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16464e66cf9b45b690ea9e62bcdebc61', 'request_id': 'req-932f4139-48d9-4322-b1be-8f9797fa81f8'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:53.251011 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-932f4139-48d9-4322-b1be-8f9797fa81f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16464e66cf9b45b690ea9e62bcdebc61', 'request_id': 'req-932f4139-48d9-4322-b1be-8f9797fa81f8'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:53.260122 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-932f4139-48d9-4322-b1be-8f9797fa81f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16464e66cf9b45b690ea9e62bcdebc61', 'request_id': 'req-932f4139-48d9-4322-b1be-8f9797fa81f8'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:53.270895 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c2dc4-dcd2-47dc-8228-8d5fd33a599b None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:53.271182 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c2dc4-dcd2-47dc-8228-8d5fd33a599b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:53.271458 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c2dc4-dcd2-47dc-8228-8d5fd33a599b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:53.273780 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-932f4139-48d9-4322-b1be-8f9797fa81f8 admin admin] The token cache is being invalidate because project 16464e66cf9b45b690ea9e62bcdebc61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:57:53.274085 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-932f4139-48d9-4322-b1be-8f9797fa81f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:53.274724 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-932f4139-48d9-4322-b1be-8f9797fa81f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:53.276489 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1335/2670] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:57:53 2022] DELETE /identity/v3/projects/16464e66cf9b45b690ea9e62bcdebc61 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:57:53.280207 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932f4139-48d9-4322-b1be-8f9797fa81f8 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:53.281521 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-932f4139-48d9-4322-b1be-8f9797fa81f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:53.289399 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c69c2dc4-dcd2-47dc-8228-8d5fd33a599b None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:53.290572 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c69c2dc4-dcd2-47dc-8228-8d5fd33a599b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:53.352096 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1336/2671] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 20:57:53.356912 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c2dc4-dcd2-47dc-8228-8d5fd33a599b None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:53.357173 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932f4139-48d9-4322-b1be-8f9797fa81f8 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:53.361858 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2dee04-fd23-45e4-a775-c67ef29d2291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:53.362739 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2dee04-fd23-45e4-a775-c67ef29d2291 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:53.363028 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2dee04-fd23-45e4-a775-c67ef29d2291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:53.363333 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2dee04-fd23-45e4-a775-c67ef29d2291 admin admin] PATH_INFO: `/v3/users/c1069f77d85c43cd8dfb2c9413d7d98f` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:53.364564 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2dee04-fd23-45e4-a775-c67ef29d2291 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1069f77d85c43cd8dfb2c9413d7d98f)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:53.365809 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c2dc4-dcd2-47dc-8228-8d5fd33a599b None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:53.366517 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2dee04-fd23-45e4-a775-c67ef29d2291 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:53.370525 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d9b1f-7662-4748-994c-43c52ea46948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:53.371811 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d9b1f-7662-4748-994c-43c52ea46948 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:53.372127 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d9b1f-7662-4748-994c-43c52ea46948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:53.372421 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d9b1f-7662-4748-994c-43c52ea46948 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:53.373484 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1d9b1f-7662-4748-994c-43c52ea46948 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:57:53.373484 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1d9b1f-7662-4748-994c-43c52ea46948 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:53.375010 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1d9b1f-7662-4748-994c-43c52ea46948 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:53.386554 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1337/2672] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:57:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:57:53.390905 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:53.391157 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d9b1f-7662-4748-994c-43c52ea46948 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:53.402063 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d9b1f-7662-4748-994c-43c52ea46948 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:53.407037 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41133e8b-4873-485b-ac92-6b82dcb091b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:53.407675 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41133e8b-4873-485b-ac92-6b82dcb091b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:53.407990 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41133e8b-4873-485b-ac92-6b82dcb091b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:53.408270 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41133e8b-4873-485b-ac92-6b82dcb091b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:53.408954 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41133e8b-4873-485b-ac92-6b82dcb091b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:53.410867 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41133e8b-4873-485b-ac92-6b82dcb091b9 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:53.419072 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-fb2dee04-fd23-45e4-a775-c67ef29d2291 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1069f77d85c43cd8dfb2c9413d7d98f'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:53.419744 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-fb2dee04-fd23-45e4-a775-c67ef29d2291 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1069f77d85c43cd8dfb2c9413d7d98f'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:53.428275 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-fb2dee04-fd23-45e4-a775-c67ef29d2291 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1069f77d85c43cd8dfb2c9413d7d98f'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:53.438540 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1338/2673] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:57:53 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:57:53.442564 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41133e8b-4873-485b-ac92-6b82dcb091b9 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:53.444467 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-fb2dee04-fd23-45e4-a775-c67ef29d2291 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1069f77d85c43cd8dfb2c9413d7d98f'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:53.444616 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-41133e8b-4873-485b-ac92-6b82dcb091b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:53.445332 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-fb2dee04-fd23-45e4-a775-c67ef29d2291 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1069f77d85c43cd8dfb2c9413d7d98f'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:53.461431 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1336/2674] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:57:53 2022] DELETE /identity/v3/users/c1069f77d85c43cd8dfb2c9413d7d98f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:57:53.515246 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41133e8b-4873-485b-ac92-6b82dcb091b9 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:53.556556 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:53.573499 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3bf179-752c-4e3e-96c0-ae33e5a26b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:53.574705 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3bf179-752c-4e3e-96c0-ae33e5a26b08 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:53.574989 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3bf179-752c-4e3e-96c0-ae33e5a26b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:53.575265 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3bf179-752c-4e3e-96c0-ae33e5a26b08 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:53.576012 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3bf179-752c-4e3e-96c0-ae33e5a26b08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:53.578083 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3bf179-752c-4e3e-96c0-ae33e5a26b08 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:53.606005 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1339/2675] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:57:53 2022] POST /identity/v3/users => generated 294 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 20:57:53.610109 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2dee04-fd23-45e4-a775-c67ef29d2291 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:53.620321 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2dee04-fd23-45e4-a775-c67ef29d2291 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:53.625188 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536605d6-394a-46e8-8a4f-589a4ce4f736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:53.625862 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536605d6-394a-46e8-8a4f-589a4ce4f736 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:53.626146 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536605d6-394a-46e8-8a4f-589a4ce4f736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:53.626425 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536605d6-394a-46e8-8a4f-589a4ce4f736 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:53.627156 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536605d6-394a-46e8-8a4f-589a4ce4f736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:53.628776 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536605d6-394a-46e8-8a4f-589a4ce4f736 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:53.642387 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1337/2676] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:57:53.642520 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3bf179-752c-4e3e-96c0-ae33e5a26b08 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:53.643604 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ae3bf179-752c-4e3e-96c0-ae33e5a26b08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:53.644138 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536605d6-394a-46e8-8a4f-589a4ce4f736 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:53.657830 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3bf179-752c-4e3e-96c0-ae33e5a26b08 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:53.659901 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536605d6-394a-46e8-8a4f-589a4ce4f736 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:53.662857 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da15c0e6-fc83-4f05-8aec-8baa1ff5ef83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:53.663817 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15c0e6-fc83-4f05-8aec-8baa1ff5ef83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:53.664209 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15c0e6-fc83-4f05-8aec-8baa1ff5ef83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:53.664572 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15c0e6-fc83-4f05-8aec-8baa1ff5ef83 admin admin] PATH_INFO: `/v3/projects/68c26c5a4610479bbed75a3f7d57a8d3` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:53.664945 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab2b233-09b7-4944-a518-92225854303a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:53.665623 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2b233-09b7-4944-a518-92225854303a admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:53.665891 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2b233-09b7-4944-a518-92225854303a admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:53.665998 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da15c0e6-fc83-4f05-8aec-8baa1ff5ef83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68c26c5a4610479bbed75a3f7d57a8d3)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:53.666166 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2b233-09b7-4944-a518-92225854303a admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:53.666912 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab2b233-09b7-4944-a518-92225854303a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:53.668165 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da15c0e6-fc83-4f05-8aec-8baa1ff5ef83 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:53.668662 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab2b233-09b7-4944-a518-92225854303a admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:53.680133 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1338/2677] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 20:57:53.684179 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab2b233-09b7-4944-a518-92225854303a admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:53.693646 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab2b233-09b7-4944-a518-92225854303a admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:53.698588 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65ddead-e8ae-42b1-a033-867b0dcb68b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:53.700121 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ddead-e8ae-42b1-a033-867b0dcb68b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:53.700431 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ddead-e8ae-42b1-a033-867b0dcb68b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:53.700712 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ddead-e8ae-42b1-a033-867b0dcb68b9 admin admin] PATH_INFO: `/v3/projects/3c6d12e76d7b47d78b39622d8dd58496/users/8c179d9a6ca744efb66db0bd4b810977/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:53.716463 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65ddead-e8ae-42b1-a033-867b0dcb68b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c6d12e76d7b47d78b39622d8dd58496, user_id=8c179d9a6ca744efb66db0bd4b810977, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:53.719226 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-da15c0e6-fc83-4f05-8aec-8baa1ff5ef83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68c26c5a4610479bbed75a3f7d57a8d3', 'request_id': 'req-da15c0e6-fc83-4f05-8aec-8baa1ff5ef83'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:53.719485 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65ddead-e8ae-42b1-a033-867b0dcb68b9 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:53.729967 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-da15c0e6-fc83-4f05-8aec-8baa1ff5ef83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68c26c5a4610479bbed75a3f7d57a8d3', 'request_id': 'req-da15c0e6-fc83-4f05-8aec-8baa1ff5ef83'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:53.736325 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-da15c0e6-fc83-4f05-8aec-8baa1ff5ef83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68c26c5a4610479bbed75a3f7d57a8d3', 'request_id': 'req-da15c0e6-fc83-4f05-8aec-8baa1ff5ef83'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:53.739709 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1339/2678] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:57:53 2022] PUT /identity/v3/projects/3c6d12e76d7b47d78b39622d8dd58496/users/8c179d9a6ca744efb66db0bd4b810977/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:57:53.747998 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-da15c0e6-fc83-4f05-8aec-8baa1ff5ef83 admin admin] The token cache is being invalidate because project 68c26c5a4610479bbed75a3f7d57a8d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:57:53.748309 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-da15c0e6-fc83-4f05-8aec-8baa1ff5ef83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:53.748969 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-da15c0e6-fc83-4f05-8aec-8baa1ff5ef83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:53.750574 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1340/2679] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:57:53 2022] DELETE /identity/v3/projects/68c26c5a4610479bbed75a3f7d57a8d3 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:57:53.752068 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41408e-b2bc-44bb-a9f9-441567211cda None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:53.752391 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41408e-b2bc-44bb-a9f9-441567211cda None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:53.752696 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41408e-b2bc-44bb-a9f9-441567211cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:53.758098 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428182ab-a658-44e9-ba16-6acb5dfb285b None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:53.758388 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428182ab-a658-44e9-ba16-6acb5dfb285b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:53.758672 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428182ab-a658-44e9-ba16-6acb5dfb285b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:53.776416 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-428182ab-a658-44e9-ba16-6acb5dfb285b None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:53.778199 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-428182ab-a658-44e9-ba16-6acb5dfb285b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:53.782649 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-8d41408e-b2bc-44bb-a9f9-441567211cda None None] MFA Rules not processed for user `8c179d9a6ca744efb66db0bd4b810977`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:53.783815 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-8d41408e-b2bc-44bb-a9f9-441567211cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:53.848312 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1341/2680] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 20:57:53.849896 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9577ee-4163-41b2-af79-2650eb705f5f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:53.850188 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9577ee-4163-41b2-af79-2650eb705f5f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:53.850638 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9577ee-4163-41b2-af79-2650eb705f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:53.866927 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1340/2681] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 20:57:53.867168 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d41408e-b2bc-44bb-a9f9-441567211cda None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:53.869258 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-8d41408e-b2bc-44bb-a9f9-441567211cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:53.879119 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-1a9577ee-4163-41b2-af79-2650eb705f5f None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:53.880617 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1a9577ee-4163-41b2-af79-2650eb705f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:53.887094 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d41408e-b2bc-44bb-a9f9-441567211cda None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:53.893275 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1342/2682] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 20:57:53.894475 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9577ee-4163-41b2-af79-2650eb705f5f None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:53.894829 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81007856-e257-4d69-8c09-e9109462875f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:53.895779 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81007856-e257-4d69-8c09-e9109462875f admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:53.896100 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81007856-e257-4d69-8c09-e9109462875f admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:53.896383 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81007856-e257-4d69-8c09-e9109462875f admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:53.897073 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81007856-e257-4d69-8c09-e9109462875f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:53.898962 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81007856-e257-4d69-8c09-e9109462875f admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:53.904220 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9577ee-4163-41b2-af79-2650eb705f5f None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:53.908803 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00d790-b1ba-4e6a-a2e6-6416a3398cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:53.909451 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00d790-b1ba-4e6a-a2e6-6416a3398cc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:53.909738 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00d790-b1ba-4e6a-a2e6-6416a3398cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:53.910014 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00d790-b1ba-4e6a-a2e6-6416a3398cc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:53.910743 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f00d790-b1ba-4e6a-a2e6-6416a3398cc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:57:53.911050 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f00d790-b1ba-4e6a-a2e6-6416a3398cc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:53.912671 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f00d790-b1ba-4e6a-a2e6-6416a3398cc4 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:53.933226 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1341/2683] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:57:53 2022] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 20:57:53.933413 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1343/2684] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:57:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:57:53.934347 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81007856-e257-4d69-8c09-e9109462875f admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:53.934785 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00d790-b1ba-4e6a-a2e6-6416a3398cc4 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:53.944770 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00d790-b1ba-4e6a-a2e6-6416a3398cc4 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:53.955039 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:53.978993 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:54.001007 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81007856-e257-4d69-8c09-e9109462875f admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:54.005190 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f1135-98bd-4ddc-8da4-6a1068cce605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:54.005815 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f513b4f-f356-41f1-979e-aa6e8a2a64c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:54.005961 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f1135-98bd-4ddc-8da4-6a1068cce605 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:54.006133 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f1135-98bd-4ddc-8da4-6a1068cce605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:54.006413 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f1135-98bd-4ddc-8da4-6a1068cce605 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:54.006509 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f513b4f-f356-41f1-979e-aa6e8a2a64c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:54.006742 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f513b4f-f356-41f1-979e-aa6e8a2a64c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:54.007019 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f513b4f-f356-41f1-979e-aa6e8a2a64c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:54.007107 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f1135-98bd-4ddc-8da4-6a1068cce605 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:54.007708 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f513b4f-f356-41f1-979e-aa6e8a2a64c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:54.009038 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f1135-98bd-4ddc-8da4-6a1068cce605 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:54.009682 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f513b4f-f356-41f1-979e-aa6e8a2a64c2 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:54.031753 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1344/2685] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:57:53 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 20:57:54.035739 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f1135-98bd-4ddc-8da4-6a1068cce605 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:54.039715 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1342/2686] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:57:53 2022] POST /identity/v3/projects => generated 379 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 20:57:54.043518 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f513b4f-f356-41f1-979e-aa6e8a2a64c2 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:54.048298 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f1135-98bd-4ddc-8da4-6a1068cce605 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:54.106221 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f513b4f-f356-41f1-979e-aa6e8a2a64c2 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:54.107972 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82abc471-19ed-463e-9243-ddfa18f2b281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:54.108617 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82abc471-19ed-463e-9243-ddfa18f2b281 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:54.108907 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82abc471-19ed-463e-9243-ddfa18f2b281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:54.109794 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82abc471-19ed-463e-9243-ddfa18f2b281 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:54.110558 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82abc471-19ed-463e-9243-ddfa18f2b281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:54.111021 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800acc95-fc80-4380-8566-0dbfd5a80173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:54.111697 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800acc95-fc80-4380-8566-0dbfd5a80173 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:54.112021 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800acc95-fc80-4380-8566-0dbfd5a80173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:54.112303 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800acc95-fc80-4380-8566-0dbfd5a80173 admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:54.112400 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82abc471-19ed-463e-9243-ddfa18f2b281 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:54.113005 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800acc95-fc80-4380-8566-0dbfd5a80173 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:54.114908 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800acc95-fc80-4380-8566-0dbfd5a80173 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:54.123675 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1345/2687] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:57:54 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 20:57:54.127665 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82abc471-19ed-463e-9243-ddfa18f2b281 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:54.139327 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82abc471-19ed-463e-9243-ddfa18f2b281 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:54.145004 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1343/2688] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:57:54 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 20:57:54.145126 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d1ad87-d3ad-48c2-98fd-101c11761575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:54.145258 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1ad87-d3ad-48c2-98fd-101c11761575 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:54.145520 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1ad87-d3ad-48c2-98fd-101c11761575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:54.145793 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1ad87-d3ad-48c2-98fd-101c11761575 admin admin] PATH_INFO: `/v3/projects/5bb90aaaf6514346852135f4b99179e0/users/9fbfebce17834dd68213d8848f617fd6/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:54.145884 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800acc95-fc80-4380-8566-0dbfd5a80173 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:54.157021 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800acc95-fc80-4380-8566-0dbfd5a80173 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:54.161358 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d1ad87-d3ad-48c2-98fd-101c11761575 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bb90aaaf6514346852135f4b99179e0, user_id=9fbfebce17834dd68213d8848f617fd6, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:54.161911 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25351da8-dfcc-4480-86fa-dcbfa71aa9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:54.162600 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25351da8-dfcc-4480-86fa-dcbfa71aa9c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:54.162891 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25351da8-dfcc-4480-86fa-dcbfa71aa9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:54.163174 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25351da8-dfcc-4480-86fa-dcbfa71aa9c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:54.163907 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25351da8-dfcc-4480-86fa-dcbfa71aa9c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:54.164018 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d1ad87-d3ad-48c2-98fd-101c11761575 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:54.165533 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25351da8-dfcc-4480-86fa-dcbfa71aa9c7 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:54.179634 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1344/2689] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:57:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 20:57:54.180667 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1346/2690] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:57:54 2022] PUT /identity/v3/projects/5bb90aaaf6514346852135f4b99179e0/users/9fbfebce17834dd68213d8848f617fd6/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:57:54.180799 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25351da8-dfcc-4480-86fa-dcbfa71aa9c7 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:54.184715 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d1ad87-d3ad-48c2-98fd-101c11761575 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:54.191194 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25351da8-dfcc-4480-86fa-dcbfa71aa9c7 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:54.245437 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d1ad87-d3ad-48c2-98fd-101c11761575 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:54.248034 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e93d0-096c-4f3f-9237-0d0166532fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:54.248758 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e93d0-096c-4f3f-9237-0d0166532fdb admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:54.249049 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e93d0-096c-4f3f-9237-0d0166532fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:54.249334 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e93d0-096c-4f3f-9237-0d0166532fdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:54.250082 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e93d0-096c-4f3f-9237-0d0166532fdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:54.250917 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d2bf8d-b617-4394-89fa-68d0ed8d93a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:54.251573 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2bf8d-b617-4394-89fa-68d0ed8d93a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:54.251731 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e93d0-096c-4f3f-9237-0d0166532fdb admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:54.251855 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2bf8d-b617-4394-89fa-68d0ed8d93a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:54.252160 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2bf8d-b617-4394-89fa-68d0ed8d93a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:54.252879 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d2bf8d-b617-4394-89fa-68d0ed8d93a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:54.254444 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d2bf8d-b617-4394-89fa-68d0ed8d93a0 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:54.262226 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1345/2691] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:57:54 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:57:54.265510 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1347/2692] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:57:54 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 20:57:54.266525 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e93d0-096c-4f3f-9237-0d0166532fdb admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:54.269065 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d2bf8d-b617-4394-89fa-68d0ed8d93a0 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:54.276450 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e93d0-096c-4f3f-9237-0d0166532fdb admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:54.278429 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d2bf8d-b617-4394-89fa-68d0ed8d93a0 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:54.282873 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f84cf-39eb-4dff-bc71-00dc1aaaad2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:54.283019 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46972cbd-3a47-4e9c-b533-08b440874e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:54.283750 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f84cf-39eb-4dff-bc71-00dc1aaaad2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:54.283845 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46972cbd-3a47-4e9c-b533-08b440874e3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:54.284105 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46972cbd-3a47-4e9c-b533-08b440874e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:54.284196 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f84cf-39eb-4dff-bc71-00dc1aaaad2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:54.284386 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46972cbd-3a47-4e9c-b533-08b440874e3f admin admin] PATH_INFO: `/v3/projects/5bb90aaaf6514346852135f4b99179e0/users/9fbfebce17834dd68213d8848f617fd6/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:54.284478 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f84cf-39eb-4dff-bc71-00dc1aaaad2c admin admin] PATH_INFO: `/v3/projects/657e2b67c445440d9300a9b1633f1038/users/8846803a5b8a4f5ab5a33feeddfc5138/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:54.286380 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46972cbd-3a47-4e9c-b533-08b440874e3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bb90aaaf6514346852135f4b99179e0, user_id=9fbfebce17834dd68213d8848f617fd6, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:54.289029 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46972cbd-3a47-4e9c-b533-08b440874e3f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:54.299064 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28f84cf-39eb-4dff-bc71-00dc1aaaad2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=657e2b67c445440d9300a9b1633f1038, user_id=8846803a5b8a4f5ab5a33feeddfc5138, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:54.299342 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1348/2693] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:57:54 2022] PUT /identity/v3/projects/5bb90aaaf6514346852135f4b99179e0/users/9fbfebce17834dd68213d8848f617fd6/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:57:54.302088 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28f84cf-39eb-4dff-bc71-00dc1aaaad2c admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:54.304298 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:54.310412 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396091d1-1296-4a5e-b47b-2889d73a2d86 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:54.310791 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396091d1-1296-4a5e-b47b-2889d73a2d86 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:54.311076 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396091d1-1296-4a5e-b47b-2889d73a2d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:54.324875 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1346/2694] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:57:54 2022] PUT /identity/v3/projects/657e2b67c445440d9300a9b1633f1038/users/8846803a5b8a4f5ab5a33feeddfc5138/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:57:54.329696 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488fd88c-fdf2-4ec5-be1d-229307fa5ad6 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:54.329993 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488fd88c-fdf2-4ec5-be1d-229307fa5ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:54.330285 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488fd88c-fdf2-4ec5-be1d-229307fa5ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:54.337726 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-396091d1-1296-4a5e-b47b-2889d73a2d86 None None] MFA Rules not processed for user `9fbfebce17834dd68213d8848f617fd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:54.338926 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-396091d1-1296-4a5e-b47b-2889d73a2d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:54.346677 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-488fd88c-fdf2-4ec5-be1d-229307fa5ad6 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:54.346954 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:54.347837 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-488fd88c-fdf2-4ec5-be1d-229307fa5ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:54.410971 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1347/2695] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 20:57:54.411655 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1349/2696] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:54 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 20:57:54.417468 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488fd88c-fdf2-4ec5-be1d-229307fa5ad6 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:54.418926 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-488fd88c-fdf2-4ec5-be1d-229307fa5ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:54.421541 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396091d1-1296-4a5e-b47b-2889d73a2d86 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:54.422908 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-396091d1-1296-4a5e-b47b-2889d73a2d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:54.482991 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488fd88c-fdf2-4ec5-be1d-229307fa5ad6 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:54.486950 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6765958-04b7-439e-b3cf-0f6731c224d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:54.487118 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396091d1-1296-4a5e-b47b-2889d73a2d86 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:54.487604 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6765958-04b7-439e-b3cf-0f6731c224d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:54.487894 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6765958-04b7-439e-b3cf-0f6731c224d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:54.488206 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6765958-04b7-439e-b3cf-0f6731c224d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:54.490788 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9425e6b-02ad-458b-a578-f20d12be9707 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:54.491437 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9425e6b-02ad-458b-a578-f20d12be9707 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:54.491752 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9425e6b-02ad-458b-a578-f20d12be9707 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:54.492074 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9425e6b-02ad-458b-a578-f20d12be9707 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:54.497975 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6765958-04b7-439e-b3cf-0f6731c224d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:54.499403 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6765958-04b7-439e-b3cf-0f6731c224d6 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:54.501859 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9425e6b-02ad-458b-a578-f20d12be9707 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:54.503283 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9425e6b-02ad-458b-a578-f20d12be9707 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:54.509016 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1348/2697] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:57:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:57:54.513631 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1350/2698] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:57:54 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 20:57:54.582937 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6765958-04b7-439e-b3cf-0f6731c224d6 service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:54.593790 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6765958-04b7-439e-b3cf-0f6731c224d6 service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:54.598452 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c04897-ede7-43a3-b604-715cc44fb118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:54.599329 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c04897-ede7-43a3-b604-715cc44fb118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:54.599642 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c04897-ede7-43a3-b604-715cc44fb118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:54.599905 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c04897-ede7-43a3-b604-715cc44fb118 admin admin] PATH_INFO: `/v3/users/8c179d9a6ca744efb66db0bd4b810977` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:54.601142 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c04897-ede7-43a3-b604-715cc44fb118 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c179d9a6ca744efb66db0bd4b810977)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:54.603064 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c04897-ede7-43a3-b604-715cc44fb118 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:54.654758 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-75c04897-ede7-43a3-b604-715cc44fb118 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c179d9a6ca744efb66db0bd4b810977'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:54.655524 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-75c04897-ede7-43a3-b604-715cc44fb118 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c179d9a6ca744efb66db0bd4b810977'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:54.663749 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-75c04897-ede7-43a3-b604-715cc44fb118 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c179d9a6ca744efb66db0bd4b810977'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:54.678995 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-75c04897-ede7-43a3-b604-715cc44fb118 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c179d9a6ca744efb66db0bd4b810977'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:54.680269 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-75c04897-ede7-43a3-b604-715cc44fb118 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c179d9a6ca744efb66db0bd4b810977'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:54.694106 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1349/2699] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:57:54 2022] DELETE /identity/v3/users/8c179d9a6ca744efb66db0bd4b810977 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:57:54.698684 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85720751-e708-4631-9e38-c19aead0a3a9 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:54.699576 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85720751-e708-4631-9e38-c19aead0a3a9 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:54.699972 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85720751-e708-4631-9e38-c19aead0a3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:54.719662 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-85720751-e708-4631-9e38-c19aead0a3a9 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:54.720988 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-85720751-e708-4631-9e38-c19aead0a3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:54.786279 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1351/2700] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:57:54.802612 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c04897-ede7-43a3-b604-715cc44fb118 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:54.804776 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-75c04897-ede7-43a3-b604-715cc44fb118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:54.830894 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:54.899246 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c04897-ede7-43a3-b604-715cc44fb118 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:54.905986 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee369d21-aa64-48f3-b3c6-9445fdbbc9cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:54.906420 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee369d21-aa64-48f3-b3c6-9445fdbbc9cd service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:54.906711 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee369d21-aa64-48f3-b3c6-9445fdbbc9cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:54.906994 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee369d21-aa64-48f3-b3c6-9445fdbbc9cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:54.917405 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee369d21-aa64-48f3-b3c6-9445fdbbc9cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:54.919038 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee369d21-aa64-48f3-b3c6-9445fdbbc9cd service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:54.929830 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1350/2701] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:57:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:57:55.357585 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85720751-e708-4631-9e38-c19aead0a3a9 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:55.359172 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-85720751-e708-4631-9e38-c19aead0a3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:55.379993 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85720751-e708-4631-9e38-c19aead0a3a9 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:55.384858 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da3915-8f6c-40d5-9d6c-ec8f504a68ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:55.385719 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da3915-8f6c-40d5-9d6c-ec8f504a68ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:55.386000 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da3915-8f6c-40d5-9d6c-ec8f504a68ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:55.386352 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da3915-8f6c-40d5-9d6c-ec8f504a68ed admin admin] PATH_INFO: `/v3/projects/3c6d12e76d7b47d78b39622d8dd58496` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:55.387507 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73da3915-8f6c-40d5-9d6c-ec8f504a68ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c6d12e76d7b47d78b39622d8dd58496)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:55.392446 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73da3915-8f6c-40d5-9d6c-ec8f504a68ed admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:55.444768 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:55.448971 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-73da3915-8f6c-40d5-9d6c-ec8f504a68ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c6d12e76d7b47d78b39622d8dd58496', 'request_id': 'req-73da3915-8f6c-40d5-9d6c-ec8f504a68ed'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:55.460353 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-73da3915-8f6c-40d5-9d6c-ec8f504a68ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c6d12e76d7b47d78b39622d8dd58496', 'request_id': 'req-73da3915-8f6c-40d5-9d6c-ec8f504a68ed'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:55.468357 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-73da3915-8f6c-40d5-9d6c-ec8f504a68ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c6d12e76d7b47d78b39622d8dd58496', 'request_id': 'req-73da3915-8f6c-40d5-9d6c-ec8f504a68ed'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:55.482332 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-73da3915-8f6c-40d5-9d6c-ec8f504a68ed admin admin] The token cache is being invalidate because project 3c6d12e76d7b47d78b39622d8dd58496 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:57:55.482716 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-73da3915-8f6c-40d5-9d6c-ec8f504a68ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:55.483437 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-73da3915-8f6c-40d5-9d6c-ec8f504a68ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:55.485305 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1352/2702] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:57:55 2022] DELETE /identity/v3/projects/3c6d12e76d7b47d78b39622d8dd58496 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:57:55.489200 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee369d21-aa64-48f3-b3c6-9445fdbbc9cd service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:55.501255 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee369d21-aa64-48f3-b3c6-9445fdbbc9cd service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:55.573396 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e5593-80f5-45f8-aff5-ed1e4b183be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:55.574336 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e5593-80f5-45f8-aff5-ed1e4b183be5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:55.574624 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e5593-80f5-45f8-aff5-ed1e4b183be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:55.574902 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e5593-80f5-45f8-aff5-ed1e4b183be5 admin admin] PATH_INFO: `/v3/users/9fbfebce17834dd68213d8848f617fd6` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:55.576150 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65e5593-80f5-45f8-aff5-ed1e4b183be5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fbfebce17834dd68213d8848f617fd6)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:55.578267 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65e5593-80f5-45f8-aff5-ed1e4b183be5 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:55.637030 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-c65e5593-80f5-45f8-aff5-ed1e4b183be5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fbfebce17834dd68213d8848f617fd6'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:55.637734 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-c65e5593-80f5-45f8-aff5-ed1e4b183be5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fbfebce17834dd68213d8848f617fd6'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:55.646298 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-c65e5593-80f5-45f8-aff5-ed1e4b183be5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fbfebce17834dd68213d8848f617fd6'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:55.661218 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-c65e5593-80f5-45f8-aff5-ed1e4b183be5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fbfebce17834dd68213d8848f617fd6'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:55.661943 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-c65e5593-80f5-45f8-aff5-ed1e4b183be5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fbfebce17834dd68213d8848f617fd6'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:55.678576 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1351/2703] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:57:55 2022] DELETE /identity/v3/users/9fbfebce17834dd68213d8848f617fd6 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:57:56.294363 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da3915-8f6c-40d5-9d6c-ec8f504a68ed admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:56.295853 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-73da3915-8f6c-40d5-9d6c-ec8f504a68ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:56.325560 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da3915-8f6c-40d5-9d6c-ec8f504a68ed admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:56.390398 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6ffb6-aba1-4a06-9597-045ec60285a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:56.392082 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6ffb6-aba1-4a06-9597-045ec60285a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:56.392377 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6ffb6-aba1-4a06-9597-045ec60285a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:56.392712 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6ffb6-aba1-4a06-9597-045ec60285a4 admin admin] PATH_INFO: `/v3/projects/5bb90aaaf6514346852135f4b99179e0` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:56.393978 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d6ffb6-aba1-4a06-9597-045ec60285a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bb90aaaf6514346852135f4b99179e0)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:56.396479 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d6ffb6-aba1-4a06-9597-045ec60285a4 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:56.444307 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-59d6ffb6-aba1-4a06-9597-045ec60285a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bb90aaaf6514346852135f4b99179e0', 'request_id': 'req-59d6ffb6-aba1-4a06-9597-045ec60285a4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:56.453399 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-59d6ffb6-aba1-4a06-9597-045ec60285a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bb90aaaf6514346852135f4b99179e0', 'request_id': 'req-59d6ffb6-aba1-4a06-9597-045ec60285a4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:56.459378 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-59d6ffb6-aba1-4a06-9597-045ec60285a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bb90aaaf6514346852135f4b99179e0', 'request_id': 'req-59d6ffb6-aba1-4a06-9597-045ec60285a4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:56.471419 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-59d6ffb6-aba1-4a06-9597-045ec60285a4 admin admin] The token cache is being invalidate because project 5bb90aaaf6514346852135f4b99179e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:57:56.471712 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-59d6ffb6-aba1-4a06-9597-045ec60285a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:56.472387 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-59d6ffb6-aba1-4a06-9597-045ec60285a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:57:56.473923 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1353/2704] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:57:56 2022] DELETE /identity/v3/projects/5bb90aaaf6514346852135f4b99179e0 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:57:56.478830 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b80234-a9a4-480e-b743-737ef314b55f None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:56.479181 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b80234-a9a4-480e-b743-737ef314b55f None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:56.479549 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b80234-a9a4-480e-b743-737ef314b55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:56.497629 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-f8b80234-a9a4-480e-b743-737ef314b55f None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:56.498839 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-f8b80234-a9a4-480e-b743-737ef314b55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:56.526079 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:56.580399 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1352/2705] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:57:56.588075 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da76b7b-1280-489c-b45f-b6eca10dc3a5 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:56.588368 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da76b7b-1280-489c-b45f-b6eca10dc3a5 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:56.588651 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da76b7b-1280-489c-b45f-b6eca10dc3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:56.608402 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-8da76b7b-1280-489c-b45f-b6eca10dc3a5 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:56.609484 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8da76b7b-1280-489c-b45f-b6eca10dc3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:56.619657 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1354/2706] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:57:56.624234 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b80234-a9a4-480e-b743-737ef314b55f None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:56.634487 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b80234-a9a4-480e-b743-737ef314b55f None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:56.640028 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d2203-d779-44af-b8a2-cd76d4b52c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:56.640713 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d2203-d779-44af-b8a2-cd76d4b52c50 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:56.640999 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d2203-d779-44af-b8a2-cd76d4b52c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:56.641277 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d2203-d779-44af-b8a2-cd76d4b52c50 admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:56.642156 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d2203-d779-44af-b8a2-cd76d4b52c50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:57:56.642877 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d2203-d779-44af-b8a2-cd76d4b52c50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:56.644092 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d2203-d779-44af-b8a2-cd76d4b52c50 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:56.657649 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1353/2707] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:57:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:57:56.662172 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da76b7b-1280-489c-b45f-b6eca10dc3a5 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:56.675113 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da76b7b-1280-489c-b45f-b6eca10dc3a5 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:56.680637 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b40c46-5a0e-4f99-b1ce-05ba3052cc8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:56.681375 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b40c46-5a0e-4f99-b1ce-05ba3052cc8e admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:56.681669 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b40c46-5a0e-4f99-b1ce-05ba3052cc8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:56.682246 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b40c46-5a0e-4f99-b1ce-05ba3052cc8e admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:56.682982 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b40c46-5a0e-4f99-b1ce-05ba3052cc8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:56.685796 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b40c46-5a0e-4f99-b1ce-05ba3052cc8e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:56.718025 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1355/2708] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:57:56 2022] POST /identity/v3/projects => generated 387 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 20:57:56.722038 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d2203-d779-44af-b8a2-cd76d4b52c50 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:56.733301 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d2203-d779-44af-b8a2-cd76d4b52c50 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:56.810325 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01599066-1c3f-45ef-8bc7-cfe8500b51c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:56.811014 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01599066-1c3f-45ef-8bc7-cfe8500b51c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:56.811303 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01599066-1c3f-45ef-8bc7-cfe8500b51c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:56.811586 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01599066-1c3f-45ef-8bc7-cfe8500b51c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:56.812334 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01599066-1c3f-45ef-8bc7-cfe8500b51c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:56.814305 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01599066-1c3f-45ef-8bc7-cfe8500b51c9 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:56.838288 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1354/2709] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:57:56 2022] POST /identity/v3/users => generated 294 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:57:56.846470 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b40c46-5a0e-4f99-b1ce-05ba3052cc8e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:56.866634 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b40c46-5a0e-4f99-b1ce-05ba3052cc8e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:56.873572 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d4ba7-6eed-488b-b46c-d55889c74d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:56.874296 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d4ba7-6eed-488b-b46c-d55889c74d0e admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:56.874699 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d4ba7-6eed-488b-b46c-d55889c74d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:56.874955 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d4ba7-6eed-488b-b46c-d55889c74d0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:56.875908 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9d4ba7-6eed-488b-b46c-d55889c74d0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:56.877665 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9d4ba7-6eed-488b-b46c-d55889c74d0e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:56.889936 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1356/2710] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:57:56.894007 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01599066-1c3f-45ef-8bc7-cfe8500b51c9 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:56.905255 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01599066-1c3f-45ef-8bc7-cfe8500b51c9 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:56.910138 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f3a2a7-38e0-4267-93e4-2e9d3df6772a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:56.910825 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3a2a7-38e0-4267-93e4-2e9d3df6772a admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:56.911099 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3a2a7-38e0-4267-93e4-2e9d3df6772a admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:56.911380 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3a2a7-38e0-4267-93e4-2e9d3df6772a admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:56.912149 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f3a2a7-38e0-4267-93e4-2e9d3df6772a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:56.913741 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f3a2a7-38e0-4267-93e4-2e9d3df6772a admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:56.926116 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1355/2711] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 20:57:56.930570 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d4ba7-6eed-488b-b46c-d55889c74d0e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:56.944529 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d4ba7-6eed-488b-b46c-d55889c74d0e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:56.950312 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5960d2a-8d4d-4731-8291-205606b3bd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:56.951237 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5960d2a-8d4d-4731-8291-205606b3bd1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:56.951528 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5960d2a-8d4d-4731-8291-205606b3bd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:56.951811 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5960d2a-8d4d-4731-8291-205606b3bd1e admin admin] PATH_INFO: `/v3/projects/f324ece5d6294375b22b894aa83aed10/users/4008d806047b4e709977e7df122449cb/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:56.970816 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5960d2a-8d4d-4731-8291-205606b3bd1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f324ece5d6294375b22b894aa83aed10, user_id=4008d806047b4e709977e7df122449cb, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:56.973882 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5960d2a-8d4d-4731-8291-205606b3bd1e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:56.982828 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:56.990580 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1357/2712] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:57:56 2022] PUT /identity/v3/projects/f324ece5d6294375b22b894aa83aed10/users/4008d806047b4e709977e7df122449cb/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:57:57.001784 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107dd08-2f4c-4dc4-9b01-e808ea98dada None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:57.002462 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107dd08-2f4c-4dc4-9b01-e808ea98dada None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:57.002941 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107dd08-2f4c-4dc4-9b01-e808ea98dada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:57.050134 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-7107dd08-2f4c-4dc4-9b01-e808ea98dada None None] MFA Rules not processed for user `4008d806047b4e709977e7df122449cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:57.052356 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-7107dd08-2f4c-4dc4-9b01-e808ea98dada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:57.196007 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1356/2713] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 20:57:57.200467 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5960d2a-8d4d-4731-8291-205606b3bd1e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:57.303354 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5960d2a-8d4d-4731-8291-205606b3bd1e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:57.320403 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b012a-5c44-41c9-b4fc-4767ae4d01eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:57.321158 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b012a-5c44-41c9-b4fc-4767ae4d01eb admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:57.321475 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b012a-5c44-41c9-b4fc-4767ae4d01eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:57.321779 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b012a-5c44-41c9-b4fc-4767ae4d01eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:57.322780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b012a-5c44-41c9-b4fc-4767ae4d01eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:57.326122 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b012a-5c44-41c9-b4fc-4767ae4d01eb admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:57.368921 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1358/2714] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:57:57 2022] POST /identity/v3/projects => generated 387 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:57:57.373667 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7107dd08-2f4c-4dc4-9b01-e808ea98dada None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:57.385677 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7107dd08-2f4c-4dc4-9b01-e808ea98dada None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:57.422372 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:57.475302 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05218433-bd29-4e30-ae96-569f9c5a19dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:57.476028 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05218433-bd29-4e30-ae96-569f9c5a19dd admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:57.476323 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05218433-bd29-4e30-ae96-569f9c5a19dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:57.476607 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05218433-bd29-4e30-ae96-569f9c5a19dd admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:57.477344 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05218433-bd29-4e30-ae96-569f9c5a19dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:57.479428 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05218433-bd29-4e30-ae96-569f9c5a19dd admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:57.505058 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1357/2715] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:57:57 2022] POST /identity/v3/users => generated 294 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:57:57.508999 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b012a-5c44-41c9-b4fc-4767ae4d01eb admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:57.519675 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b012a-5c44-41c9-b4fc-4767ae4d01eb admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:57.525333 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1923d486-60da-4075-8845-77cb3af2f2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:57.526111 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1923d486-60da-4075-8845-77cb3af2f2c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:57.526475 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1923d486-60da-4075-8845-77cb3af2f2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:57.526868 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1923d486-60da-4075-8845-77cb3af2f2c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:57.527673 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1923d486-60da-4075-8845-77cb3af2f2c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:57.529393 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1923d486-60da-4075-8845-77cb3af2f2c3 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:57.541567 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1359/2716] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:57:57.546463 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05218433-bd29-4e30-ae96-569f9c5a19dd admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:57.559147 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05218433-bd29-4e30-ae96-569f9c5a19dd admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:57.565470 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5bd0e0-bd4a-4770-a66c-7a61accaa6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:57.566729 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5bd0e0-bd4a-4770-a66c-7a61accaa6a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:57.567102 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5bd0e0-bd4a-4770-a66c-7a61accaa6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:57.567585 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5bd0e0-bd4a-4770-a66c-7a61accaa6a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:57.573446 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5bd0e0-bd4a-4770-a66c-7a61accaa6a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:57.576196 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5bd0e0-bd4a-4770-a66c-7a61accaa6a5 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:57.597421 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1923d486-60da-4075-8845-77cb3af2f2c3 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:57.608349 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1358/2717] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 20:57:57.614176 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1923d486-60da-4075-8845-77cb3af2f2c3 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:57.620369 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233d61e-05da-4ce3-b591-4c5c64b6006f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:57.622527 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233d61e-05da-4ce3-b591-4c5c64b6006f admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:57.622896 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233d61e-05da-4ce3-b591-4c5c64b6006f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:57.623311 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233d61e-05da-4ce3-b591-4c5c64b6006f admin admin] PATH_INFO: `/v3/projects/0934457cc60840d7a33ddf1d6ed9c05c/users/a43acedae25847038668808c769abb7c/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:57.644595 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9233d61e-05da-4ce3-b591-4c5c64b6006f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0934457cc60840d7a33ddf1d6ed9c05c, user_id=a43acedae25847038668808c769abb7c, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:57.647384 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9233d61e-05da-4ce3-b591-4c5c64b6006f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:57.662600 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1360/2718] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:57:57 2022] PUT /identity/v3/projects/0934457cc60840d7a33ddf1d6ed9c05c/users/a43acedae25847038668808c769abb7c/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:57:57.676262 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c3d74-15bd-4e1c-94e4-1db98f69d416 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:57.676926 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c3d74-15bd-4e1c-94e4-1db98f69d416 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:57.677282 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c3d74-15bd-4e1c-94e4-1db98f69d416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:57.710187 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-8f3c3d74-15bd-4e1c-94e4-1db98f69d416 None None] MFA Rules not processed for user `a43acedae25847038668808c769abb7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:57.711727 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-8f3c3d74-15bd-4e1c-94e4-1db98f69d416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:57.806433 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1359/2719] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 20:57:57.807703 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233d61e-05da-4ce3-b591-4c5c64b6006f admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:57.903900 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233d61e-05da-4ce3-b591-4c5c64b6006f admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:57.909217 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ce535-ef7e-4761-bf8d-5bddcbe549df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:57.909893 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ce535-ef7e-4761-bf8d-5bddcbe549df admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:57.910180 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ce535-ef7e-4761-bf8d-5bddcbe549df admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:57.910800 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ce535-ef7e-4761-bf8d-5bddcbe549df admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:57.911149 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60ce535-ef7e-4761-bf8d-5bddcbe549df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:57.913216 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60ce535-ef7e-4761-bf8d-5bddcbe549df admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:57.944214 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1361/2720] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:57:57 2022] POST /identity/v3/projects => generated 387 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:57:57.948076 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c3d74-15bd-4e1c-94e4-1db98f69d416 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:57.959682 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c3d74-15bd-4e1c-94e4-1db98f69d416 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:58.024824 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c15edd-ef84-4f42-a3fc-5976981cf26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:58.025516 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c15edd-ef84-4f42-a3fc-5976981cf26a admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:58.025805 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c15edd-ef84-4f42-a3fc-5976981cf26a admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:58.026088 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c15edd-ef84-4f42-a3fc-5976981cf26a admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:58.027061 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c15edd-ef84-4f42-a3fc-5976981cf26a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:58.028909 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c15edd-ef84-4f42-a3fc-5976981cf26a admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:58.054711 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1360/2721] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:57:57 2022] POST /identity/v3/users => generated 300 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:57:58.056170 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ce535-ef7e-4761-bf8d-5bddcbe549df admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:58.067694 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ce535-ef7e-4761-bf8d-5bddcbe549df admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:58.072935 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d3ab7-200d-49ee-a074-6a90fa69d9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:58.073636 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d3ab7-200d-49ee-a074-6a90fa69d9d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:58.074716 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d3ab7-200d-49ee-a074-6a90fa69d9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:58.074824 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d3ab7-200d-49ee-a074-6a90fa69d9d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:58.075504 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01d3ab7-200d-49ee-a074-6a90fa69d9d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:58.077127 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01d3ab7-200d-49ee-a074-6a90fa69d9d7 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:58.089926 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1362/2722] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:57:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 20:57:58.094213 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c15edd-ef84-4f42-a3fc-5976981cf26a admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:58.107358 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c15edd-ef84-4f42-a3fc-5976981cf26a admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:58.112837 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec331bd-aa6c-4e18-906b-6d4dbf5cbec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:58.114727 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec331bd-aa6c-4e18-906b-6d4dbf5cbec5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:58.115204 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec331bd-aa6c-4e18-906b-6d4dbf5cbec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:58.115558 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec331bd-aa6c-4e18-906b-6d4dbf5cbec5 admin admin] PATH_INFO: `/v3/projects/e428f77c2d8347a98cbb18258a45891a/users/cc0b7cfc45344e7fb8e84f19bb2a9ccc/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:58.146338 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec331bd-aa6c-4e18-906b-6d4dbf5cbec5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e428f77c2d8347a98cbb18258a45891a, user_id=cc0b7cfc45344e7fb8e84f19bb2a9ccc, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:58.149201 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec331bd-aa6c-4e18-906b-6d4dbf5cbec5 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:58.161365 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:58.170496 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1361/2723] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:57:58 2022] PUT /identity/v3/projects/e428f77c2d8347a98cbb18258a45891a/users/cc0b7cfc45344e7fb8e84f19bb2a9ccc/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:57:58.175163 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d3ab7-200d-49ee-a074-6a90fa69d9d7 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:58.190074 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d3ab7-200d-49ee-a074-6a90fa69d9d7 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:58.220588 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:58.286809 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17063451-f5ec-4af6-8d19-49ac002b6eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:58.287530 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17063451-f5ec-4af6-8d19-49ac002b6eb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:58.287881 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17063451-f5ec-4af6-8d19-49ac002b6eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:58.288955 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17063451-f5ec-4af6-8d19-49ac002b6eb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:58.289351 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17063451-f5ec-4af6-8d19-49ac002b6eb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:58.291051 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17063451-f5ec-4af6-8d19-49ac002b6eb5 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:58.303212 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1363/2724] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:57:58 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:57:58.306970 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec331bd-aa6c-4e18-906b-6d4dbf5cbec5 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:58.319952 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec331bd-aa6c-4e18-906b-6d4dbf5cbec5 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:58.327631 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e2b9e-5dfd-4c5f-a24c-84a01f7b54c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:58.328527 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e2b9e-5dfd-4c5f-a24c-84a01f7b54c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:58.328885 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e2b9e-5dfd-4c5f-a24c-84a01f7b54c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:58.329284 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e2b9e-5dfd-4c5f-a24c-84a01f7b54c2 admin admin] PATH_INFO: `/v3/projects/e428f77c2d8347a98cbb18258a45891a/users/cc0b7cfc45344e7fb8e84f19bb2a9ccc/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:58.331575 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e2b9e-5dfd-4c5f-a24c-84a01f7b54c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e428f77c2d8347a98cbb18258a45891a, user_id=cc0b7cfc45344e7fb8e84f19bb2a9ccc, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:58.334496 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e2b9e-5dfd-4c5f-a24c-84a01f7b54c2 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:58.350582 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1362/2725] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:57:58 2022] PUT /identity/v3/projects/e428f77c2d8347a98cbb18258a45891a/users/cc0b7cfc45344e7fb8e84f19bb2a9ccc/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:57:58.361376 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34369ebc-8ff2-43a1-a44d-39d7f62935dc None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:58.361758 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34369ebc-8ff2-43a1-a44d-39d7f62935dc None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:58.362039 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34369ebc-8ff2-43a1-a44d-39d7f62935dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:58.397553 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-34369ebc-8ff2-43a1-a44d-39d7f62935dc None None] MFA Rules not processed for user `cc0b7cfc45344e7fb8e84f19bb2a9ccc`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:58.398892 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-34369ebc-8ff2-43a1-a44d-39d7f62935dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:58.482758 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1364/2726] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:58 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:57:58.494041 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e2b9e-5dfd-4c5f-a24c-84a01f7b54c2 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:58.496181 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-ec7e2b9e-5dfd-4c5f-a24c-84a01f7b54c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:58.562467 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e2b9e-5dfd-4c5f-a24c-84a01f7b54c2 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:58.566655 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e6b338-5dc3-48b1-8746-e29d0530cf8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:58.567415 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6b338-5dc3-48b1-8746-e29d0530cf8d service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:58.567773 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6b338-5dc3-48b1-8746-e29d0530cf8d service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:58.568151 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6b338-5dc3-48b1-8746-e29d0530cf8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:58.580517 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e6b338-5dc3-48b1-8746-e29d0530cf8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:58.581191 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e6b338-5dc3-48b1-8746-e29d0530cf8d service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:58.596571 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1363/2727] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:57:58 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:57:59.048548 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2122b91-3242-4ba9-a9da-0ac1919e55aa None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:59.049004 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2122b91-3242-4ba9-a9da-0ac1919e55aa None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:59.050492 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2122b91-3242-4ba9-a9da-0ac1919e55aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:59.098253 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c2122b91-3242-4ba9-a9da-0ac1919e55aa None None] MFA Rules not processed for user `8846803a5b8a4f5ab5a33feeddfc5138`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:57:59.099803 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c2122b91-3242-4ba9-a9da-0ac1919e55aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:59.256691 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1365/2728] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:57:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:57:59.260665 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e6b338-5dc3-48b1-8746-e29d0530cf8d service cinder] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:59.262603 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-08e6b338-5dc3-48b1-8746-e29d0530cf8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:57:59.315090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2122b91-3242-4ba9-a9da-0ac1919e55aa None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:59.330651 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2122b91-3242-4ba9-a9da-0ac1919e55aa None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:59.335650 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c7485d-3f4a-4ed4-9536-e49d3036e69b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:59.336837 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7485d-3f4a-4ed4-9536-e49d3036e69b service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:59.337355 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7485d-3f4a-4ed4-9536-e49d3036e69b service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:59.337712 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7485d-3f4a-4ed4-9536-e49d3036e69b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:59.374042 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:59.392525 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e6b338-5dc3-48b1-8746-e29d0530cf8d service cinder] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:59.398033 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7584cab1-84de-488b-a9a5-1f6a568fab66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:59.398716 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584cab1-84de-488b-a9a5-1f6a568fab66 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:59.399011 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584cab1-84de-488b-a9a5-1f6a568fab66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:59.399281 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584cab1-84de-488b-a9a5-1f6a568fab66 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:59.400150 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7584cab1-84de-488b-a9a5-1f6a568fab66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:59.402809 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7584cab1-84de-488b-a9a5-1f6a568fab66 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:59.413009 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c7485d-3f4a-4ed4-9536-e49d3036e69b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:59.414582 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c7485d-3f4a-4ed4-9536-e49d3036e69b service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:59.426235 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1366/2729] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:57:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:57:59.433821 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1364/2730] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:57:59 2022] POST /identity/v3/projects => generated 379 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 20:57:59.438012 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c7485d-3f4a-4ed4-9536-e49d3036e69b service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:59.452368 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c7485d-3f4a-4ed4-9536-e49d3036e69b service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:59.517789 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d7e83c-3fdb-4649-9556-73369e712fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:59.518482 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7e83c-3fdb-4649-9556-73369e712fce admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:59.518779 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7e83c-3fdb-4649-9556-73369e712fce admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:59.519060 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7e83c-3fdb-4649-9556-73369e712fce admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:59.519763 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d7e83c-3fdb-4649-9556-73369e712fce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:59.521747 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d7e83c-3fdb-4649-9556-73369e712fce admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:59.546705 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1367/2731] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:57:59 2022] POST /identity/v3/users => generated 296 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:57:59.550639 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7584cab1-84de-488b-a9a5-1f6a568fab66 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:59.563276 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7584cab1-84de-488b-a9a5-1f6a568fab66 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:59.568303 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3fdf94-195c-47aa-a766-526c6df6655b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:59.568980 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fdf94-195c-47aa-a766-526c6df6655b admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:59.569323 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fdf94-195c-47aa-a766-526c6df6655b admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:59.569801 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fdf94-195c-47aa-a766-526c6df6655b admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:59.570269 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3fdf94-195c-47aa-a766-526c6df6655b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:59.571970 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3fdf94-195c-47aa-a766-526c6df6655b admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:59.586536 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1365/2732] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:57:59.591737 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d7e83c-3fdb-4649-9556-73369e712fce admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:59.605720 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d7e83c-3fdb-4649-9556-73369e712fce admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:59.610969 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f87430-e86d-4144-92d9-a11042a3ffd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:59.611988 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f87430-e86d-4144-92d9-a11042a3ffd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:59.612282 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f87430-e86d-4144-92d9-a11042a3ffd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:59.612571 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f87430-e86d-4144-92d9-a11042a3ffd5 admin admin] PATH_INFO: `/v3/projects/9f43d66f5c4e4cef8eccdde1c984365b/users/97ee7547d5fb4100aad420bda5312d29/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:59.629780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f87430-e86d-4144-92d9-a11042a3ffd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f43d66f5c4e4cef8eccdde1c984365b, user_id=97ee7547d5fb4100aad420bda5312d29, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:59.632875 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f87430-e86d-4144-92d9-a11042a3ffd5 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:59.649653 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1368/2733] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:57:59 2022] PUT /identity/v3/projects/9f43d66f5c4e4cef8eccdde1c984365b/users/97ee7547d5fb4100aad420bda5312d29/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:57:59.654602 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3fdf94-195c-47aa-a766-526c6df6655b admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:59.666835 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3fdf94-195c-47aa-a766-526c6df6655b admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:59.751976 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce03962-e89f-44c4-bb3a-ebdd11d9855a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:59.752825 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce03962-e89f-44c4-bb3a-ebdd11d9855a admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:59.753231 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce03962-e89f-44c4-bb3a-ebdd11d9855a admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:59.753609 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce03962-e89f-44c4-bb3a-ebdd11d9855a admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:59.754473 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce03962-e89f-44c4-bb3a-ebdd11d9855a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:59.756352 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce03962-e89f-44c4-bb3a-ebdd11d9855a admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:59.774879 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:57:59.793879 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f87430-e86d-4144-92d9-a11042a3ffd5 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:57:59.796186 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1366/2734] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:57:59.808530 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f87430-e86d-4144-92d9-a11042a3ffd5 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:57:59.814326 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc4fff-a95a-4e09-bd41-b98bf609eed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:57:59.815550 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc4fff-a95a-4e09-bd41-b98bf609eed3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:57:59.815899 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc4fff-a95a-4e09-bd41-b98bf609eed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:57:59.819772 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc4fff-a95a-4e09-bd41-b98bf609eed3 admin admin] PATH_INFO: `/v3/projects/9f43d66f5c4e4cef8eccdde1c984365b/users/97ee7547d5fb4100aad420bda5312d29/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:57:59.823519 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc4fff-a95a-4e09-bd41-b98bf609eed3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f43d66f5c4e4cef8eccdde1c984365b, user_id=97ee7547d5fb4100aad420bda5312d29, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:57:59.827133 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc4fff-a95a-4e09-bd41-b98bf609eed3 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:57:59.848593 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1369/2735] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:57:59 2022] PUT /identity/v3/projects/9f43d66f5c4e4cef8eccdde1c984365b/users/97ee7547d5fb4100aad420bda5312d29/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:58:04.397534 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e56e8-f7cb-4a86-83e4-b599a9a7c1ba None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:04.398342 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e56e8-f7cb-4a86-83e4-b599a9a7c1ba None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:04.398627 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e56e8-f7cb-4a86-83e4-b599a9a7c1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:04.426631 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-626e56e8-f7cb-4a86-83e4-b599a9a7c1ba None None] MFA Rules not processed for user `97ee7547d5fb4100aad420bda5312d29`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:58:04.428209 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-626e56e8-f7cb-4a86-83e4-b599a9a7c1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:04.505158 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1367/2736] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:58:04 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:58:04.522527 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc4fff-a95a-4e09-bd41-b98bf609eed3 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:04.526103 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4edc4fff-a95a-4e09-bd41-b98bf609eed3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:04.661637 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc4fff-a95a-4e09-bd41-b98bf609eed3 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:04.685058 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908c48f1-a08e-4142-bfab-4de0dc59dca0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3918fe05c8634bc39f3e295374701465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:04.686082 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c48f1-a08e-4142-bfab-4de0dc59dca0 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:04.686376 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c48f1-a08e-4142-bfab-4de0dc59dca0 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:04.686692 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c48f1-a08e-4142-bfab-4de0dc59dca0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:04.709779 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:58:04.755097 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908c48f1-a08e-4142-bfab-4de0dc59dca0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:04.756894 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908c48f1-a08e-4142-bfab-4de0dc59dca0 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:04.767518 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1370/2737] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:58:04 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:58:07.997965 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e56e8-f7cb-4a86-83e4-b599a9a7c1ba None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:08.059565 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e56e8-f7cb-4a86-83e4-b599a9a7c1ba None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:08.063297 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f1f815-c5ec-4fab-8e04-510517b3c68e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:08.064000 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f1f815-c5ec-4fab-8e04-510517b3c68e service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:08.064286 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f1f815-c5ec-4fab-8e04-510517b3c68e service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:08.064563 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f1f815-c5ec-4fab-8e04-510517b3c68e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:08.123299 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f1f815-c5ec-4fab-8e04-510517b3c68e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:08.124877 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f1f815-c5ec-4fab-8e04-510517b3c68e service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:08.140409 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1368/2738] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:58:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:58:08.737725 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908c48f1-a08e-4142-bfab-4de0dc59dca0 service nova] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:08.739300 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-908c48f1-a08e-4142-bfab-4de0dc59dca0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:08.861283 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908c48f1-a08e-4142-bfab-4de0dc59dca0 service nova] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:08.867486 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491723dc-1c08-4791-8f9c-7a917bd4c655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:08.868700 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491723dc-1c08-4791-8f9c-7a917bd4c655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:08.869229 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491723dc-1c08-4791-8f9c-7a917bd4c655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:08.869729 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491723dc-1c08-4791-8f9c-7a917bd4c655 admin admin] PATH_INFO: `/v3/users/41bd61767a93417e89c4a53b82cfdd66` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:08.872391 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491723dc-1c08-4791-8f9c-7a917bd4c655 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41bd61767a93417e89c4a53b82cfdd66)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:08.874685 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491723dc-1c08-4791-8f9c-7a917bd4c655 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:08.940952 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-491723dc-1c08-4791-8f9c-7a917bd4c655 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41bd61767a93417e89c4a53b82cfdd66'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:08.941889 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-491723dc-1c08-4791-8f9c-7a917bd4c655 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41bd61767a93417e89c4a53b82cfdd66'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:08.942689 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-491723dc-1c08-4791-8f9c-7a917bd4c655 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41bd61767a93417e89c4a53b82cfdd66'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:08.959629 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-491723dc-1c08-4791-8f9c-7a917bd4c655 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41bd61767a93417e89c4a53b82cfdd66'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:08.971086 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-491723dc-1c08-4791-8f9c-7a917bd4c655 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41bd61767a93417e89c4a53b82cfdd66'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:08.991830 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1371/2739] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:58:08 2022] DELETE /identity/v3/users/41bd61767a93417e89c4a53b82cfdd66 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:58:08.993573 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb57e9-3f28-469b-a245-f0b0ef67d7c6 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:08.994001 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb57e9-3f28-469b-a245-f0b0ef67d7c6 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:08.994440 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb57e9-3f28-469b-a245-f0b0ef67d7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:09.014817 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-dbdb57e9-3f28-469b-a245-f0b0ef67d7c6 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:58:09.016393 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-dbdb57e9-3f28-469b-a245-f0b0ef67d7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:09.064168 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:58:09.119661 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1369/2740] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:58:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 20:58:09.128507 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491723dc-1c08-4791-8f9c-7a917bd4c655 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:09.130326 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-491723dc-1c08-4791-8f9c-7a917bd4c655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:09.186510 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:58:09.203311 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491723dc-1c08-4791-8f9c-7a917bd4c655 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:09.207306 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c55b23e-6cfa-4a0f-8901-b464021945f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:09.208153 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55b23e-6cfa-4a0f-8901-b464021945f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:09.208546 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55b23e-6cfa-4a0f-8901-b464021945f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:09.208928 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55b23e-6cfa-4a0f-8901-b464021945f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:09.219009 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c55b23e-6cfa-4a0f-8901-b464021945f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:09.220653 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c55b23e-6cfa-4a0f-8901-b464021945f7 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:09.232654 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1372/2741] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:58:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:58:09.527871 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb57e9-3f28-469b-a245-f0b0ef67d7c6 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:09.529379 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-dbdb57e9-3f28-469b-a245-f0b0ef67d7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:09.541374 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb57e9-3f28-469b-a245-f0b0ef67d7c6 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:09.546117 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77bcf1a-bb1e-4cae-b49d-24b9f8d52834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:09.546992 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77bcf1a-bb1e-4cae-b49d-24b9f8d52834 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:09.547382 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77bcf1a-bb1e-4cae-b49d-24b9f8d52834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:09.547696 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77bcf1a-bb1e-4cae-b49d-24b9f8d52834 admin admin] PATH_INFO: `/v3/projects/f46a8ad2bae54f3589b95cd2901c0561` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:09.549008 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77bcf1a-bb1e-4cae-b49d-24b9f8d52834 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f46a8ad2bae54f3589b95cd2901c0561)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:09.551193 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77bcf1a-bb1e-4cae-b49d-24b9f8d52834 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:09.601150 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-b77bcf1a-bb1e-4cae-b49d-24b9f8d52834 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f46a8ad2bae54f3589b95cd2901c0561', 'request_id': 'req-b77bcf1a-bb1e-4cae-b49d-24b9f8d52834'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:09.607267 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-b77bcf1a-bb1e-4cae-b49d-24b9f8d52834 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f46a8ad2bae54f3589b95cd2901c0561', 'request_id': 'req-b77bcf1a-bb1e-4cae-b49d-24b9f8d52834'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:09.616592 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-b77bcf1a-bb1e-4cae-b49d-24b9f8d52834 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f46a8ad2bae54f3589b95cd2901c0561', 'request_id': 'req-b77bcf1a-bb1e-4cae-b49d-24b9f8d52834'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:09.630348 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-b77bcf1a-bb1e-4cae-b49d-24b9f8d52834 admin admin] The token cache is being invalidate because project f46a8ad2bae54f3589b95cd2901c0561 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:58:09.630995 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-b77bcf1a-bb1e-4cae-b49d-24b9f8d52834 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:09.631455 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-b77bcf1a-bb1e-4cae-b49d-24b9f8d52834 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:09.633135 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1370/2742] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:58:09 2022] DELETE /identity/v3/projects/f46a8ad2bae54f3589b95cd2901c0561 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:58:09.639670 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d12f1a-ee3c-4451-85f6-ae3fdea5f895 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:09.640327 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d12f1a-ee3c-4451-85f6-ae3fdea5f895 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:09.640613 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d12f1a-ee3c-4451-85f6-ae3fdea5f895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:09.658538 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-26d12f1a-ee3c-4451-85f6-ae3fdea5f895 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:58:09.659755 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-26d12f1a-ee3c-4451-85f6-ae3fdea5f895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:09.721406 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1373/2743] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:58:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:58:09.729043 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808ec7b-3958-4544-aa3a-3b14005990f2 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:09.729337 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808ec7b-3958-4544-aa3a-3b14005990f2 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:09.729658 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808ec7b-3958-4544-aa3a-3b14005990f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:09.748098 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-4808ec7b-3958-4544-aa3a-3b14005990f2 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:58:09.749293 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-4808ec7b-3958-4544-aa3a-3b14005990f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:09.757139 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1371/2744] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:58:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:58:09.761627 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d12f1a-ee3c-4451-85f6-ae3fdea5f895 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:09.771255 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d12f1a-ee3c-4451-85f6-ae3fdea5f895 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:09.775765 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b8eaf-64c8-489d-813c-4314dc7a5d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:09.776493 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b8eaf-64c8-489d-813c-4314dc7a5d5a admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:09.776777 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b8eaf-64c8-489d-813c-4314dc7a5d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:09.777051 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b8eaf-64c8-489d-813c-4314dc7a5d5a admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:09.777766 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2b8eaf-64c8-489d-813c-4314dc7a5d5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:58:09.778071 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2b8eaf-64c8-489d-813c-4314dc7a5d5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:09.779635 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2b8eaf-64c8-489d-813c-4314dc7a5d5a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:09.790811 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1374/2745] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:58:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:58:09.794841 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4808ec7b-3958-4544-aa3a-3b14005990f2 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:09.804334 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4808ec7b-3958-4544-aa3a-3b14005990f2 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:09.809538 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0fc4f6-3adf-4abb-bef0-0da872a63a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:09.810188 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0fc4f6-3adf-4abb-bef0-0da872a63a4e admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:09.810476 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0fc4f6-3adf-4abb-bef0-0da872a63a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:09.810758 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0fc4f6-3adf-4abb-bef0-0da872a63a4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:09.811460 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0fc4f6-3adf-4abb-bef0-0da872a63a4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:09.813415 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0fc4f6-3adf-4abb-bef0-0da872a63a4e admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:09.839202 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1372/2746] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:58:09 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:58:09.843532 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b8eaf-64c8-489d-813c-4314dc7a5d5a admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:09.854048 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b8eaf-64c8-489d-813c-4314dc7a5d5a admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:09.917924 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022fde1-ab4b-4c89-bd9a-ba0e712fb04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:09.918868 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022fde1-ab4b-4c89-bd9a-ba0e712fb04a admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:09.919160 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022fde1-ab4b-4c89-bd9a-ba0e712fb04a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:09.919441 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022fde1-ab4b-4c89-bd9a-ba0e712fb04a admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:09.920189 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6022fde1-ab4b-4c89-bd9a-ba0e712fb04a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:09.922530 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6022fde1-ab4b-4c89-bd9a-ba0e712fb04a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:09.946884 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1375/2747] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:58:09 2022] POST /identity/v3/users => generated 286 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:58:09.948141 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0fc4f6-3adf-4abb-bef0-0da872a63a4e admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:09.958409 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0fc4f6-3adf-4abb-bef0-0da872a63a4e admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:09.963247 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91505cab-a39e-40e3-b983-b1b63c903e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:09.963970 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91505cab-a39e-40e3-b983-b1b63c903e83 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:09.964258 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91505cab-a39e-40e3-b983-b1b63c903e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:09.964533 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91505cab-a39e-40e3-b983-b1b63c903e83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:09.965280 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91505cab-a39e-40e3-b983-b1b63c903e83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:09.966900 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91505cab-a39e-40e3-b983-b1b63c903e83 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:09.977777 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1373/2748] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:58:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:58:09.982262 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022fde1-ab4b-4c89-bd9a-ba0e712fb04a admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:09.993449 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022fde1-ab4b-4c89-bd9a-ba0e712fb04a admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:09.999524 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb6e5a-35d2-4a62-bb38-36699a8618f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:10.000344 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb6e5a-35d2-4a62-bb38-36699a8618f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:10.000536 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb6e5a-35d2-4a62-bb38-36699a8618f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:10.000831 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb6e5a-35d2-4a62-bb38-36699a8618f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:10.001542 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cb6e5a-35d2-4a62-bb38-36699a8618f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:10.003152 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cb6e5a-35d2-4a62-bb38-36699a8618f6 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:10.015078 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1376/2749] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:58:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:58:10.031941 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91505cab-a39e-40e3-b983-b1b63c903e83 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:10.036804 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91505cab-a39e-40e3-b983-b1b63c903e83 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:10.043044 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a8c53-a7b2-452b-adf3-c8915e2c27ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:10.044003 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a8c53-a7b2-452b-adf3-c8915e2c27ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:10.044496 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a8c53-a7b2-452b-adf3-c8915e2c27ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:10.044789 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a8c53-a7b2-452b-adf3-c8915e2c27ad admin admin] PATH_INFO: `/v3/projects/f08db13a16b349c698c4af697aa07d35/users/cb75f528976a45c78353ecd3d3f3cff4/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:10.065271 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8a8c53-a7b2-452b-adf3-c8915e2c27ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=f08db13a16b349c698c4af697aa07d35, user_id=cb75f528976a45c78353ecd3d3f3cff4, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:10.067844 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8a8c53-a7b2-452b-adf3-c8915e2c27ad admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:10.082778 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1374/2750] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:58:10 2022] PUT /identity/v3/projects/f08db13a16b349c698c4af697aa07d35/users/cb75f528976a45c78353ecd3d3f3cff4/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:58:10.094967 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded0657-2e2d-481f-8673-3ecada60bec8 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:10.095264 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded0657-2e2d-481f-8673-3ecada60bec8 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:10.095546 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded0657-2e2d-481f-8673-3ecada60bec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:10.126143 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-6ded0657-2e2d-481f-8673-3ecada60bec8 None None] MFA Rules not processed for user `cb75f528976a45c78353ecd3d3f3cff4`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:58:10.127303 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6ded0657-2e2d-481f-8673-3ecada60bec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:10.168950 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:58:10.199254 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1377/2751] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:58:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:58:10.213289 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a8c53-a7b2-452b-adf3-c8915e2c27ad admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:10.216319 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-fc8a8c53-a7b2-452b-adf3-c8915e2c27ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:10.286371 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:58:10.303843 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a8c53-a7b2-452b-adf3-c8915e2c27ad admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:10.308572 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a754f-025c-43c0-9954-4073e947adbc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30400df887ee433086d1810331785891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:10.309225 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a754f-025c-43c0-9954-4073e947adbc service glance] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:10.309524 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a754f-025c-43c0-9954-4073e947adbc service glance] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:10.309928 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a754f-025c-43c0-9954-4073e947adbc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:10.318645 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1a754f-025c-43c0-9954-4073e947adbc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:10.320321 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1a754f-025c-43c0-9954-4073e947adbc service glance] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:10.330073 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1375/2752] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:58:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:58:10.550138 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded0657-2e2d-481f-8673-3ecada60bec8 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:10.551755 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6ded0657-2e2d-481f-8673-3ecada60bec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:10.622087 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded0657-2e2d-481f-8673-3ecada60bec8 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:10.627319 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a697c-6eaf-4a54-ab7a-54ef415e995b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:10.628245 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a697c-6eaf-4a54-ab7a-54ef415e995b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:10.628588 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a697c-6eaf-4a54-ab7a-54ef415e995b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:10.628863 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a697c-6eaf-4a54-ab7a-54ef415e995b admin admin] PATH_INFO: `/v3/users/4008d806047b4e709977e7df122449cb` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:10.630955 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7a697c-6eaf-4a54-ab7a-54ef415e995b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4008d806047b4e709977e7df122449cb)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:10.633391 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7a697c-6eaf-4a54-ab7a-54ef415e995b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:10.695830 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8a7a697c-6eaf-4a54-ab7a-54ef415e995b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4008d806047b4e709977e7df122449cb'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:10.696869 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8a7a697c-6eaf-4a54-ab7a-54ef415e995b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4008d806047b4e709977e7df122449cb'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:10.697814 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8a7a697c-6eaf-4a54-ab7a-54ef415e995b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4008d806047b4e709977e7df122449cb'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:10.716702 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8a7a697c-6eaf-4a54-ab7a-54ef415e995b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4008d806047b4e709977e7df122449cb'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:10.725602 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8a7a697c-6eaf-4a54-ab7a-54ef415e995b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4008d806047b4e709977e7df122449cb'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:10.740305 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1378/2753] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:58:10 2022] DELETE /identity/v3/users/4008d806047b4e709977e7df122449cb => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:58:10.745642 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3451c-e24f-4369-9bde-76aef6c19159 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:10.745952 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3451c-e24f-4369-9bde-76aef6c19159 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:10.746250 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3451c-e24f-4369-9bde-76aef6c19159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:10.766680 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-bba3451c-e24f-4369-9bde-76aef6c19159 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:58:10.767992 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-bba3451c-e24f-4369-9bde-76aef6c19159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:10.835840 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1376/2754] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:58:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:58:10.846330 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a697c-6eaf-4a54-ab7a-54ef415e995b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:10.847763 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8a7a697c-6eaf-4a54-ab7a-54ef415e995b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:10.906767 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a697c-6eaf-4a54-ab7a-54ef415e995b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:10.910357 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d985ccd-d60b-44c1-bfce-3cb171ab76d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:10.911002 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d985ccd-d60b-44c1-bfce-3cb171ab76d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:10.911290 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d985ccd-d60b-44c1-bfce-3cb171ab76d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:10.911570 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d985ccd-d60b-44c1-bfce-3cb171ab76d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:10.921253 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d985ccd-d60b-44c1-bfce-3cb171ab76d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:10.922699 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d985ccd-d60b-44c1-bfce-3cb171ab76d3 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:10.927851 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:58:10.932981 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1379/2755] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:58:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:58:11.209746 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3451c-e24f-4369-9bde-76aef6c19159 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:11.211274 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-bba3451c-e24f-4369-9bde-76aef6c19159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:11.228172 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3451c-e24f-4369-9bde-76aef6c19159 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:11.233105 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889f7a9-705b-4e53-b293-333558f875c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:11.234253 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889f7a9-705b-4e53-b293-333558f875c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:11.234736 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889f7a9-705b-4e53-b293-333558f875c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:11.235108 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889f7a9-705b-4e53-b293-333558f875c6 admin admin] PATH_INFO: `/v3/projects/f324ece5d6294375b22b894aa83aed10` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:11.236516 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7889f7a9-705b-4e53-b293-333558f875c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f324ece5d6294375b22b894aa83aed10)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:11.238877 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7889f7a9-705b-4e53-b293-333558f875c6 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:11.291370 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-7889f7a9-705b-4e53-b293-333558f875c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f324ece5d6294375b22b894aa83aed10', 'request_id': 'req-7889f7a9-705b-4e53-b293-333558f875c6'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:11.297887 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-7889f7a9-705b-4e53-b293-333558f875c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f324ece5d6294375b22b894aa83aed10', 'request_id': 'req-7889f7a9-705b-4e53-b293-333558f875c6'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:11.306469 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-7889f7a9-705b-4e53-b293-333558f875c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f324ece5d6294375b22b894aa83aed10', 'request_id': 'req-7889f7a9-705b-4e53-b293-333558f875c6'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:11.318858 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-7889f7a9-705b-4e53-b293-333558f875c6 admin admin] The token cache is being invalidate because project f324ece5d6294375b22b894aa83aed10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:58:11.319156 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-7889f7a9-705b-4e53-b293-333558f875c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:11.319833 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-7889f7a9-705b-4e53-b293-333558f875c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:11.321462 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1377/2756] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:58:11 2022] DELETE /identity/v3/projects/f324ece5d6294375b22b894aa83aed10 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:58:11.325944 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d985ccd-d60b-44c1-bfce-3cb171ab76d3 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:11.337254 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d985ccd-d60b-44c1-bfce-3cb171ab76d3 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:11.396031 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d6118-4716-4eff-a7e7-e4ad02c7ef05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:11.396915 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d6118-4716-4eff-a7e7-e4ad02c7ef05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:11.397202 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d6118-4716-4eff-a7e7-e4ad02c7ef05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:11.397483 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d6118-4716-4eff-a7e7-e4ad02c7ef05 admin admin] PATH_INFO: `/v3/users/a43acedae25847038668808c769abb7c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:11.398665 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d6118-4716-4eff-a7e7-e4ad02c7ef05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a43acedae25847038668808c769abb7c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:11.400630 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d6118-4716-4eff-a7e7-e4ad02c7ef05 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:11.444895 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1a6d6118-4716-4eff-a7e7-e4ad02c7ef05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a43acedae25847038668808c769abb7c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:11.445475 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1a6d6118-4716-4eff-a7e7-e4ad02c7ef05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a43acedae25847038668808c769abb7c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:11.446327 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1a6d6118-4716-4eff-a7e7-e4ad02c7ef05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a43acedae25847038668808c769abb7c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:11.459605 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1a6d6118-4716-4eff-a7e7-e4ad02c7ef05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a43acedae25847038668808c769abb7c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:11.469705 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1a6d6118-4716-4eff-a7e7-e4ad02c7ef05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a43acedae25847038668808c769abb7c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:11.484636 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1380/2757] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:58:11 2022] DELETE /identity/v3/users/a43acedae25847038668808c769abb7c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:58:11.763533 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889f7a9-705b-4e53-b293-333558f875c6 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:11.765087 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-7889f7a9-705b-4e53-b293-333558f875c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:11.783647 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889f7a9-705b-4e53-b293-333558f875c6 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:11.849502 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4495aae4-0734-4dae-b3f4-60c378e00231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:11.850388 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495aae4-0734-4dae-b3f4-60c378e00231 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:11.850677 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495aae4-0734-4dae-b3f4-60c378e00231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:11.850960 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495aae4-0734-4dae-b3f4-60c378e00231 admin admin] PATH_INFO: `/v3/projects/0934457cc60840d7a33ddf1d6ed9c05c` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:11.852849 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4495aae4-0734-4dae-b3f4-60c378e00231 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0934457cc60840d7a33ddf1d6ed9c05c)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:11.855388 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4495aae4-0734-4dae-b3f4-60c378e00231 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:11.864576 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:58:11.906937 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-4495aae4-0734-4dae-b3f4-60c378e00231 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0934457cc60840d7a33ddf1d6ed9c05c', 'request_id': 'req-4495aae4-0734-4dae-b3f4-60c378e00231'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:11.912593 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-4495aae4-0734-4dae-b3f4-60c378e00231 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0934457cc60840d7a33ddf1d6ed9c05c', 'request_id': 'req-4495aae4-0734-4dae-b3f4-60c378e00231'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:11.920572 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-4495aae4-0734-4dae-b3f4-60c378e00231 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0934457cc60840d7a33ddf1d6ed9c05c', 'request_id': 'req-4495aae4-0734-4dae-b3f4-60c378e00231'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:11.932600 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-4495aae4-0734-4dae-b3f4-60c378e00231 admin admin] The token cache is being invalidate because project 0934457cc60840d7a33ddf1d6ed9c05c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:58:11.933480 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-4495aae4-0734-4dae-b3f4-60c378e00231 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:11.934127 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-4495aae4-0734-4dae-b3f4-60c378e00231 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:11.935665 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1378/2758] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:58:11 2022] DELETE /identity/v3/projects/0934457cc60840d7a33ddf1d6ed9c05c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:58:11.939540 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d6118-4716-4eff-a7e7-e4ad02c7ef05 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:11.941017 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1a6d6118-4716-4eff-a7e7-e4ad02c7ef05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:11.953486 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d6118-4716-4eff-a7e7-e4ad02c7ef05 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:12.024749 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03a877-07c2-41fb-b789-871d2aea95e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:12.025644 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03a877-07c2-41fb-b789-871d2aea95e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:12.025927 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03a877-07c2-41fb-b789-871d2aea95e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:12.026258 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03a877-07c2-41fb-b789-871d2aea95e4 admin admin] PATH_INFO: `/v3/users/cc0b7cfc45344e7fb8e84f19bb2a9ccc` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:12.027491 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03a877-07c2-41fb-b789-871d2aea95e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc0b7cfc45344e7fb8e84f19bb2a9ccc)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:12.029444 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03a877-07c2-41fb-b789-871d2aea95e4 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:12.065453 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:58:12.093755 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2a03a877-07c2-41fb-b789-871d2aea95e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc0b7cfc45344e7fb8e84f19bb2a9ccc'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:12.094417 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2a03a877-07c2-41fb-b789-871d2aea95e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc0b7cfc45344e7fb8e84f19bb2a9ccc'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:12.095019 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2a03a877-07c2-41fb-b789-871d2aea95e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc0b7cfc45344e7fb8e84f19bb2a9ccc'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:12.108186 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2a03a877-07c2-41fb-b789-871d2aea95e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc0b7cfc45344e7fb8e84f19bb2a9ccc'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:12.115900 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2a03a877-07c2-41fb-b789-871d2aea95e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc0b7cfc45344e7fb8e84f19bb2a9ccc'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:12.128252 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1381/2759] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:58:11 2022] DELETE /identity/v3/users/cc0b7cfc45344e7fb8e84f19bb2a9ccc => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:58:12.409928 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4495aae4-0734-4dae-b3f4-60c378e00231 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:12.411357 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-4495aae4-0734-4dae-b3f4-60c378e00231 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:12.433108 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4495aae4-0734-4dae-b3f4-60c378e00231 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:12.497395 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c118ad1-9dab-4d98-8a7c-72855775710d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:12.498261 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c118ad1-9dab-4d98-8a7c-72855775710d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:12.498543 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c118ad1-9dab-4d98-8a7c-72855775710d admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:12.498819 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c118ad1-9dab-4d98-8a7c-72855775710d admin admin] PATH_INFO: `/v3/projects/e428f77c2d8347a98cbb18258a45891a` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:12.500013 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c118ad1-9dab-4d98-8a7c-72855775710d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e428f77c2d8347a98cbb18258a45891a)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:12.501905 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c118ad1-9dab-4d98-8a7c-72855775710d admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:12.546262 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-1c118ad1-9dab-4d98-8a7c-72855775710d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e428f77c2d8347a98cbb18258a45891a', 'request_id': 'req-1c118ad1-9dab-4d98-8a7c-72855775710d'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:12.551889 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-1c118ad1-9dab-4d98-8a7c-72855775710d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e428f77c2d8347a98cbb18258a45891a', 'request_id': 'req-1c118ad1-9dab-4d98-8a7c-72855775710d'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:12.560003 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-1c118ad1-9dab-4d98-8a7c-72855775710d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e428f77c2d8347a98cbb18258a45891a', 'request_id': 'req-1c118ad1-9dab-4d98-8a7c-72855775710d'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:12.571094 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-1c118ad1-9dab-4d98-8a7c-72855775710d admin admin] The token cache is being invalidate because project e428f77c2d8347a98cbb18258a45891a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:58:12.571386 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-1c118ad1-9dab-4d98-8a7c-72855775710d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:12.572101 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-1c118ad1-9dab-4d98-8a7c-72855775710d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:12.573670 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1379/2760] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:58:12 2022] DELETE /identity/v3/projects/e428f77c2d8347a98cbb18258a45891a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:58:12.579635 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187e288-b9bc-4126-b05d-201daba71eaf None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:12.579943 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187e288-b9bc-4126-b05d-201daba71eaf None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:12.580230 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187e288-b9bc-4126-b05d-201daba71eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:12.597939 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-6187e288-b9bc-4126-b05d-201daba71eaf None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:58:12.599169 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6187e288-b9bc-4126-b05d-201daba71eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:12.664923 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1382/2761] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:58:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:58:12.673295 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f2b74-4c57-4255-aed8-457ec9358ecb None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:12.673654 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f2b74-4c57-4255-aed8-457ec9358ecb None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:12.673941 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f2b74-4c57-4255-aed8-457ec9358ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:12.692056 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-5e0f2b74-4c57-4255-aed8-457ec9358ecb None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:58:12.693241 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-5e0f2b74-4c57-4255-aed8-457ec9358ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:12.701502 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1380/2762] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:58:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:58:12.705437 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6187e288-b9bc-4126-b05d-201daba71eaf None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:12.715622 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6187e288-b9bc-4126-b05d-201daba71eaf None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:12.720312 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b74c5c6-fb3a-4309-ab78-d78f80324d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:12.720965 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74c5c6-fb3a-4309-ab78-d78f80324d86 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:12.721255 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74c5c6-fb3a-4309-ab78-d78f80324d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:12.721536 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74c5c6-fb3a-4309-ab78-d78f80324d86 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:12.722269 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b74c5c6-fb3a-4309-ab78-d78f80324d86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:58:12.722580 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b74c5c6-fb3a-4309-ab78-d78f80324d86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:12.724215 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b74c5c6-fb3a-4309-ab78-d78f80324d86 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:12.739867 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1383/2763] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:58:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:58:12.741354 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f2b74-4c57-4255-aed8-457ec9358ecb None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:12.751266 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f2b74-4c57-4255-aed8-457ec9358ecb None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:12.755959 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8940e7-3a3a-45ab-91e0-77aae1dec10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:12.756626 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8940e7-3a3a-45ab-91e0-77aae1dec10d admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:12.756912 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8940e7-3a3a-45ab-91e0-77aae1dec10d admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:12.757217 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8940e7-3a3a-45ab-91e0-77aae1dec10d admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:12.757912 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8940e7-3a3a-45ab-91e0-77aae1dec10d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:12.760117 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8940e7-3a3a-45ab-91e0-77aae1dec10d admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:12.782123 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:58:12.791277 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1381/2764] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:58:12 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 20:58:12.795752 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b74c5c6-fb3a-4309-ab78-d78f80324d86 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:12.806434 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b74c5c6-fb3a-4309-ab78-d78f80324d86 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:12.862623 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b929a5-ea99-4fda-b384-10ef9cdc413e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:12.863297 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b929a5-ea99-4fda-b384-10ef9cdc413e admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:12.863586 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b929a5-ea99-4fda-b384-10ef9cdc413e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:12.863866 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b929a5-ea99-4fda-b384-10ef9cdc413e admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:12.864593 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b929a5-ea99-4fda-b384-10ef9cdc413e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:12.866497 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b929a5-ea99-4fda-b384-10ef9cdc413e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:12.888794 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1384/2765] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:58:12 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:58:12.893165 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8940e7-3a3a-45ab-91e0-77aae1dec10d admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:12.905413 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8940e7-3a3a-45ab-91e0-77aae1dec10d admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:12.910546 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e0505-1e68-475d-abc2-8c52f2e4a4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:12.911385 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e0505-1e68-475d-abc2-8c52f2e4a4f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:12.911678 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e0505-1e68-475d-abc2-8c52f2e4a4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:12.912006 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e0505-1e68-475d-abc2-8c52f2e4a4f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:12.912776 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005e0505-1e68-475d-abc2-8c52f2e4a4f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:12.914514 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005e0505-1e68-475d-abc2-8c52f2e4a4f5 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:12.926596 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1382/2766] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:58:12.930892 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b929a5-ea99-4fda-b384-10ef9cdc413e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:12.950287 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b929a5-ea99-4fda-b384-10ef9cdc413e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:12.956208 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72854b1-55b5-4928-b735-f74d83537c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:12.956963 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72854b1-55b5-4928-b735-f74d83537c72 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:12.957258 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72854b1-55b5-4928-b735-f74d83537c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:12.957568 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72854b1-55b5-4928-b735-f74d83537c72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:12.958577 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72854b1-55b5-4928-b735-f74d83537c72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:12.960147 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72854b1-55b5-4928-b735-f74d83537c72 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:12.971461 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1385/2767] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:58:12.975468 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e0505-1e68-475d-abc2-8c52f2e4a4f5 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:12.986289 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e0505-1e68-475d-abc2-8c52f2e4a4f5 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:12.991332 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da32afb2-8484-4562-b63b-deb9ce9371d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:12.992271 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32afb2-8484-4562-b63b-deb9ce9371d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:12.992699 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32afb2-8484-4562-b63b-deb9ce9371d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:12.992889 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32afb2-8484-4562-b63b-deb9ce9371d2 admin admin] PATH_INFO: `/v3/projects/ac09e4a5cd464aa6a404a83da03c8345/users/41307ba532f24a339b015ab08dfe0420/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:13.012585 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da32afb2-8484-4562-b63b-deb9ce9371d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac09e4a5cd464aa6a404a83da03c8345, user_id=41307ba532f24a339b015ab08dfe0420, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:13.015424 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da32afb2-8484-4562-b63b-deb9ce9371d2 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:13.034056 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1383/2768] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:58:12 2022] PUT /identity/v3/projects/ac09e4a5cd464aa6a404a83da03c8345/users/41307ba532f24a339b015ab08dfe0420/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:58:13.045647 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cbd543-6cf5-4ec1-bc74-cec458507713 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:13.045938 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cbd543-6cf5-4ec1-bc74-cec458507713 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:13.046222 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cbd543-6cf5-4ec1-bc74-cec458507713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:13.053363 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:58:13.078580 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-d9cbd543-6cf5-4ec1-bc74-cec458507713 None None] MFA Rules not processed for user `41307ba532f24a339b015ab08dfe0420`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:58:13.079973 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d9cbd543-6cf5-4ec1-bc74-cec458507713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:13.154593 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1386/2769] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:58:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:58:13.159063 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da32afb2-8484-4562-b63b-deb9ce9371d2 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:13.228234 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da32afb2-8484-4562-b63b-deb9ce9371d2 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:13.233566 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca6a6e-a092-4602-8aef-041b4c7c5cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:13.234222 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca6a6e-a092-4602-8aef-041b4c7c5cdd admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:13.234510 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca6a6e-a092-4602-8aef-041b4c7c5cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:13.234789 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca6a6e-a092-4602-8aef-041b4c7c5cdd admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:13.235485 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ca6a6e-a092-4602-8aef-041b4c7c5cdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:13.237404 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ca6a6e-a092-4602-8aef-041b4c7c5cdd admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:13.262474 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1384/2770] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:58:13 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 20:58:13.266501 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cbd543-6cf5-4ec1-bc74-cec458507713 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:13.277820 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cbd543-6cf5-4ec1-bc74-cec458507713 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:13.333114 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118d99c5-9fdc-42c5-a3f2-8d2ab1dd12e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:13.333709 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d99c5-9fdc-42c5-a3f2-8d2ab1dd12e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:13.333995 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d99c5-9fdc-42c5-a3f2-8d2ab1dd12e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:13.334274 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d99c5-9fdc-42c5-a3f2-8d2ab1dd12e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:13.334968 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118d99c5-9fdc-42c5-a3f2-8d2ab1dd12e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:13.336907 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118d99c5-9fdc-42c5-a3f2-8d2ab1dd12e2 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:13.356440 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1387/2771] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:58:13 2022] POST /identity/v3/users => generated 298 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:58:13.360347 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca6a6e-a092-4602-8aef-041b4c7c5cdd admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:13.371143 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca6a6e-a092-4602-8aef-041b4c7c5cdd admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:13.375823 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29953ee-a5e8-473f-8324-184984d1e983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:13.376500 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29953ee-a5e8-473f-8324-184984d1e983 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:13.376790 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29953ee-a5e8-473f-8324-184984d1e983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:13.377068 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29953ee-a5e8-473f-8324-184984d1e983 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:13.377790 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29953ee-a5e8-473f-8324-184984d1e983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:13.379364 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29953ee-a5e8-473f-8324-184984d1e983 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:13.389782 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1385/2772] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:58:13.393647 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118d99c5-9fdc-42c5-a3f2-8d2ab1dd12e2 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:13.403585 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118d99c5-9fdc-42c5-a3f2-8d2ab1dd12e2 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:13.408154 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed39762-d236-48c1-8c68-892fdcb0fb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:13.409028 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed39762-d236-48c1-8c68-892fdcb0fb83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:13.409316 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed39762-d236-48c1-8c68-892fdcb0fb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:13.409596 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed39762-d236-48c1-8c68-892fdcb0fb83 admin admin] PATH_INFO: `/v3/projects/b9a130ffeead449a920538f485fadd54/users/8613490a420a402d945720ff3d4dc30b/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:13.424719 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed39762-d236-48c1-8c68-892fdcb0fb83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9a130ffeead449a920538f485fadd54, user_id=8613490a420a402d945720ff3d4dc30b, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:13.427348 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed39762-d236-48c1-8c68-892fdcb0fb83 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:13.440174 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1388/2773] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:58:13 2022] PUT /identity/v3/projects/b9a130ffeead449a920538f485fadd54/users/8613490a420a402d945720ff3d4dc30b/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:58:13.443941 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29953ee-a5e8-473f-8324-184984d1e983 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:13.453898 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29953ee-a5e8-473f-8324-184984d1e983 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:13.509547 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e75174-4793-42c5-abb5-ea0d476c1697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:13.510213 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e75174-4793-42c5-abb5-ea0d476c1697 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:13.510500 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e75174-4793-42c5-abb5-ea0d476c1697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:13.511276 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e75174-4793-42c5-abb5-ea0d476c1697 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:13.512037 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e75174-4793-42c5-abb5-ea0d476c1697 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:13.513634 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e75174-4793-42c5-abb5-ea0d476c1697 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:13.524058 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1386/2774] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:58:13.528920 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed39762-d236-48c1-8c68-892fdcb0fb83 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:13.539202 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed39762-d236-48c1-8c68-892fdcb0fb83 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:13.543797 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c63c34-194b-40a7-8029-7f9df7fc2cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:13.544706 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c63c34-194b-40a7-8029-7f9df7fc2cc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:13.544993 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c63c34-194b-40a7-8029-7f9df7fc2cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:13.545273 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c63c34-194b-40a7-8029-7f9df7fc2cc1 admin admin] PATH_INFO: `/v3/projects/b9a130ffeead449a920538f485fadd54/users/8613490a420a402d945720ff3d4dc30b/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:13.547253 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c63c34-194b-40a7-8029-7f9df7fc2cc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9a130ffeead449a920538f485fadd54, user_id=8613490a420a402d945720ff3d4dc30b, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:13.550132 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c63c34-194b-40a7-8029-7f9df7fc2cc1 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:13.560515 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1389/2775] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:58:13 2022] PUT /identity/v3/projects/b9a130ffeead449a920538f485fadd54/users/8613490a420a402d945720ff3d4dc30b/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:58:13.570814 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435e6ea-3827-4d93-a852-4dae65675989 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:13.571112 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435e6ea-3827-4d93-a852-4dae65675989 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:13.571396 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435e6ea-3827-4d93-a852-4dae65675989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:13.598242 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-0435e6ea-3827-4d93-a852-4dae65675989 None None] MFA Rules not processed for user `8613490a420a402d945720ff3d4dc30b`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:58:13.599386 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-0435e6ea-3827-4d93-a852-4dae65675989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:13.619313 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:58:13.675857 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1387/2776] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:58:13 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:58:13.687161 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c63c34-194b-40a7-8029-7f9df7fc2cc1 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:13.688900 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-46c63c34-194b-40a7-8029-7f9df7fc2cc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:13.740733 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:58:13.747291 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c63c34-194b-40a7-8029-7f9df7fc2cc1 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:13.751088 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87764e55-9ed6-4b8b-84db-39046889c086 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:13.751733 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87764e55-9ed6-4b8b-84db-39046889c086 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:13.752038 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87764e55-9ed6-4b8b-84db-39046889c086 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:13.752316 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87764e55-9ed6-4b8b-84db-39046889c086 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:13.761797 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87764e55-9ed6-4b8b-84db-39046889c086 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:13.763212 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87764e55-9ed6-4b8b-84db-39046889c086 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:13.772468 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1390/2777] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:58:13 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:58:13.867694 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435e6ea-3827-4d93-a852-4dae65675989 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:13.869126 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-0435e6ea-3827-4d93-a852-4dae65675989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:13.883456 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435e6ea-3827-4d93-a852-4dae65675989 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:13.887952 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd4e37-8512-4f5f-9e6e-f51584140559 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:13.888608 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd4e37-8512-4f5f-9e6e-f51584140559 service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:13.888895 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd4e37-8512-4f5f-9e6e-f51584140559 service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:13.889176 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd4e37-8512-4f5f-9e6e-f51584140559 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:13.948402 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bd4e37-8512-4f5f-9e6e-f51584140559 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:13.950268 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bd4e37-8512-4f5f-9e6e-f51584140559 service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:13.959493 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1388/2778] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:58:13 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:58:17.578886 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87764e55-9ed6-4b8b-84db-39046889c086 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:17.649447 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87764e55-9ed6-4b8b-84db-39046889c086 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:17.653999 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0abe3-b699-4327-a29c-500e63c1c7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:17.654870 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0abe3-b699-4327-a29c-500e63c1c7b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:17.655164 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0abe3-b699-4327-a29c-500e63c1c7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:17.655445 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0abe3-b699-4327-a29c-500e63c1c7b2 admin admin] PATH_INFO: `/v3/users/41307ba532f24a339b015ab08dfe0420` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:17.656771 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d0abe3-b699-4327-a29c-500e63c1c7b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41307ba532f24a339b015ab08dfe0420)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:17.658688 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d0abe3-b699-4327-a29c-500e63c1c7b2 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:17.703616 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e4d0abe3-b699-4327-a29c-500e63c1c7b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41307ba532f24a339b015ab08dfe0420'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:17.704313 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e4d0abe3-b699-4327-a29c-500e63c1c7b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41307ba532f24a339b015ab08dfe0420'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:17.704934 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e4d0abe3-b699-4327-a29c-500e63c1c7b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41307ba532f24a339b015ab08dfe0420'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:17.716420 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e4d0abe3-b699-4327-a29c-500e63c1c7b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41307ba532f24a339b015ab08dfe0420'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:17.723410 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e4d0abe3-b699-4327-a29c-500e63c1c7b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41307ba532f24a339b015ab08dfe0420'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:17.735669 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1391/2779] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:58:17 2022] DELETE /identity/v3/users/41307ba532f24a339b015ab08dfe0420 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:58:17.740177 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa4155-a4b8-4404-b23d-90a6b34da999 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:17.740655 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa4155-a4b8-4404-b23d-90a6b34da999 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:17.740754 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa4155-a4b8-4404-b23d-90a6b34da999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:17.757911 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-d2aa4155-a4b8-4404-b23d-90a6b34da999 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:58:17.759102 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-d2aa4155-a4b8-4404-b23d-90a6b34da999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:17.817794 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1389/2780] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:58:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:58:17.825817 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0abe3-b699-4327-a29c-500e63c1c7b2 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:17.827213 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e4d0abe3-b699-4327-a29c-500e63c1c7b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:17.883209 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0abe3-b699-4327-a29c-500e63c1c7b2 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:17.886846 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f6d30d-40d7-48d9-b7ec-18d8c0666afe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:17.887488 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f6d30d-40d7-48d9-b7ec-18d8c0666afe service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:17.887773 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f6d30d-40d7-48d9-b7ec-18d8c0666afe service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:17.888089 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f6d30d-40d7-48d9-b7ec-18d8c0666afe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:17.897046 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f6d30d-40d7-48d9-b7ec-18d8c0666afe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:17.898492 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f6d30d-40d7-48d9-b7ec-18d8c0666afe service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:17.908495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1392/2781] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:58:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:58:18.194713 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa4155-a4b8-4404-b23d-90a6b34da999 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:18.196306 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-d2aa4155-a4b8-4404-b23d-90a6b34da999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:18.208927 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa4155-a4b8-4404-b23d-90a6b34da999 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:18.214362 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded07dd-f2b5-4a0b-9e76-97dc5979f6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:18.215238 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded07dd-f2b5-4a0b-9e76-97dc5979f6a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:18.215521 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded07dd-f2b5-4a0b-9e76-97dc5979f6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:18.215799 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded07dd-f2b5-4a0b-9e76-97dc5979f6a7 admin admin] PATH_INFO: `/v3/projects/ac09e4a5cd464aa6a404a83da03c8345` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:18.217044 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fded07dd-f2b5-4a0b-9e76-97dc5979f6a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac09e4a5cd464aa6a404a83da03c8345)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:18.220056 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fded07dd-f2b5-4a0b-9e76-97dc5979f6a7 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:18.266792 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-fded07dd-f2b5-4a0b-9e76-97dc5979f6a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac09e4a5cd464aa6a404a83da03c8345', 'request_id': 'req-fded07dd-f2b5-4a0b-9e76-97dc5979f6a7'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:18.268754 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:58:18.274101 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-fded07dd-f2b5-4a0b-9e76-97dc5979f6a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac09e4a5cd464aa6a404a83da03c8345', 'request_id': 'req-fded07dd-f2b5-4a0b-9e76-97dc5979f6a7'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:18.281869 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-fded07dd-f2b5-4a0b-9e76-97dc5979f6a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac09e4a5cd464aa6a404a83da03c8345', 'request_id': 'req-fded07dd-f2b5-4a0b-9e76-97dc5979f6a7'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:18.292706 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-fded07dd-f2b5-4a0b-9e76-97dc5979f6a7 admin admin] The token cache is being invalidate because project ac09e4a5cd464aa6a404a83da03c8345 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:58:18.292992 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-fded07dd-f2b5-4a0b-9e76-97dc5979f6a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:18.293631 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-fded07dd-f2b5-4a0b-9e76-97dc5979f6a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:18.295146 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1390/2782] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:58:18 2022] DELETE /identity/v3/projects/ac09e4a5cd464aa6a404a83da03c8345 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:58:18.299502 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f6d30d-40d7-48d9-b7ec-18d8c0666afe service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:18.309590 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f6d30d-40d7-48d9-b7ec-18d8c0666afe service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:18.317016 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:58:18.370063 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae75fbc-4878-409e-8273-dbcaae861d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:18.370932 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae75fbc-4878-409e-8273-dbcaae861d7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:18.371212 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae75fbc-4878-409e-8273-dbcaae861d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:18.371482 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae75fbc-4878-409e-8273-dbcaae861d7f admin admin] PATH_INFO: `/v3/users/8613490a420a402d945720ff3d4dc30b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:18.372670 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae75fbc-4878-409e-8273-dbcaae861d7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8613490a420a402d945720ff3d4dc30b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:18.374557 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae75fbc-4878-409e-8273-dbcaae861d7f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:18.418467 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6ae75fbc-4878-409e-8273-dbcaae861d7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8613490a420a402d945720ff3d4dc30b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:18.419144 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6ae75fbc-4878-409e-8273-dbcaae861d7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8613490a420a402d945720ff3d4dc30b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:18.419761 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6ae75fbc-4878-409e-8273-dbcaae861d7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8613490a420a402d945720ff3d4dc30b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:18.432441 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6ae75fbc-4878-409e-8273-dbcaae861d7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8613490a420a402d945720ff3d4dc30b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:18.440911 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6ae75fbc-4878-409e-8273-dbcaae861d7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8613490a420a402d945720ff3d4dc30b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:18.465284 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1393/2783] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:58:18 2022] DELETE /identity/v3/users/8613490a420a402d945720ff3d4dc30b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:58:18.735597 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded07dd-f2b5-4a0b-9e76-97dc5979f6a7 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:18.737063 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-fded07dd-f2b5-4a0b-9e76-97dc5979f6a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:18.750133 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded07dd-f2b5-4a0b-9e76-97dc5979f6a7 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:18.808992 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a566d257-a34d-4ea2-8b1e-a7e1366643cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:18.809857 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a566d257-a34d-4ea2-8b1e-a7e1366643cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:18.810147 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a566d257-a34d-4ea2-8b1e-a7e1366643cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:18.810429 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a566d257-a34d-4ea2-8b1e-a7e1366643cf admin admin] PATH_INFO: `/v3/projects/b9a130ffeead449a920538f485fadd54` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:18.811604 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a566d257-a34d-4ea2-8b1e-a7e1366643cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9a130ffeead449a920538f485fadd54)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:18.813543 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a566d257-a34d-4ea2-8b1e-a7e1366643cf admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:18.859398 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-a566d257-a34d-4ea2-8b1e-a7e1366643cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9a130ffeead449a920538f485fadd54', 'request_id': 'req-a566d257-a34d-4ea2-8b1e-a7e1366643cf'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:18.864823 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-a566d257-a34d-4ea2-8b1e-a7e1366643cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9a130ffeead449a920538f485fadd54', 'request_id': 'req-a566d257-a34d-4ea2-8b1e-a7e1366643cf'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:18.872562 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-a566d257-a34d-4ea2-8b1e-a7e1366643cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9a130ffeead449a920538f485fadd54', 'request_id': 'req-a566d257-a34d-4ea2-8b1e-a7e1366643cf'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:18.883741 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-a566d257-a34d-4ea2-8b1e-a7e1366643cf admin admin] The token cache is being invalidate because project b9a130ffeead449a920538f485fadd54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:58:18.884189 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-a566d257-a34d-4ea2-8b1e-a7e1366643cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:18.884877 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-a566d257-a34d-4ea2-8b1e-a7e1366643cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:18.887061 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1391/2784] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:58:18 2022] DELETE /identity/v3/projects/b9a130ffeead449a920538f485fadd54 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:58:18.892297 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6681a-9de3-498b-8b9a-e3b8612734fe None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:18.892815 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6681a-9de3-498b-8b9a-e3b8612734fe None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:18.892901 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6681a-9de3-498b-8b9a-e3b8612734fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:18.912799 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-15d6681a-9de3-498b-8b9a-e3b8612734fe None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:58:18.914036 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-15d6681a-9de3-498b-8b9a-e3b8612734fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:18.972861 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1394/2785] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:58:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:58:18.981695 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72996959-59c2-4de1-a8ec-c8cf3b5d70bb None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:18.981992 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72996959-59c2-4de1-a8ec-c8cf3b5d70bb None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:18.982277 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72996959-59c2-4de1-a8ec-c8cf3b5d70bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:19.000490 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-72996959-59c2-4de1-a8ec-c8cf3b5d70bb None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:58:19.001695 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-72996959-59c2-4de1-a8ec-c8cf3b5d70bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:19.009751 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1392/2786] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:58:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:58:19.014307 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d6681a-9de3-498b-8b9a-e3b8612734fe None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:19.023751 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d6681a-9de3-498b-8b9a-e3b8612734fe None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:19.028879 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf07698-01d9-418e-97a5-7a1f87b913c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:19.029531 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf07698-01d9-418e-97a5-7a1f87b913c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:19.029817 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf07698-01d9-418e-97a5-7a1f87b913c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:19.030095 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf07698-01d9-418e-97a5-7a1f87b913c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:19.030816 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf07698-01d9-418e-97a5-7a1f87b913c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:58:19.031128 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf07698-01d9-418e-97a5-7a1f87b913c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:19.032751 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf07698-01d9-418e-97a5-7a1f87b913c0 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:19.044385 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1395/2787] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:58:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:58:19.050014 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72996959-59c2-4de1-a8ec-c8cf3b5d70bb None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:19.060869 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72996959-59c2-4de1-a8ec-c8cf3b5d70bb None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:19.065631 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac6a7f1-91fc-41b7-8ea5-28b51d83819e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:19.066465 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6a7f1-91fc-41b7-8ea5-28b51d83819e admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:19.066746 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6a7f1-91fc-41b7-8ea5-28b51d83819e admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:19.067021 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6a7f1-91fc-41b7-8ea5-28b51d83819e admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:19.067712 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac6a7f1-91fc-41b7-8ea5-28b51d83819e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:19.069679 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac6a7f1-91fc-41b7-8ea5-28b51d83819e admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:19.097351 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1393/2788] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:58:19 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:58:19.101574 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf07698-01d9-418e-97a5-7a1f87b913c0 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:19.112454 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf07698-01d9-418e-97a5-7a1f87b913c0 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:19.126081 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:58:19.172565 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de64c27-8f89-44bb-8f11-e40867a4e0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:19.173233 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de64c27-8f89-44bb-8f11-e40867a4e0d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:19.173518 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de64c27-8f89-44bb-8f11-e40867a4e0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:19.173796 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de64c27-8f89-44bb-8f11-e40867a4e0d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:19.174753 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de64c27-8f89-44bb-8f11-e40867a4e0d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:19.176752 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de64c27-8f89-44bb-8f11-e40867a4e0d5 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:19.204150 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1396/2789] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:58:19 2022] POST /identity/v3/users => generated 286 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 20:58:19.205292 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac6a7f1-91fc-41b7-8ea5-28b51d83819e admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:19.215661 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac6a7f1-91fc-41b7-8ea5-28b51d83819e admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:19.220716 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9315e-94e5-4ba3-8edf-74b86cc878a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:19.221405 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9315e-94e5-4ba3-8edf-74b86cc878a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:19.221794 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9315e-94e5-4ba3-8edf-74b86cc878a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:19.222072 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9315e-94e5-4ba3-8edf-74b86cc878a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:19.222796 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f9315e-94e5-4ba3-8edf-74b86cc878a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:19.224435 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f9315e-94e5-4ba3-8edf-74b86cc878a6 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:19.235893 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1394/2790] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:58:19.240109 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de64c27-8f89-44bb-8f11-e40867a4e0d5 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:19.251156 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de64c27-8f89-44bb-8f11-e40867a4e0d5 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:19.255826 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5913d9a-1f72-44f6-8524-d92b522ee4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:19.256514 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5913d9a-1f72-44f6-8524-d92b522ee4e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:19.256800 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5913d9a-1f72-44f6-8524-d92b522ee4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:19.257077 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5913d9a-1f72-44f6-8524-d92b522ee4e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:19.257837 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5913d9a-1f72-44f6-8524-d92b522ee4e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:19.259445 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5913d9a-1f72-44f6-8524-d92b522ee4e6 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:19.269343 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1397/2791] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:58:19.273316 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9315e-94e5-4ba3-8edf-74b86cc878a6 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:19.283860 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9315e-94e5-4ba3-8edf-74b86cc878a6 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:19.288562 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c373b6c-feb6-4c6d-a908-f7a398aed8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:19.289467 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c373b6c-feb6-4c6d-a908-f7a398aed8e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:19.289748 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c373b6c-feb6-4c6d-a908-f7a398aed8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:19.290021 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c373b6c-feb6-4c6d-a908-f7a398aed8e7 admin admin] PATH_INFO: `/v3/projects/7d397f88a4604e5f953f6fb96fa0074c/users/81bc0197fb484415a82ab457fc3f96f4/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:19.309488 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c373b6c-feb6-4c6d-a908-f7a398aed8e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d397f88a4604e5f953f6fb96fa0074c, user_id=81bc0197fb484415a82ab457fc3f96f4, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:19.312318 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c373b6c-feb6-4c6d-a908-f7a398aed8e7 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:19.325784 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1395/2792] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:58:19 2022] PUT /identity/v3/projects/7d397f88a4604e5f953f6fb96fa0074c/users/81bc0197fb484415a82ab457fc3f96f4/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:58:19.336424 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51085ee0-2f8d-4ea2-bd77-81e304c0d217 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:19.336720 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51085ee0-2f8d-4ea2-bd77-81e304c0d217 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:19.337028 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51085ee0-2f8d-4ea2-bd77-81e304c0d217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:19.372175 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-51085ee0-2f8d-4ea2-bd77-81e304c0d217 None None] MFA Rules not processed for user `81bc0197fb484415a82ab457fc3f96f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:58:19.373479 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-51085ee0-2f8d-4ea2-bd77-81e304c0d217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:19.438265 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1398/2793] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:58:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:58:19.449149 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c373b6c-feb6-4c6d-a908-f7a398aed8e7 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:19.450832 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-8c373b6c-feb6-4c6d-a908-f7a398aed8e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:19.460611 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:58:19.508824 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c373b6c-feb6-4c6d-a908-f7a398aed8e7 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:19.512507 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4664254-1a2c-4b1b-a195-47e21057f317 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:19.513155 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4664254-1a2c-4b1b-a195-47e21057f317 service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:19.513444 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4664254-1a2c-4b1b-a195-47e21057f317 service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:19.513728 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4664254-1a2c-4b1b-a195-47e21057f317 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:19.521905 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4664254-1a2c-4b1b-a195-47e21057f317 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:19.523341 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4664254-1a2c-4b1b-a195-47e21057f317 service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:19.532678 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1396/2794] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:58:19 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:58:19.552436 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51085ee0-2f8d-4ea2-bd77-81e304c0d217 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:19.613935 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51085ee0-2f8d-4ea2-bd77-81e304c0d217 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:19.618535 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb527c4-cd4c-4e26-8093-e0d24f840d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:19.619397 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb527c4-cd4c-4e26-8093-e0d24f840d8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:19.619710 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb527c4-cd4c-4e26-8093-e0d24f840d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:19.620026 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb527c4-cd4c-4e26-8093-e0d24f840d8b admin admin] PATH_INFO: `/v3/users/81bc0197fb484415a82ab457fc3f96f4` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:19.621238 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb527c4-cd4c-4e26-8093-e0d24f840d8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=81bc0197fb484415a82ab457fc3f96f4)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:19.623135 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb527c4-cd4c-4e26-8093-e0d24f840d8b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:19.652511 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:58:19.671862 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3eb527c4-cd4c-4e26-8093-e0d24f840d8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81bc0197fb484415a82ab457fc3f96f4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:19.672596 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3eb527c4-cd4c-4e26-8093-e0d24f840d8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81bc0197fb484415a82ab457fc3f96f4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:19.673292 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3eb527c4-cd4c-4e26-8093-e0d24f840d8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81bc0197fb484415a82ab457fc3f96f4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:19.687849 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3eb527c4-cd4c-4e26-8093-e0d24f840d8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81bc0197fb484415a82ab457fc3f96f4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:19.696486 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3eb527c4-cd4c-4e26-8093-e0d24f840d8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81bc0197fb484415a82ab457fc3f96f4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:19.709626 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1399/2795] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:58:19 2022] DELETE /identity/v3/users/81bc0197fb484415a82ab457fc3f96f4 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:58:19.714152 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6592c568-5c65-4855-9922-309609c62566 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:19.714952 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6592c568-5c65-4855-9922-309609c62566 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:19.715235 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6592c568-5c65-4855-9922-309609c62566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:19.732141 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-6592c568-5c65-4855-9922-309609c62566 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:58:19.733336 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-6592c568-5c65-4855-9922-309609c62566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:19.790547 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1397/2796] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:58:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:58:19.800276 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb527c4-cd4c-4e26-8093-e0d24f840d8b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:19.801680 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3eb527c4-cd4c-4e26-8093-e0d24f840d8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:19.864577 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb527c4-cd4c-4e26-8093-e0d24f840d8b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:19.868595 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5319d43a-a31f-4c90-90a2-a0ed6324ded1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:19.869274 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319d43a-a31f-4c90-90a2-a0ed6324ded1 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:19.869564 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319d43a-a31f-4c90-90a2-a0ed6324ded1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:19.869895 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319d43a-a31f-4c90-90a2-a0ed6324ded1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:19.880053 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5319d43a-a31f-4c90-90a2-a0ed6324ded1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:19.881495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5319d43a-a31f-4c90-90a2-a0ed6324ded1 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:19.891440 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1400/2797] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:58:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:58:20.160918 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6592c568-5c65-4855-9922-309609c62566 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:20.162411 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-6592c568-5c65-4855-9922-309609c62566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:20.183221 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6592c568-5c65-4855-9922-309609c62566 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:20.188229 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743bd3fb-b7eb-4432-95de-a8a1aa1bf7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:20.189132 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743bd3fb-b7eb-4432-95de-a8a1aa1bf7b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:20.189387 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743bd3fb-b7eb-4432-95de-a8a1aa1bf7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:20.189659 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743bd3fb-b7eb-4432-95de-a8a1aa1bf7b4 admin admin] PATH_INFO: `/v3/projects/7d397f88a4604e5f953f6fb96fa0074c` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:20.190867 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743bd3fb-b7eb-4432-95de-a8a1aa1bf7b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d397f88a4604e5f953f6fb96fa0074c)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:20.192807 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743bd3fb-b7eb-4432-95de-a8a1aa1bf7b4 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:20.239524 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-743bd3fb-b7eb-4432-95de-a8a1aa1bf7b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d397f88a4604e5f953f6fb96fa0074c', 'request_id': 'req-743bd3fb-b7eb-4432-95de-a8a1aa1bf7b4'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:20.246162 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-743bd3fb-b7eb-4432-95de-a8a1aa1bf7b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d397f88a4604e5f953f6fb96fa0074c', 'request_id': 'req-743bd3fb-b7eb-4432-95de-a8a1aa1bf7b4'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:20.253391 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-743bd3fb-b7eb-4432-95de-a8a1aa1bf7b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d397f88a4604e5f953f6fb96fa0074c', 'request_id': 'req-743bd3fb-b7eb-4432-95de-a8a1aa1bf7b4'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:20.265228 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-743bd3fb-b7eb-4432-95de-a8a1aa1bf7b4 admin admin] The token cache is being invalidate because project 7d397f88a4604e5f953f6fb96fa0074c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:58:20.265518 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-743bd3fb-b7eb-4432-95de-a8a1aa1bf7b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:20.266147 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-743bd3fb-b7eb-4432-95de-a8a1aa1bf7b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:20.267685 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1398/2798] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:58:20 2022] DELETE /identity/v3/projects/7d397f88a4604e5f953f6fb96fa0074c => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:58:20.272959 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19899a31-ec37-4be4-a119-f342e9be05ca None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:20.273412 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19899a31-ec37-4be4-a119-f342e9be05ca None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:20.273500 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19899a31-ec37-4be4-a119-f342e9be05ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:20.290597 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-19899a31-ec37-4be4-a119-f342e9be05ca None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:58:20.291796 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-19899a31-ec37-4be4-a119-f342e9be05ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:20.355504 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1401/2799] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:58:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:58:20.363495 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d992f29-15d9-4039-bfc4-2e9691e76c92 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:20.363792 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d992f29-15d9-4039-bfc4-2e9691e76c92 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:20.364127 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d992f29-15d9-4039-bfc4-2e9691e76c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:20.382584 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-7d992f29-15d9-4039-bfc4-2e9691e76c92 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:58:20.383776 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-7d992f29-15d9-4039-bfc4-2e9691e76c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:20.391720 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1399/2800] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:58:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:58:20.395666 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19899a31-ec37-4be4-a119-f342e9be05ca None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:20.405330 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19899a31-ec37-4be4-a119-f342e9be05ca None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:20.409804 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c9b16-52db-41d3-ae06-30919488505b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:20.410453 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c9b16-52db-41d3-ae06-30919488505b admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:20.410734 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c9b16-52db-41d3-ae06-30919488505b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:20.411010 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c9b16-52db-41d3-ae06-30919488505b admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:20.411731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c9b16-52db-41d3-ae06-30919488505b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:58:20.412072 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c9b16-52db-41d3-ae06-30919488505b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:20.413653 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c9b16-52db-41d3-ae06-30919488505b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:20.425985 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1402/2801] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:58:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:58:20.432877 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d992f29-15d9-4039-bfc4-2e9691e76c92 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:20.446175 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d992f29-15d9-4039-bfc4-2e9691e76c92 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:20.463055 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52214f48-0bc0-45c4-946b-a44a4cb78f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:20.463798 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52214f48-0bc0-45c4-946b-a44a4cb78f93 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:20.464216 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52214f48-0bc0-45c4-946b-a44a4cb78f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:20.464515 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52214f48-0bc0-45c4-946b-a44a4cb78f93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:20.465234 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52214f48-0bc0-45c4-946b-a44a4cb78f93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:20.467245 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52214f48-0bc0-45c4-946b-a44a4cb78f93 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:20.494224 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1400/2802] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:58:20 2022] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:58:20.499128 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c9b16-52db-41d3-ae06-30919488505b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:20.509141 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c9b16-52db-41d3-ae06-30919488505b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:20.540405 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:58:20.567719 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d05b0-bc4b-47ab-ae5a-4c0b381b9e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:20.568413 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d05b0-bc4b-47ab-ae5a-4c0b381b9e36 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:20.568698 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d05b0-bc4b-47ab-ae5a-4c0b381b9e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:20.568976 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d05b0-bc4b-47ab-ae5a-4c0b381b9e36 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:20.569654 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37d05b0-bc4b-47ab-ae5a-4c0b381b9e36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:20.571550 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37d05b0-bc4b-47ab-ae5a-4c0b381b9e36 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:20.593637 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1403/2803] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:58:20 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:58:20.594788 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52214f48-0bc0-45c4-946b-a44a4cb78f93 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:20.601415 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:58:20.606120 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52214f48-0bc0-45c4-946b-a44a4cb78f93 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:20.611828 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa193cd7-4d7f-4dfc-9a37-5078a4c2e11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:20.612808 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa193cd7-4d7f-4dfc-9a37-5078a4c2e11f admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:20.613113 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa193cd7-4d7f-4dfc-9a37-5078a4c2e11f admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:20.613577 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa193cd7-4d7f-4dfc-9a37-5078a4c2e11f admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:20.614487 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa193cd7-4d7f-4dfc-9a37-5078a4c2e11f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:20.616114 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa193cd7-4d7f-4dfc-9a37-5078a4c2e11f admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:20.626583 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1401/2804] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:58:20.630415 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d05b0-bc4b-47ab-ae5a-4c0b381b9e36 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:20.640788 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d05b0-bc4b-47ab-ae5a-4c0b381b9e36 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:20.645510 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b379861-ee85-47e5-9429-f7b1494bc011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:20.646103 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b379861-ee85-47e5-9429-f7b1494bc011 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:20.646384 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b379861-ee85-47e5-9429-f7b1494bc011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:20.646691 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b379861-ee85-47e5-9429-f7b1494bc011 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:20.647432 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b379861-ee85-47e5-9429-f7b1494bc011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:20.649017 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b379861-ee85-47e5-9429-f7b1494bc011 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:20.658696 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1404/2805] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:58:20.662530 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa193cd7-4d7f-4dfc-9a37-5078a4c2e11f admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:20.672831 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa193cd7-4d7f-4dfc-9a37-5078a4c2e11f admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:20.677731 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dae7b4-f7c1-4ab8-ad65-95a037772260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:20.678591 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dae7b4-f7c1-4ab8-ad65-95a037772260 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:20.678875 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dae7b4-f7c1-4ab8-ad65-95a037772260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:20.679153 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dae7b4-f7c1-4ab8-ad65-95a037772260 admin admin] PATH_INFO: `/v3/projects/40e451a05fd04224a560cb13dc604aff/users/548e61bb910644e5abb93ffb1dabc9e2/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:20.694521 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dae7b4-f7c1-4ab8-ad65-95a037772260 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40e451a05fd04224a560cb13dc604aff, user_id=548e61bb910644e5abb93ffb1dabc9e2, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:20.697212 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dae7b4-f7c1-4ab8-ad65-95a037772260 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:20.710537 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1402/2806] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:58:20 2022] PUT /identity/v3/projects/40e451a05fd04224a560cb13dc604aff/users/548e61bb910644e5abb93ffb1dabc9e2/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:58:20.721369 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091173f-58c0-4469-a126-6825256db854 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:20.721667 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091173f-58c0-4469-a126-6825256db854 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:20.721952 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091173f-58c0-4469-a126-6825256db854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:20.749678 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-d091173f-58c0-4469-a126-6825256db854 None None] MFA Rules not processed for user `548e61bb910644e5abb93ffb1dabc9e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:58:20.750898 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d091173f-58c0-4469-a126-6825256db854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:20.823623 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1405/2807] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:58:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:58:20.834370 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dae7b4-f7c1-4ab8-ad65-95a037772260 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:20.836143 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-79dae7b4-f7c1-4ab8-ad65-95a037772260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:20.893650 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dae7b4-f7c1-4ab8-ad65-95a037772260 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:20.897354 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367f9287-9a28-4010-ab02-4c6825d292ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:20.897940 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f9287-9a28-4010-ab02-4c6825d292ca service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:20.898226 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f9287-9a28-4010-ab02-4c6825d292ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:20.898505 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f9287-9a28-4010-ab02-4c6825d292ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:20.907232 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367f9287-9a28-4010-ab02-4c6825d292ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:20.908684 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367f9287-9a28-4010-ab02-4c6825d292ca service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:20.918099 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1403/2808] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:58:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:58:24.926924 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d091173f-58c0-4469-a126-6825256db854 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:24.987720 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d091173f-58c0-4469-a126-6825256db854 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:24.992262 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075aacc1-f5b7-4990-8ab0-6b1df19653bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:24.993128 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075aacc1-f5b7-4990-8ab0-6b1df19653bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:24.993414 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075aacc1-f5b7-4990-8ab0-6b1df19653bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:24.993689 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075aacc1-f5b7-4990-8ab0-6b1df19653bd admin admin] PATH_INFO: `/v3/users/548e61bb910644e5abb93ffb1dabc9e2` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:24.995134 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075aacc1-f5b7-4990-8ab0-6b1df19653bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=548e61bb910644e5abb93ffb1dabc9e2)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:24.997088 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075aacc1-f5b7-4990-8ab0-6b1df19653bd admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:25.041140 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:58:25.042660 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-075aacc1-f5b7-4990-8ab0-6b1df19653bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '548e61bb910644e5abb93ffb1dabc9e2'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:25.043406 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-075aacc1-f5b7-4990-8ab0-6b1df19653bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '548e61bb910644e5abb93ffb1dabc9e2'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:25.044267 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-075aacc1-f5b7-4990-8ab0-6b1df19653bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '548e61bb910644e5abb93ffb1dabc9e2'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:25.057720 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-075aacc1-f5b7-4990-8ab0-6b1df19653bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '548e61bb910644e5abb93ffb1dabc9e2'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:25.077132 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-075aacc1-f5b7-4990-8ab0-6b1df19653bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '548e61bb910644e5abb93ffb1dabc9e2'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:25.099444 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1406/2809] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:58:24 2022] DELETE /identity/v3/users/548e61bb910644e5abb93ffb1dabc9e2 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:58:25.104754 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36f6dc-ba85-43ec-b859-b297b3286a70 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:25.105231 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36f6dc-ba85-43ec-b859-b297b3286a70 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:25.105462 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36f6dc-ba85-43ec-b859-b297b3286a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:25.122957 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-2b36f6dc-ba85-43ec-b859-b297b3286a70 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:58:25.124500 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-2b36f6dc-ba85-43ec-b859-b297b3286a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:25.185814 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1404/2810] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:58:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 20:58:25.195415 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075aacc1-f5b7-4990-8ab0-6b1df19653bd admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:25.196824 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-075aacc1-f5b7-4990-8ab0-6b1df19653bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:25.252725 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075aacc1-f5b7-4990-8ab0-6b1df19653bd admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:25.256367 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a9a08-a9a8-41b0-9e09-24c8e794ab0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:25.257013 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a9a08-a9a8-41b0-9e09-24c8e794ab0f service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:25.257297 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a9a08-a9a8-41b0-9e09-24c8e794ab0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:25.257577 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a9a08-a9a8-41b0-9e09-24c8e794ab0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:25.267067 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a9a08-a9a8-41b0-9e09-24c8e794ab0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:25.268537 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a9a08-a9a8-41b0-9e09-24c8e794ab0f service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:25.277842 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1407/2811] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:58:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:58:25.544205 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b36f6dc-ba85-43ec-b859-b297b3286a70 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:25.546075 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-2b36f6dc-ba85-43ec-b859-b297b3286a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:25.561111 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b36f6dc-ba85-43ec-b859-b297b3286a70 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:25.565928 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab303c6-ff5c-488f-a17c-beaa3bde50ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:25.566874 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab303c6-ff5c-488f-a17c-beaa3bde50ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:25.567166 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab303c6-ff5c-488f-a17c-beaa3bde50ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:25.567443 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab303c6-ff5c-488f-a17c-beaa3bde50ad admin admin] PATH_INFO: `/v3/projects/40e451a05fd04224a560cb13dc604aff` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:25.568688 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab303c6-ff5c-488f-a17c-beaa3bde50ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=40e451a05fd04224a560cb13dc604aff)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:25.570610 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab303c6-ff5c-488f-a17c-beaa3bde50ad admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:25.626078 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-3ab303c6-ff5c-488f-a17c-beaa3bde50ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40e451a05fd04224a560cb13dc604aff', 'request_id': 'req-3ab303c6-ff5c-488f-a17c-beaa3bde50ad'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:25.631744 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-3ab303c6-ff5c-488f-a17c-beaa3bde50ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40e451a05fd04224a560cb13dc604aff', 'request_id': 'req-3ab303c6-ff5c-488f-a17c-beaa3bde50ad'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:25.639033 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-3ab303c6-ff5c-488f-a17c-beaa3bde50ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40e451a05fd04224a560cb13dc604aff', 'request_id': 'req-3ab303c6-ff5c-488f-a17c-beaa3bde50ad'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:25.641023 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:58:25.652226 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-3ab303c6-ff5c-488f-a17c-beaa3bde50ad admin admin] The token cache is being invalidate because project 40e451a05fd04224a560cb13dc604aff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:58:25.652652 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-3ab303c6-ff5c-488f-a17c-beaa3bde50ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:25.653443 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-3ab303c6-ff5c-488f-a17c-beaa3bde50ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:25.655041 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1405/2812] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:58:25 2022] DELETE /identity/v3/projects/40e451a05fd04224a560cb13dc604aff => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:58:25.659770 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5262548d-49cc-43a6-aae8-717e33b03f56 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:25.660089 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5262548d-49cc-43a6-aae8-717e33b03f56 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:25.660359 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5262548d-49cc-43a6-aae8-717e33b03f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:25.678427 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-5262548d-49cc-43a6-aae8-717e33b03f56 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:58:25.679692 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5262548d-49cc-43a6-aae8-717e33b03f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:25.739800 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1408/2813] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:58:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:58:25.747933 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3226eb-1a5b-4ba2-87ef-7d267039d810 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:25.748233 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3226eb-1a5b-4ba2-87ef-7d267039d810 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:25.748515 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3226eb-1a5b-4ba2-87ef-7d267039d810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:25.766268 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-cd3226eb-1a5b-4ba2-87ef-7d267039d810 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:58:25.767446 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-cd3226eb-1a5b-4ba2-87ef-7d267039d810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:25.775263 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1406/2814] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:58:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:58:25.779252 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5262548d-49cc-43a6-aae8-717e33b03f56 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:25.788729 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5262548d-49cc-43a6-aae8-717e33b03f56 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:25.793704 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945f2de-fc79-4ebf-855a-f44d83bc5440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:25.794340 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945f2de-fc79-4ebf-855a-f44d83bc5440 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:25.794622 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945f2de-fc79-4ebf-855a-f44d83bc5440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:25.794897 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945f2de-fc79-4ebf-855a-f44d83bc5440 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:25.795610 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a945f2de-fc79-4ebf-855a-f44d83bc5440 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:58:25.795934 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a945f2de-fc79-4ebf-855a-f44d83bc5440 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:25.797516 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a945f2de-fc79-4ebf-855a-f44d83bc5440 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:25.809496 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1409/2815] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:58:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:58:25.813432 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3226eb-1a5b-4ba2-87ef-7d267039d810 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:25.822419 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3226eb-1a5b-4ba2-87ef-7d267039d810 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:25.827044 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b30ca-8c96-49cc-8f5f-caf2d9f95a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:25.827685 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b30ca-8c96-49cc-8f5f-caf2d9f95a08 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:25.827998 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b30ca-8c96-49cc-8f5f-caf2d9f95a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:25.828277 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b30ca-8c96-49cc-8f5f-caf2d9f95a08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:25.828958 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1b30ca-8c96-49cc-8f5f-caf2d9f95a08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:25.830840 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1b30ca-8c96-49cc-8f5f-caf2d9f95a08 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:25.860296 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1407/2816] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:58:25 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:58:25.862275 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945f2de-fc79-4ebf-855a-f44d83bc5440 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:25.873853 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945f2de-fc79-4ebf-855a-f44d83bc5440 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:25.924742 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:58:25.935403 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac0934b-2dcc-46cf-a8f3-765b90add0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:25.936105 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0934b-2dcc-46cf-a8f3-765b90add0b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:25.936389 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0934b-2dcc-46cf-a8f3-765b90add0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:25.936666 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0934b-2dcc-46cf-a8f3-765b90add0b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:25.937392 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac0934b-2dcc-46cf-a8f3-765b90add0b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:25.939293 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac0934b-2dcc-46cf-a8f3-765b90add0b0 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:25.958057 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1410/2817] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:58:25 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:58:25.962126 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b30ca-8c96-49cc-8f5f-caf2d9f95a08 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:25.972730 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b30ca-8c96-49cc-8f5f-caf2d9f95a08 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:25.977232 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c765a88-876b-4002-b45f-a69866497ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:25.977884 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c765a88-876b-4002-b45f-a69866497ed4 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:25.978171 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c765a88-876b-4002-b45f-a69866497ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:25.978448 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c765a88-876b-4002-b45f-a69866497ed4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:25.979169 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c765a88-876b-4002-b45f-a69866497ed4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:25.981361 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c765a88-876b-4002-b45f-a69866497ed4 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:25.991471 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1408/2818] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:58:25.995100 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac0934b-2dcc-46cf-a8f3-765b90add0b0 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:26.004956 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac0934b-2dcc-46cf-a8f3-765b90add0b0 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:26.009519 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d9a4e-f7bb-4a4f-a3d8-e773e5eaef06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:26.010163 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d9a4e-f7bb-4a4f-a3d8-e773e5eaef06 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:26.010446 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d9a4e-f7bb-4a4f-a3d8-e773e5eaef06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:26.010722 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d9a4e-f7bb-4a4f-a3d8-e773e5eaef06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:26.011495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d9a4e-f7bb-4a4f-a3d8-e773e5eaef06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:26.013090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d9a4e-f7bb-4a4f-a3d8-e773e5eaef06 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:26.025058 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1411/2819] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:58:26.029888 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c765a88-876b-4002-b45f-a69866497ed4 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:26.041092 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c765a88-876b-4002-b45f-a69866497ed4 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:26.047100 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a5370-8d39-436d-8a75-7e59a13658c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:26.048210 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a5370-8d39-436d-8a75-7e59a13658c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:26.048526 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a5370-8d39-436d-8a75-7e59a13658c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:26.049147 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a5370-8d39-436d-8a75-7e59a13658c2 admin admin] PATH_INFO: `/v3/projects/b7de598eeefe40f3a63a02f6129d4830/users/0a381c28df6f4b99b90ef865790314d9/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:26.065818 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769a5370-8d39-436d-8a75-7e59a13658c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7de598eeefe40f3a63a02f6129d4830, user_id=0a381c28df6f4b99b90ef865790314d9, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:26.068483 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769a5370-8d39-436d-8a75-7e59a13658c2 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:26.080963 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1409/2820] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:58:26 2022] PUT /identity/v3/projects/b7de598eeefe40f3a63a02f6129d4830/users/0a381c28df6f4b99b90ef865790314d9/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:58:26.092449 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509d5a7-74df-4fde-82fb-ca5bf85de5c0 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:26.092770 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509d5a7-74df-4fde-82fb-ca5bf85de5c0 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:26.093054 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509d5a7-74df-4fde-82fb-ca5bf85de5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:26.119666 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-8509d5a7-74df-4fde-82fb-ca5bf85de5c0 None None] MFA Rules not processed for user `0a381c28df6f4b99b90ef865790314d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:58:26.120923 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8509d5a7-74df-4fde-82fb-ca5bf85de5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:26.183093 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1412/2821] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:58:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:58:26.187386 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a5370-8d39-436d-8a75-7e59a13658c2 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:26.252506 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a5370-8d39-436d-8a75-7e59a13658c2 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:26.257423 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1fd71e-c45e-4cc4-9306-99b5fbacd74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:26.258093 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fd71e-c45e-4cc4-9306-99b5fbacd74d admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:26.258379 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fd71e-c45e-4cc4-9306-99b5fbacd74d admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:26.258659 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fd71e-c45e-4cc4-9306-99b5fbacd74d admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:26.259356 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1fd71e-c45e-4cc4-9306-99b5fbacd74d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:26.261320 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1fd71e-c45e-4cc4-9306-99b5fbacd74d admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:26.287056 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1410/2822] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:58:26 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:58:26.291042 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509d5a7-74df-4fde-82fb-ca5bf85de5c0 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:26.302423 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509d5a7-74df-4fde-82fb-ca5bf85de5c0 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:26.360152 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd73d3-12dc-40f0-b5c2-ed5eba5e377e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:26.360818 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd73d3-12dc-40f0-b5c2-ed5eba5e377e admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:26.361104 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd73d3-12dc-40f0-b5c2-ed5eba5e377e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:26.361383 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd73d3-12dc-40f0-b5c2-ed5eba5e377e admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:26.362103 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdd73d3-12dc-40f0-b5c2-ed5eba5e377e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:26.364026 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdd73d3-12dc-40f0-b5c2-ed5eba5e377e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:26.382848 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1413/2823] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:58:26 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:58:26.387423 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1fd71e-c45e-4cc4-9306-99b5fbacd74d admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:26.397794 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1fd71e-c45e-4cc4-9306-99b5fbacd74d admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:26.403033 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8215b-f41a-41e8-90c7-ef44b60475cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:26.403690 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8215b-f41a-41e8-90c7-ef44b60475cc admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:26.404017 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8215b-f41a-41e8-90c7-ef44b60475cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:26.404301 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8215b-f41a-41e8-90c7-ef44b60475cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:26.405034 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b8215b-f41a-41e8-90c7-ef44b60475cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:26.406726 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b8215b-f41a-41e8-90c7-ef44b60475cc admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:26.417262 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1411/2824] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 20:58:26.421042 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd73d3-12dc-40f0-b5c2-ed5eba5e377e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:26.438166 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd73d3-12dc-40f0-b5c2-ed5eba5e377e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:26.442699 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec8ebe-a7dd-420f-a10c-1ff25b362b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:26.443357 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec8ebe-a7dd-420f-a10c-1ff25b362b74 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:26.443650 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec8ebe-a7dd-420f-a10c-1ff25b362b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:26.443967 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec8ebe-a7dd-420f-a10c-1ff25b362b74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:26.444679 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec8ebe-a7dd-420f-a10c-1ff25b362b74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:26.446246 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec8ebe-a7dd-420f-a10c-1ff25b362b74 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:26.456898 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1414/2825] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:58:26.461126 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8215b-f41a-41e8-90c7-ef44b60475cc admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:26.472070 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8215b-f41a-41e8-90c7-ef44b60475cc admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:26.476818 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a7293-922f-48a0-adbf-26fcd2d64034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:26.477848 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a7293-922f-48a0-adbf-26fcd2d64034 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:26.478135 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a7293-922f-48a0-adbf-26fcd2d64034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:26.478417 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a7293-922f-48a0-adbf-26fcd2d64034 admin admin] PATH_INFO: `/v3/projects/b4b0933c90304cc485e2c8f349d80c13/users/5267398ecce140dc89756073c125fd27/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:26.505818 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a7293-922f-48a0-adbf-26fcd2d64034 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4b0933c90304cc485e2c8f349d80c13, user_id=5267398ecce140dc89756073c125fd27, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:26.508520 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a7293-922f-48a0-adbf-26fcd2d64034 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:26.526138 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1412/2826] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:58:26 2022] PUT /identity/v3/projects/b4b0933c90304cc485e2c8f349d80c13/users/5267398ecce140dc89756073c125fd27/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:58:26.538618 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b796734-1749-448f-93fc-a47a9aaa85be None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:26.538907 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b796734-1749-448f-93fc-a47a9aaa85be None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:26.539187 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b796734-1749-448f-93fc-a47a9aaa85be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:26.572676 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-7b796734-1749-448f-93fc-a47a9aaa85be None None] MFA Rules not processed for user `5267398ecce140dc89756073c125fd27`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:58:26.573912 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7b796734-1749-448f-93fc-a47a9aaa85be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:26.603473 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:58:26.638912 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1415/2827] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:58:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 20:58:26.643457 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a7293-922f-48a0-adbf-26fcd2d64034 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:26.689407 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:58:26.707696 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a7293-922f-48a0-adbf-26fcd2d64034 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:26.712340 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae64716-807a-4f66-9b8f-006a07edec4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:26.712989 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae64716-807a-4f66-9b8f-006a07edec4d admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:26.713274 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae64716-807a-4f66-9b8f-006a07edec4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:26.713578 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae64716-807a-4f66-9b8f-006a07edec4d admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:26.714260 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae64716-807a-4f66-9b8f-006a07edec4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:26.716244 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae64716-807a-4f66-9b8f-006a07edec4d admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:26.745095 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1413/2828] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:58:26 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 20:58:26.746378 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b796734-1749-448f-93fc-a47a9aaa85be None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:26.757554 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b796734-1749-448f-93fc-a47a9aaa85be None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:26.814009 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fbcc85-dca4-47d7-a8d5-c17d9b0d7308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:26.814716 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fbcc85-dca4-47d7-a8d5-c17d9b0d7308 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:26.815003 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fbcc85-dca4-47d7-a8d5-c17d9b0d7308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:26.815282 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fbcc85-dca4-47d7-a8d5-c17d9b0d7308 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:26.816045 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fbcc85-dca4-47d7-a8d5-c17d9b0d7308 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:26.817986 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fbcc85-dca4-47d7-a8d5-c17d9b0d7308 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:26.837692 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1416/2829] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:58:26 2022] POST /identity/v3/users => generated 298 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:58:26.841876 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae64716-807a-4f66-9b8f-006a07edec4d admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:26.852153 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae64716-807a-4f66-9b8f-006a07edec4d admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:26.856800 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b441ee-f62c-434c-9dff-545556d39e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:26.857466 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b441ee-f62c-434c-9dff-545556d39e52 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:26.857762 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b441ee-f62c-434c-9dff-545556d39e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:26.858046 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b441ee-f62c-434c-9dff-545556d39e52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:26.858776 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b441ee-f62c-434c-9dff-545556d39e52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:26.860416 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b441ee-f62c-434c-9dff-545556d39e52 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:26.871544 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1414/2830] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:58:26.876290 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fbcc85-dca4-47d7-a8d5-c17d9b0d7308 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:26.886467 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fbcc85-dca4-47d7-a8d5-c17d9b0d7308 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:26.895958 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657c254-a0ef-48e6-9b33-5bee39fbfb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:26.896841 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657c254-a0ef-48e6-9b33-5bee39fbfb26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:26.898490 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657c254-a0ef-48e6-9b33-5bee39fbfb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:26.898778 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657c254-a0ef-48e6-9b33-5bee39fbfb26 admin admin] PATH_INFO: `/v3/projects/5ef9eb287eba4653a780a9d72d759fb5/users/064b71873f804dd095553aa3fb1ad194/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:26.916232 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a657c254-a0ef-48e6-9b33-5bee39fbfb26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ef9eb287eba4653a780a9d72d759fb5, user_id=064b71873f804dd095553aa3fb1ad194, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:26.918846 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a657c254-a0ef-48e6-9b33-5bee39fbfb26 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:26.931341 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1417/2831] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:58:26 2022] PUT /identity/v3/projects/5ef9eb287eba4653a780a9d72d759fb5/users/064b71873f804dd095553aa3fb1ad194/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:58:26.935906 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b441ee-f62c-434c-9dff-545556d39e52 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:26.947325 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b441ee-f62c-434c-9dff-545556d39e52 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:27.006402 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb09934e-9541-45f0-babb-5216deb5fa8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:27.007135 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09934e-9541-45f0-babb-5216deb5fa8d admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:27.007425 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09934e-9541-45f0-babb-5216deb5fa8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:27.007711 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09934e-9541-45f0-babb-5216deb5fa8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:27.008480 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb09934e-9541-45f0-babb-5216deb5fa8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:27.010079 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb09934e-9541-45f0-babb-5216deb5fa8d admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:27.020334 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1415/2832] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:58:27.024568 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657c254-a0ef-48e6-9b33-5bee39fbfb26 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:27.034768 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657c254-a0ef-48e6-9b33-5bee39fbfb26 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:27.039313 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083eea83-58ef-43cf-989c-ce9bf880d129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:27.040223 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083eea83-58ef-43cf-989c-ce9bf880d129 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:27.040508 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083eea83-58ef-43cf-989c-ce9bf880d129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:27.040783 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083eea83-58ef-43cf-989c-ce9bf880d129 admin admin] PATH_INFO: `/v3/projects/5ef9eb287eba4653a780a9d72d759fb5/users/064b71873f804dd095553aa3fb1ad194/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:27.042713 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083eea83-58ef-43cf-989c-ce9bf880d129 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ef9eb287eba4653a780a9d72d759fb5, user_id=064b71873f804dd095553aa3fb1ad194, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:27.045634 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083eea83-58ef-43cf-989c-ce9bf880d129 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:27.055785 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1418/2833] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:58:27 2022] PUT /identity/v3/projects/5ef9eb287eba4653a780a9d72d759fb5/users/064b71873f804dd095553aa3fb1ad194/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:58:27.066073 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f527a08-c658-495a-9312-597bb8c46c84 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:27.066400 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f527a08-c658-495a-9312-597bb8c46c84 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:27.066685 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f527a08-c658-495a-9312-597bb8c46c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:27.093847 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-3f527a08-c658-495a-9312-597bb8c46c84 None None] MFA Rules not processed for user `064b71873f804dd095553aa3fb1ad194`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:58:27.095088 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-3f527a08-c658-495a-9312-597bb8c46c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:27.161240 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1416/2834] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:58:27 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:58:27.172687 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083eea83-58ef-43cf-989c-ce9bf880d129 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:27.174659 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-083eea83-58ef-43cf-989c-ce9bf880d129 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:27.230727 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083eea83-58ef-43cf-989c-ce9bf880d129 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:27.234269 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e0aca-5379-4025-a8e2-1f523193a323 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:27.234914 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e0aca-5379-4025-a8e2-1f523193a323 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:27.235200 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e0aca-5379-4025-a8e2-1f523193a323 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:27.235481 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e0aca-5379-4025-a8e2-1f523193a323 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:27.268645 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:58:27.291635 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87e0aca-5379-4025-a8e2-1f523193a323 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:27.293693 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87e0aca-5379-4025-a8e2-1f523193a323 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:27.302703 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1419/2835] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:58:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:58:30.883228 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f527a08-c658-495a-9312-597bb8c46c84 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:30.893647 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f527a08-c658-495a-9312-597bb8c46c84 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:30.897140 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314edd5-6493-4884-a562-463b723b4f42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:30.897780 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314edd5-6493-4884-a562-463b723b4f42 service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:30.898069 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314edd5-6493-4884-a562-463b723b4f42 service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:30.898350 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314edd5-6493-4884-a562-463b723b4f42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:30.932494 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:58:30.959494 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3314edd5-6493-4884-a562-463b723b4f42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:30.961043 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3314edd5-6493-4884-a562-463b723b4f42 service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:30.970702 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1417/2836] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:58:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:58:31.550378 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e0aca-5379-4025-a8e2-1f523193a323 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:31.559676 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e0aca-5379-4025-a8e2-1f523193a323 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:31.563355 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e50468d-d22a-4670-bc74-4ddaf6ce0507 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:31.564025 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50468d-d22a-4670-bc74-4ddaf6ce0507 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:31.564310 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50468d-d22a-4670-bc74-4ddaf6ce0507 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:31.564587 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50468d-d22a-4670-bc74-4ddaf6ce0507 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:31.573418 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e50468d-d22a-4670-bc74-4ddaf6ce0507 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:31.575396 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e50468d-d22a-4670-bc74-4ddaf6ce0507 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:31.584957 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1420/2837] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:58:31 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:58:35.421716 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314edd5-6493-4884-a562-463b723b4f42 service cinder] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:35.485300 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314edd5-6493-4884-a562-463b723b4f42 service cinder] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:35.489855 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2dad2-156b-4ec9-918e-ce51fb5dab81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:35.490734 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2dad2-156b-4ec9-918e-ce51fb5dab81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:35.491022 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2dad2-156b-4ec9-918e-ce51fb5dab81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:35.491299 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2dad2-156b-4ec9-918e-ce51fb5dab81 admin admin] PATH_INFO: `/v3/users/0a381c28df6f4b99b90ef865790314d9` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:35.492512 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd2dad2-156b-4ec9-918e-ce51fb5dab81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a381c28df6f4b99b90ef865790314d9)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:35.494428 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd2dad2-156b-4ec9-918e-ce51fb5dab81 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:35.542920 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-ccd2dad2-156b-4ec9-918e-ce51fb5dab81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a381c28df6f4b99b90ef865790314d9'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:35.543667 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-ccd2dad2-156b-4ec9-918e-ce51fb5dab81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a381c28df6f4b99b90ef865790314d9'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:35.552961 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-ccd2dad2-156b-4ec9-918e-ce51fb5dab81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a381c28df6f4b99b90ef865790314d9'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:35.565346 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-ccd2dad2-156b-4ec9-918e-ce51fb5dab81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a381c28df6f4b99b90ef865790314d9'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:35.566019 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-ccd2dad2-156b-4ec9-918e-ce51fb5dab81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a381c28df6f4b99b90ef865790314d9'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:35.578469 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1418/2838] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:58:35 2022] DELETE /identity/v3/users/0a381c28df6f4b99b90ef865790314d9 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:58:35.584731 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9378c23-275d-4424-9daf-a33165bb1924 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:35.585167 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9378c23-275d-4424-9daf-a33165bb1924 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:35.585317 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9378c23-275d-4424-9daf-a33165bb1924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:35.606973 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c9378c23-275d-4424-9daf-a33165bb1924 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:58:35.608735 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c9378c23-275d-4424-9daf-a33165bb1924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:35.667570 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1421/2839] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:58:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:58:35.677555 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2dad2-156b-4ec9-918e-ce51fb5dab81 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:35.678984 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-ccd2dad2-156b-4ec9-918e-ce51fb5dab81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:35.736113 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2dad2-156b-4ec9-918e-ce51fb5dab81 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:35.739818 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb85f83c-bae5-497d-9210-27f28b9d918f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:35.740496 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85f83c-bae5-497d-9210-27f28b9d918f service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:35.740786 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85f83c-bae5-497d-9210-27f28b9d918f service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:35.741071 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85f83c-bae5-497d-9210-27f28b9d918f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:35.750193 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb85f83c-bae5-497d-9210-27f28b9d918f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:35.751621 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb85f83c-bae5-497d-9210-27f28b9d918f service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:35.755720 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:58:35.763506 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1419/2840] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:58:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:58:36.078469 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9378c23-275d-4424-9daf-a33165bb1924 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:36.080115 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c9378c23-275d-4424-9daf-a33165bb1924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:36.104061 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9378c23-275d-4424-9daf-a33165bb1924 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:36.104061 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15bb612-82fc-47b9-a387-14f9514a8c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:36.104345 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bb612-82fc-47b9-a387-14f9514a8c66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:36.105014 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bb612-82fc-47b9-a387-14f9514a8c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:36.105014 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bb612-82fc-47b9-a387-14f9514a8c66 admin admin] PATH_INFO: `/v3/projects/b7de598eeefe40f3a63a02f6129d4830` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:36.105948 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15bb612-82fc-47b9-a387-14f9514a8c66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7de598eeefe40f3a63a02f6129d4830)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:36.108035 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15bb612-82fc-47b9-a387-14f9514a8c66 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:36.160774 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e15bb612-82fc-47b9-a387-14f9514a8c66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7de598eeefe40f3a63a02f6129d4830', 'request_id': 'req-e15bb612-82fc-47b9-a387-14f9514a8c66'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:36.168871 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e15bb612-82fc-47b9-a387-14f9514a8c66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7de598eeefe40f3a63a02f6129d4830', 'request_id': 'req-e15bb612-82fc-47b9-a387-14f9514a8c66'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:36.174852 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e15bb612-82fc-47b9-a387-14f9514a8c66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7de598eeefe40f3a63a02f6129d4830', 'request_id': 'req-e15bb612-82fc-47b9-a387-14f9514a8c66'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:36.185633 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e15bb612-82fc-47b9-a387-14f9514a8c66 admin admin] The token cache is being invalidate because project b7de598eeefe40f3a63a02f6129d4830 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:58:36.186432 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e15bb612-82fc-47b9-a387-14f9514a8c66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:36.187054 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e15bb612-82fc-47b9-a387-14f9514a8c66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:36.188601 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1422/2841] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:58:36 2022] DELETE /identity/v3/projects/b7de598eeefe40f3a63a02f6129d4830 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:58:36.192492 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb85f83c-bae5-497d-9210-27f28b9d918f service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:36.202669 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb85f83c-bae5-497d-9210-27f28b9d918f service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:36.256681 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec487c0-7ca2-4562-9882-5ea1b4e4cd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:36.257546 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec487c0-7ca2-4562-9882-5ea1b4e4cd4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:36.257829 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec487c0-7ca2-4562-9882-5ea1b4e4cd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:36.258107 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec487c0-7ca2-4562-9882-5ea1b4e4cd4d admin admin] PATH_INFO: `/v3/users/5267398ecce140dc89756073c125fd27` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:36.259271 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec487c0-7ca2-4562-9882-5ea1b4e4cd4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5267398ecce140dc89756073c125fd27)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:36.261206 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec487c0-7ca2-4562-9882-5ea1b4e4cd4d admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:36.310720 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-fec487c0-7ca2-4562-9882-5ea1b4e4cd4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5267398ecce140dc89756073c125fd27'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:36.311861 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-fec487c0-7ca2-4562-9882-5ea1b4e4cd4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5267398ecce140dc89756073c125fd27'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:36.319075 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-fec487c0-7ca2-4562-9882-5ea1b4e4cd4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5267398ecce140dc89756073c125fd27'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:36.333320 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-fec487c0-7ca2-4562-9882-5ea1b4e4cd4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5267398ecce140dc89756073c125fd27'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:36.334375 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-fec487c0-7ca2-4562-9882-5ea1b4e4cd4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5267398ecce140dc89756073c125fd27'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:36.346763 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1420/2842] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:58:36 2022] DELETE /identity/v3/users/5267398ecce140dc89756073c125fd27 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:58:36.606098 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15bb612-82fc-47b9-a387-14f9514a8c66 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:36.607551 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e15bb612-82fc-47b9-a387-14f9514a8c66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:36.622028 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15bb612-82fc-47b9-a387-14f9514a8c66 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:36.667350 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:58:36.681691 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f50d37-3617-45ee-807b-19058a22e1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:36.682553 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f50d37-3617-45ee-807b-19058a22e1dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:36.682832 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f50d37-3617-45ee-807b-19058a22e1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:36.683107 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f50d37-3617-45ee-807b-19058a22e1dc admin admin] PATH_INFO: `/v3/projects/b4b0933c90304cc485e2c8f349d80c13` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:36.684308 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f50d37-3617-45ee-807b-19058a22e1dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4b0933c90304cc485e2c8f349d80c13)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:36.686807 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f50d37-3617-45ee-807b-19058a22e1dc admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:36.730271 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b5f50d37-3617-45ee-807b-19058a22e1dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4b0933c90304cc485e2c8f349d80c13', 'request_id': 'req-b5f50d37-3617-45ee-807b-19058a22e1dc'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:36.738004 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b5f50d37-3617-45ee-807b-19058a22e1dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4b0933c90304cc485e2c8f349d80c13', 'request_id': 'req-b5f50d37-3617-45ee-807b-19058a22e1dc'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:36.743684 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b5f50d37-3617-45ee-807b-19058a22e1dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4b0933c90304cc485e2c8f349d80c13', 'request_id': 'req-b5f50d37-3617-45ee-807b-19058a22e1dc'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:36.754803 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b5f50d37-3617-45ee-807b-19058a22e1dc admin admin] The token cache is being invalidate because project b4b0933c90304cc485e2c8f349d80c13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:58:36.755089 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b5f50d37-3617-45ee-807b-19058a22e1dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:36.755718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b5f50d37-3617-45ee-807b-19058a22e1dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:36.757238 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1423/2843] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:58:36 2022] DELETE /identity/v3/projects/b4b0933c90304cc485e2c8f349d80c13 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:58:36.761110 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec487c0-7ca2-4562-9882-5ea1b4e4cd4d admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:36.762598 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-fec487c0-7ca2-4562-9882-5ea1b4e4cd4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:36.775337 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec487c0-7ca2-4562-9882-5ea1b4e4cd4d admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:36.832317 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b081ec19-f747-4ff3-b9b8-204e99d7fd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:36.833200 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081ec19-f747-4ff3-b9b8-204e99d7fd42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:36.833488 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081ec19-f747-4ff3-b9b8-204e99d7fd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:36.833767 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081ec19-f747-4ff3-b9b8-204e99d7fd42 admin admin] PATH_INFO: `/v3/users/064b71873f804dd095553aa3fb1ad194` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:36.834944 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b081ec19-f747-4ff3-b9b8-204e99d7fd42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=064b71873f804dd095553aa3fb1ad194)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:36.836903 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b081ec19-f747-4ff3-b9b8-204e99d7fd42 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:36.859283 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:58:36.886522 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-b081ec19-f747-4ff3-b9b8-204e99d7fd42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '064b71873f804dd095553aa3fb1ad194'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:36.887100 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-b081ec19-f747-4ff3-b9b8-204e99d7fd42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '064b71873f804dd095553aa3fb1ad194'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:36.893835 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-b081ec19-f747-4ff3-b9b8-204e99d7fd42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '064b71873f804dd095553aa3fb1ad194'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:36.906312 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-b081ec19-f747-4ff3-b9b8-204e99d7fd42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '064b71873f804dd095553aa3fb1ad194'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:36.906966 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-b081ec19-f747-4ff3-b9b8-204e99d7fd42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '064b71873f804dd095553aa3fb1ad194'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:36.919070 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1421/2844] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:58:36 2022] DELETE /identity/v3/users/064b71873f804dd095553aa3fb1ad194 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:58:36.971817 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f50d37-3617-45ee-807b-19058a22e1dc admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:36.973595 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b5f50d37-3617-45ee-807b-19058a22e1dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:36.987697 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f50d37-3617-45ee-807b-19058a22e1dc admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:37.050024 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ffdff-ce19-42c1-bddf-4ca437e9b037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:37.050916 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ffdff-ce19-42c1-bddf-4ca437e9b037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:37.051206 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ffdff-ce19-42c1-bddf-4ca437e9b037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:37.051485 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ffdff-ce19-42c1-bddf-4ca437e9b037 admin admin] PATH_INFO: `/v3/users/60d51054196a47cf93b69116706ebdb5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:37.052832 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7ffdff-ce19-42c1-bddf-4ca437e9b037 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60d51054196a47cf93b69116706ebdb5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:37.054752 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7ffdff-ce19-42c1-bddf-4ca437e9b037 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:37.120723 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3f7ffdff-ce19-42c1-bddf-4ca437e9b037 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60d51054196a47cf93b69116706ebdb5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:37.121342 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3f7ffdff-ce19-42c1-bddf-4ca437e9b037 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60d51054196a47cf93b69116706ebdb5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:37.121965 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3f7ffdff-ce19-42c1-bddf-4ca437e9b037 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60d51054196a47cf93b69116706ebdb5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:37.134260 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3f7ffdff-ce19-42c1-bddf-4ca437e9b037 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60d51054196a47cf93b69116706ebdb5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:37.142181 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3f7ffdff-ce19-42c1-bddf-4ca437e9b037 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60d51054196a47cf93b69116706ebdb5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:37.147676 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:58:37.159552 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1424/2845] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:58:36 2022] DELETE /identity/v3/users/60d51054196a47cf93b69116706ebdb5 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:58:37.161272 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b4ca5-df7e-4e56-8649-bd3526aa31e9 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:37.161568 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b4ca5-df7e-4e56-8649-bd3526aa31e9 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:37.161849 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b4ca5-df7e-4e56-8649-bd3526aa31e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:37.179551 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-d17b4ca5-df7e-4e56-8649-bd3526aa31e9 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:58:37.180787 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-d17b4ca5-df7e-4e56-8649-bd3526aa31e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:37.199534 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ffdff-ce19-42c1-bddf-4ca437e9b037 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:37.201138 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3f7ffdff-ce19-42c1-bddf-4ca437e9b037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:37.247661 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1422/2846] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:58:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:58:37.257780 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b4ca5-df7e-4e56-8649-bd3526aa31e9 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:37.259673 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-d17b4ca5-df7e-4e56-8649-bd3526aa31e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:37.277598 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ffdff-ce19-42c1-bddf-4ca437e9b037 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:37.282907 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c44f98-49fd-4730-ad05-69b91923f6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:37.283817 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c44f98-49fd-4730-ad05-69b91923f6bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:37.284125 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c44f98-49fd-4730-ad05-69b91923f6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:37.284404 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c44f98-49fd-4730-ad05-69b91923f6bf admin admin] PATH_INFO: `/v3/projects/5ef9eb287eba4653a780a9d72d759fb5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:37.285578 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c44f98-49fd-4730-ad05-69b91923f6bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ef9eb287eba4653a780a9d72d759fb5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:37.287459 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c44f98-49fd-4730-ad05-69b91923f6bf admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:37.319991 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b4ca5-df7e-4e56-8649-bd3526aa31e9 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:37.323662 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d2afe4-967d-44f8-9ebf-005fad528d12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:37.324352 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2afe4-967d-44f8-9ebf-005fad528d12 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:37.324644 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2afe4-967d-44f8-9ebf-005fad528d12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:37.324929 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2afe4-967d-44f8-9ebf-005fad528d12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:37.334820 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d2afe4-967d-44f8-9ebf-005fad528d12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:37.336292 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d2afe4-967d-44f8-9ebf-005fad528d12 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:37.336640 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a4c44f98-49fd-4730-ad05-69b91923f6bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ef9eb287eba4653a780a9d72d759fb5', 'request_id': 'req-a4c44f98-49fd-4730-ad05-69b91923f6bf'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:37.344975 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a4c44f98-49fd-4730-ad05-69b91923f6bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ef9eb287eba4653a780a9d72d759fb5', 'request_id': 'req-a4c44f98-49fd-4730-ad05-69b91923f6bf'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:37.347690 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1423/2847] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:58:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 20:58:37.350760 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a4c44f98-49fd-4730-ad05-69b91923f6bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ef9eb287eba4653a780a9d72d759fb5', 'request_id': 'req-a4c44f98-49fd-4730-ad05-69b91923f6bf'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:37.361885 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a4c44f98-49fd-4730-ad05-69b91923f6bf admin admin] The token cache is being invalidate because project 5ef9eb287eba4653a780a9d72d759fb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:58:37.362173 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a4c44f98-49fd-4730-ad05-69b91923f6bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:37.362838 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a4c44f98-49fd-4730-ad05-69b91923f6bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:37.364553 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1425/2848] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:58:37 2022] DELETE /identity/v3/projects/5ef9eb287eba4653a780a9d72d759fb5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 20:58:37.646348 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d2afe4-967d-44f8-9ebf-005fad528d12 service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:37.647856 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-64d2afe4-967d-44f8-9ebf-005fad528d12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:37.663348 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d2afe4-967d-44f8-9ebf-005fad528d12 service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:37.702959 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:58:37.722279 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce6aa7-eb3c-4958-95c9-f721a6cbc025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:37.723141 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce6aa7-eb3c-4958-95c9-f721a6cbc025 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:37.723423 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce6aa7-eb3c-4958-95c9-f721a6cbc025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:37.723695 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce6aa7-eb3c-4958-95c9-f721a6cbc025 admin admin] PATH_INFO: `/v3/projects/00d116dc29684db1896a9223a348736d` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:37.724895 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ce6aa7-eb3c-4958-95c9-f721a6cbc025 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00d116dc29684db1896a9223a348736d)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:37.726783 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ce6aa7-eb3c-4958-95c9-f721a6cbc025 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:37.771621 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-52ce6aa7-eb3c-4958-95c9-f721a6cbc025 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00d116dc29684db1896a9223a348736d', 'request_id': 'req-52ce6aa7-eb3c-4958-95c9-f721a6cbc025'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:37.777028 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-52ce6aa7-eb3c-4958-95c9-f721a6cbc025 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00d116dc29684db1896a9223a348736d', 'request_id': 'req-52ce6aa7-eb3c-4958-95c9-f721a6cbc025'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:37.783968 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-52ce6aa7-eb3c-4958-95c9-f721a6cbc025 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00d116dc29684db1896a9223a348736d', 'request_id': 'req-52ce6aa7-eb3c-4958-95c9-f721a6cbc025'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:37.794577 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-52ce6aa7-eb3c-4958-95c9-f721a6cbc025 admin admin] The token cache is being invalidate because project 00d116dc29684db1896a9223a348736d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:58:37.794862 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-52ce6aa7-eb3c-4958-95c9-f721a6cbc025 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:37.795505 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-52ce6aa7-eb3c-4958-95c9-f721a6cbc025 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:58:37.797042 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1424/2849] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:58:37 2022] DELETE /identity/v3/projects/00d116dc29684db1896a9223a348736d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:58:37.802157 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b2a5a-b047-4b1a-912f-1b9786d76a0a None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:37.802628 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b2a5a-b047-4b1a-912f-1b9786d76a0a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:37.802762 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b2a5a-b047-4b1a-912f-1b9786d76a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:37.822345 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-2c2b2a5a-b047-4b1a-912f-1b9786d76a0a None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:58:37.823551 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2c2b2a5a-b047-4b1a-912f-1b9786d76a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:37.882835 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1426/2850] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:58:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:58:37.891956 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcce460-b3e5-48bd-8119-4fadc4e714de None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:37.892245 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcce460-b3e5-48bd-8119-4fadc4e714de None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:37.892530 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcce460-b3e5-48bd-8119-4fadc4e714de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:37.910471 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-1bcce460-b3e5-48bd-8119-4fadc4e714de None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:58:37.911645 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-1bcce460-b3e5-48bd-8119-4fadc4e714de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:37.919472 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1425/2851] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:58:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:58:37.924443 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b2a5a-b047-4b1a-912f-1b9786d76a0a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:37.933965 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b2a5a-b047-4b1a-912f-1b9786d76a0a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:37.939092 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de09b7-df54-4507-b55b-2d07b83f7a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:37.939742 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de09b7-df54-4507-b55b-2d07b83f7a65 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:37.940065 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de09b7-df54-4507-b55b-2d07b83f7a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:37.940349 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de09b7-df54-4507-b55b-2d07b83f7a65 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:37.941075 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36de09b7-df54-4507-b55b-2d07b83f7a65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:58:37.941389 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36de09b7-df54-4507-b55b-2d07b83f7a65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:37.942976 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36de09b7-df54-4507-b55b-2d07b83f7a65 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:37.954307 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1427/2852] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:58:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:58:37.958286 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcce460-b3e5-48bd-8119-4fadc4e714de None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:37.967660 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcce460-b3e5-48bd-8119-4fadc4e714de None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:37.972514 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b0603-0f2c-44a4-a6fd-6f2a1e32054a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:37.973154 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b0603-0f2c-44a4-a6fd-6f2a1e32054a admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:37.973440 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b0603-0f2c-44a4-a6fd-6f2a1e32054a admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:37.973717 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b0603-0f2c-44a4-a6fd-6f2a1e32054a admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:37.974411 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04b0603-0f2c-44a4-a6fd-6f2a1e32054a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:37.976340 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04b0603-0f2c-44a4-a6fd-6f2a1e32054a admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:38.005552 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1426/2853] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:58:37 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:58:38.006666 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de09b7-df54-4507-b55b-2d07b83f7a65 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:38.016536 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de09b7-df54-4507-b55b-2d07b83f7a65 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:38.025311 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:58:38.073672 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5dbc83-08c6-4205-b315-7dde51f3cd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:38.074337 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5dbc83-08c6-4205-b315-7dde51f3cd9d admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:38.074621 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5dbc83-08c6-4205-b315-7dde51f3cd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:38.074896 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5dbc83-08c6-4205-b315-7dde51f3cd9d admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:38.075573 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5dbc83-08c6-4205-b315-7dde51f3cd9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:38.077544 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5dbc83-08c6-4205-b315-7dde51f3cd9d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:38.100865 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1428/2854] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:58:38 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:58:38.102096 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b0603-0f2c-44a4-a6fd-6f2a1e32054a admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:38.113280 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b0603-0f2c-44a4-a6fd-6f2a1e32054a admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:38.118254 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2c97c-54ef-4db8-9e7c-da2a55164495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:38.118920 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2c97c-54ef-4db8-9e7c-da2a55164495 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:38.119218 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2c97c-54ef-4db8-9e7c-da2a55164495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:38.119493 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2c97c-54ef-4db8-9e7c-da2a55164495 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:38.120258 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d2c97c-54ef-4db8-9e7c-da2a55164495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:38.122176 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d2c97c-54ef-4db8-9e7c-da2a55164495 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:38.134519 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1427/2855] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:58:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:58:38.138258 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5dbc83-08c6-4205-b315-7dde51f3cd9d admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:38.148387 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5dbc83-08c6-4205-b315-7dde51f3cd9d admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:38.153034 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be11c3-cdde-49f8-b93c-a63822d584e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:38.153693 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be11c3-cdde-49f8-b93c-a63822d584e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:38.153982 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be11c3-cdde-49f8-b93c-a63822d584e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:38.154265 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be11c3-cdde-49f8-b93c-a63822d584e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:38.155044 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01be11c3-cdde-49f8-b93c-a63822d584e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:38.156704 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01be11c3-cdde-49f8-b93c-a63822d584e3 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:38.166404 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1429/2856] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:58:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:58:38.170752 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2c97c-54ef-4db8-9e7c-da2a55164495 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:38.180818 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2c97c-54ef-4db8-9e7c-da2a55164495 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:38.185387 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e5670-0374-4a32-83c5-89a9267cf78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:38.186929 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e5670-0374-4a32-83c5-89a9267cf78e admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:38.187212 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e5670-0374-4a32-83c5-89a9267cf78e admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:38.187492 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e5670-0374-4a32-83c5-89a9267cf78e admin admin] PATH_INFO: `/v3/projects/5c4518607b40408e8f6cf6f1149c6406/users/8b9932144eeb4aa4ab6c0cf6d7e9b37a/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:38.201786 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5e5670-0374-4a32-83c5-89a9267cf78e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c4518607b40408e8f6cf6f1149c6406, user_id=8b9932144eeb4aa4ab6c0cf6d7e9b37a, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:38.204528 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5e5670-0374-4a32-83c5-89a9267cf78e admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:38.216963 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1428/2857] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:58:38 2022] PUT /identity/v3/projects/5c4518607b40408e8f6cf6f1149c6406/users/8b9932144eeb4aa4ab6c0cf6d7e9b37a/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:58:38.227265 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadbf1a5-de9b-459c-b0c0-105d1bcdd952 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:38.227555 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadbf1a5-de9b-459c-b0c0-105d1bcdd952 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:38.227853 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadbf1a5-de9b-459c-b0c0-105d1bcdd952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:38.254855 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-fadbf1a5-de9b-459c-b0c0-105d1bcdd952 None None] MFA Rules not processed for user `8b9932144eeb4aa4ab6c0cf6d7e9b37a`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:58:38.256101 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-fadbf1a5-de9b-459c-b0c0-105d1bcdd952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:38.318390 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1430/2858] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:58:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:58:38.328946 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e5670-0374-4a32-83c5-89a9267cf78e admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:38.330606 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-de5e5670-0374-4a32-83c5-89a9267cf78e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:38.390759 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e5670-0374-4a32-83c5-89a9267cf78e admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:38.394512 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185bad3b-5c5a-4252-890e-a412a62e3e97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:38.395392 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bad3b-5c5a-4252-890e-a412a62e3e97 service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:38.396078 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bad3b-5c5a-4252-890e-a412a62e3e97 service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:38.396417 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bad3b-5c5a-4252-890e-a412a62e3e97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:38.407703 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185bad3b-5c5a-4252-890e-a412a62e3e97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:38.409282 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185bad3b-5c5a-4252-890e-a412a62e3e97 service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:38.418468 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1429/2859] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:58:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:58:40.823413 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c787096-a685-4e47-bf69-97f80917b78e None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:40.823892 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c787096-a685-4e47-bf69-97f80917b78e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:40.824026 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c787096-a685-4e47-bf69-97f80917b78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:40.841231 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-8c787096-a685-4e47-bf69-97f80917b78e None None] MFA Rules not processed for user `8b9932144eeb4aa4ab6c0cf6d7e9b37a`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:58:40.842932 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8c787096-a685-4e47-bf69-97f80917b78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:40.849839 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1431/2860] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:58:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:58:43.056354 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185bad3b-5c5a-4252-890e-a412a62e3e97 service cinder] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:43.057826 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-185bad3b-5c5a-4252-890e-a412a62e3e97 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:43.069171 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:58:43.119041 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185bad3b-5c5a-4252-890e-a412a62e3e97 service cinder] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:43.122590 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022f911-7a71-455e-b428-e634b6b0cb06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:43.123767 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022f911-7a71-455e-b428-e634b6b0cb06 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:43.124083 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022f911-7a71-455e-b428-e634b6b0cb06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:43.124364 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022f911-7a71-455e-b428-e634b6b0cb06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:43.126219 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-a022f911-7a71-455e-b428-e634b6b0cb06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:43.137143 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a022f911-7a71-455e-b428-e634b6b0cb06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:43.138591 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a022f911-7a71-455e-b428-e634b6b0cb06 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:43.147643 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1430/2861] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:58:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:58:48.576325 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f958b-4bc7-4287-873a-878e6c57f245 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:48.576778 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f958b-4bc7-4287-873a-878e6c57f245 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:48.576903 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f958b-4bc7-4287-873a-878e6c57f245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:48.594217 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-330f958b-4bc7-4287-873a-878e6c57f245 None None] MFA Rules not processed for user `8846803a5b8a4f5ab5a33feeddfc5138`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:58:48.595464 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-330f958b-4bc7-4287-873a-878e6c57f245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:48.649228 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1432/2862] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:58:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:58:49.105517 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022f911-7a71-455e-b428-e634b6b0cb06 service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:58:49.114790 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022f911-7a71-455e-b428-e634b6b0cb06 service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:58:49.118568 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef2920-7183-4e6a-b118-0736ae18344d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:58:49.119215 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef2920-7183-4e6a-b118-0736ae18344d service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:58:49.119505 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef2920-7183-4e6a-b118-0736ae18344d service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:58:49.119786 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef2920-7183-4e6a-b118-0736ae18344d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:58:49.121591 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-26ef2920-7183-4e6a-b118-0736ae18344d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:58:49.131622 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ef2920-7183-4e6a-b118-0736ae18344d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:58:49.133098 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ef2920-7183-4e6a-b118-0736ae18344d service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:58:49.141875 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1431/2863] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:58:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:58:58.642642 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=88,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:58:59.137636 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=28 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:59:03.743334 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b1b29-e2dd-4a26-a549-18e2e7d2722f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:59:03.743830 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b1b29-e2dd-4a26-a549-18e2e7d2722f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:59:03.743936 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b1b29-e2dd-4a26-a549-18e2e7d2722f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:59:03.804488 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f88b1b29-e2dd-4a26-a549-18e2e7d2722f None None] MFA Rules not processed for user `5cf067b8833f4596a1b91073a66768f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:59:03.805725 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f88b1b29-e2dd-4a26-a549-18e2e7d2722f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:59:03.870660 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1433/2864] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jun 21 20:59:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:59:03.921998 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef2920-7183-4e6a-b118-0736ae18344d service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:59:03.923894 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-26ef2920-7183-4e6a-b118-0736ae18344d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:59:04.010960 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef2920-7183-4e6a-b118-0736ae18344d service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:59:04.015866 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7697e0-9dd1-4ef5-bb61-b0435617805d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '038537bd12174154ba259e097b97b8bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:59:04.016530 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7697e0-9dd1-4ef5-bb61-b0435617805d service swift] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:59:04.016820 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7697e0-9dd1-4ef5-bb61-b0435617805d service swift] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:59:04.017098 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7697e0-9dd1-4ef5-bb61-b0435617805d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:59:04.024986 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7697e0-9dd1-4ef5-bb61-b0435617805d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:59:04.026614 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7697e0-9dd1-4ef5-bb61-b0435617805d service swift] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:59:04.035187 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1432/2865] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jun 21 20:59:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 20:59:04.484871 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b1b29-e2dd-4a26-a549-18e2e7d2722f None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:59:04.486369 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f88b1b29-e2dd-4a26-a549-18e2e7d2722f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:59:04.534748 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a2b15-f386-4810-8397-9543692c4b5f None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:59:04.535041 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a2b15-f386-4810-8397-9543692c4b5f None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:59:04.535325 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a2b15-f386-4810-8397-9543692c4b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:59:04.561100 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-498a2b15-f386-4810-8397-9543692c4b5f None None] MFA Rules not processed for user `5cf067b8833f4596a1b91073a66768f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:59:04.562608 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-498a2b15-f386-4810-8397-9543692c4b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:59:04.567775 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b1b29-e2dd-4a26-a549-18e2e7d2722f None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:59:04.569954 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1433/2866] 10.222.0.15 () {58 vars in 967 bytes} [Tue Jun 21 20:59:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 20:59:04.572643 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b239e9-1736-4c27-9208-6b7bd92cafee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:59:04.573531 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b239e9-1736-4c27-9208-6b7bd92cafee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:59:04.573822 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b239e9-1736-4c27-9208-6b7bd92cafee admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:59:04.574224 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b239e9-1736-4c27-9208-6b7bd92cafee admin admin] PATH_INFO: `/v3/users/cb75f528976a45c78353ecd3d3f3cff4` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:59:04.575448 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b239e9-1736-4c27-9208-6b7bd92cafee admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb75f528976a45c78353ecd3d3f3cff4)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:59:04.578076 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b239e9-1736-4c27-9208-6b7bd92cafee admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:59:04.582425 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a2b15-f386-4810-8397-9543692c4b5f None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:59:04.594423 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a2b15-f386-4810-8397-9543692c4b5f None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:59:04.599647 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb09474-5099-4ed1-b538-bebf106f550e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '038537bd12174154ba259e097b97b8bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:59:04.600387 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb09474-5099-4ed1-b538-bebf106f550e service swift] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:59:04.600808 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb09474-5099-4ed1-b538-bebf106f550e service swift] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:59:04.601094 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb09474-5099-4ed1-b538-bebf106f550e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:59:04.610795 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb09474-5099-4ed1-b538-bebf106f550e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:59:04.612958 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb09474-5099-4ed1-b538-bebf106f550e service swift] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:59:04.621556 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1434/2867] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jun 21 20:59:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 21 20:59:04.630630 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-32b239e9-1736-4c27-9208-6b7bd92cafee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb75f528976a45c78353ecd3d3f3cff4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:59:04.631581 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-32b239e9-1736-4c27-9208-6b7bd92cafee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb75f528976a45c78353ecd3d3f3cff4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:59:04.632085 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-32b239e9-1736-4c27-9208-6b7bd92cafee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb75f528976a45c78353ecd3d3f3cff4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:59:04.644476 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-32b239e9-1736-4c27-9208-6b7bd92cafee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb75f528976a45c78353ecd3d3f3cff4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:59:04.646138 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:59:04.653393 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-32b239e9-1736-4c27-9208-6b7bd92cafee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb75f528976a45c78353ecd3d3f3cff4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:59:04.666498 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1434/2868] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:59:04 2022] DELETE /identity/v3/users/cb75f528976a45c78353ecd3d3f3cff4 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:59:04.671593 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b3de7-0c38-4468-a75f-0b1b8d02841c None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:59:04.671984 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b3de7-0c38-4468-a75f-0b1b8d02841c None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:59:04.672273 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b3de7-0c38-4468-a75f-0b1b8d02841c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:59:04.691572 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-223b3de7-0c38-4468-a75f-0b1b8d02841c None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:59:04.692967 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-223b3de7-0c38-4468-a75f-0b1b8d02841c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:59:04.754680 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1435/2869] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:59:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:59:04.764756 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b239e9-1736-4c27-9208-6b7bd92cafee admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:59:04.766244 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-32b239e9-1736-4c27-9208-6b7bd92cafee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:59:04.817387 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c2778-2e37-4381-86b1-1069b269c5d9 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:59:04.817752 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c2778-2e37-4381-86b1-1069b269c5d9 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:59:04.817960 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c2778-2e37-4381-86b1-1069b269c5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:59:04.825603 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b239e9-1736-4c27-9208-6b7bd92cafee admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:59:04.830213 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cefc48-a49e-484c-80aa-86ab54948c3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:59:04.830976 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cefc48-a49e-484c-80aa-86ab54948c3e service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:59:04.831319 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cefc48-a49e-484c-80aa-86ab54948c3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:59:04.831668 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cefc48-a49e-484c-80aa-86ab54948c3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:59:04.835957 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-a18c2778-2e37-4381-86b1-1069b269c5d9 None None] MFA Rules not processed for user `5cf067b8833f4596a1b91073a66768f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:59:04.837581 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-a18c2778-2e37-4381-86b1-1069b269c5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:59:04.841556 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cefc48-a49e-484c-80aa-86ab54948c3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:59:04.842945 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cefc48-a49e-484c-80aa-86ab54948c3e service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:59:04.853587 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1435/2870] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:59:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:59:04.896679 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:59:04.910569 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1436/2871] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jun 21 20:59:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 20:59:04.923911 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cefc48-a49e-484c-80aa-86ab54948c3e service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:59:04.925318 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-41cefc48-a49e-484c-80aa-86ab54948c3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:59:04.995630 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cefc48-a49e-484c-80aa-86ab54948c3e service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:59:05.001945 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dbcfe9-d2d4-430b-a739-b0e0029dd094 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '038537bd12174154ba259e097b97b8bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:59:05.002605 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dbcfe9-d2d4-430b-a739-b0e0029dd094 service swift] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:59:05.002917 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dbcfe9-d2d4-430b-a739-b0e0029dd094 service swift] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:59:05.003193 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dbcfe9-d2d4-430b-a739-b0e0029dd094 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:59:05.012153 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dbcfe9-d2d4-430b-a739-b0e0029dd094 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:59:05.013858 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dbcfe9-d2d4-430b-a739-b0e0029dd094 service swift] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:59:05.022627 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1436/2872] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jun 21 20:59:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 20:59:05.150420 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c2778-2e37-4381-86b1-1069b269c5d9 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:59:05.150420 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-a18c2778-2e37-4381-86b1-1069b269c5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:59:05.182102 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c2778-2e37-4381-86b1-1069b269c5d9 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:59:05.188723 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cf2fb0-2f95-49ce-86b1-8454920b2efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:59:05.189858 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf2fb0-2f95-49ce-86b1-8454920b2efb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:59:05.189858 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf2fb0-2f95-49ce-86b1-8454920b2efb admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:59:05.190142 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf2fb0-2f95-49ce-86b1-8454920b2efb admin admin] PATH_INFO: `/v3/projects/f08db13a16b349c698c4af697aa07d35` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:59:05.191809 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cf2fb0-2f95-49ce-86b1-8454920b2efb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f08db13a16b349c698c4af697aa07d35)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:59:05.193746 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cf2fb0-2f95-49ce-86b1-8454920b2efb admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:59:05.243319 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-43cf2fb0-2f95-49ce-86b1-8454920b2efb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f08db13a16b349c698c4af697aa07d35', 'request_id': 'req-43cf2fb0-2f95-49ce-86b1-8454920b2efb'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:59:05.250053 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-43cf2fb0-2f95-49ce-86b1-8454920b2efb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f08db13a16b349c698c4af697aa07d35', 'request_id': 'req-43cf2fb0-2f95-49ce-86b1-8454920b2efb'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:59:05.257740 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-43cf2fb0-2f95-49ce-86b1-8454920b2efb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f08db13a16b349c698c4af697aa07d35', 'request_id': 'req-43cf2fb0-2f95-49ce-86b1-8454920b2efb'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:59:05.269639 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-43cf2fb0-2f95-49ce-86b1-8454920b2efb admin admin] The token cache is being invalidate because project f08db13a16b349c698c4af697aa07d35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:59:05.269868 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-43cf2fb0-2f95-49ce-86b1-8454920b2efb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:59:05.270511 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-43cf2fb0-2f95-49ce-86b1-8454920b2efb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:59:05.272177 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1437/2873] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:59:05 2022] DELETE /identity/v3/projects/f08db13a16b349c698c4af697aa07d35 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:59:05.276999 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac2401-7ce8-460b-a6a7-ebd49a5b82d3 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:59:05.277289 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac2401-7ce8-460b-a6a7-ebd49a5b82d3 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:59:05.277572 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac2401-7ce8-460b-a6a7-ebd49a5b82d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:59:05.295791 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-4aac2401-7ce8-460b-a6a7-ebd49a5b82d3 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:59:05.297008 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4aac2401-7ce8-460b-a6a7-ebd49a5b82d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:59:05.352163 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde25aec-f203-4b8a-b8bc-5673e9871412 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:59:05.352535 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde25aec-f203-4b8a-b8bc-5673e9871412 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:59:05.352894 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde25aec-f203-4b8a-b8bc-5673e9871412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:59:05.359893 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1437/2874] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:59:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:59:05.367441 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9c4f5-2353-4ef4-bb91-dab6fa015435 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:59:05.367735 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9c4f5-2353-4ef4-bb91-dab6fa015435 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:59:05.368055 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9c4f5-2353-4ef4-bb91-dab6fa015435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:59:05.371645 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-fde25aec-f203-4b8a-b8bc-5673e9871412 None None] MFA Rules not processed for user `5cf067b8833f4596a1b91073a66768f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:59:05.372948 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-fde25aec-f203-4b8a-b8bc-5673e9871412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:59:05.386207 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-04a9c4f5-2353-4ef4-bb91-dab6fa015435 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:59:05.387392 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-04a9c4f5-2353-4ef4-bb91-dab6fa015435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:59:05.395224 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1438/2875] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:59:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 20:59:05.399234 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a9c4f5-2353-4ef4-bb91-dab6fa015435 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:59:05.409282 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a9c4f5-2353-4ef4-bb91-dab6fa015435 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:59:05.413819 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295cb93-01fa-477c-be33-c2f9e4c841d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:59:05.414459 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295cb93-01fa-477c-be33-c2f9e4c841d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:59:05.414746 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295cb93-01fa-477c-be33-c2f9e4c841d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:59:05.415026 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295cb93-01fa-477c-be33-c2f9e4c841d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:59:05.415735 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4295cb93-01fa-477c-be33-c2f9e4c841d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:59:05.416073 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4295cb93-01fa-477c-be33-c2f9e4c841d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:59:05.417779 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4295cb93-01fa-477c-be33-c2f9e4c841d2 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:59:05.420801 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:59:05.431271 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1439/2876] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:59:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 20:59:05.431978 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1438/2877] 10.222.0.15 () {58 vars in 967 bytes} [Tue Jun 21 20:59:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 20:59:05.435400 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295cb93-01fa-477c-be33-c2f9e4c841d2 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:59:05.445180 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295cb93-01fa-477c-be33-c2f9e4c841d2 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:59:05.445301 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde25aec-f203-4b8a-b8bc-5673e9871412 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:59:05.446736 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-fde25aec-f203-4b8a-b8bc-5673e9871412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:59:05.449813 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a28abd-a9db-4b23-a9d1-54d49988eb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:59:05.450459 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a28abd-a9db-4b23-a9d1-54d49988eb40 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:59:05.450743 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a28abd-a9db-4b23-a9d1-54d49988eb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:59:05.451020 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a28abd-a9db-4b23-a9d1-54d49988eb40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:59:05.451703 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a28abd-a9db-4b23-a9d1-54d49988eb40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:59:05.453614 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a28abd-a9db-4b23-a9d1-54d49988eb40 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:59:05.482909 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1440/2878] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:59:05 2022] POST /identity/v3/projects => generated 391 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:59:05.483925 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a28abd-a9db-4b23-a9d1-54d49988eb40 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:59:05.517806 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde25aec-f203-4b8a-b8bc-5673e9871412 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:59:05.542547 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:59:05.546104 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a28abd-a9db-4b23-a9d1-54d49988eb40 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:59:05.553630 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b3f51c-6349-419a-bf29-88d2c6a59ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:59:05.554427 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b3f51c-6349-419a-bf29-88d2c6a59ead admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:59:05.554722 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b3f51c-6349-419a-bf29-88d2c6a59ead admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:59:05.554999 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b3f51c-6349-419a-bf29-88d2c6a59ead admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:59:05.555702 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b3f51c-6349-419a-bf29-88d2c6a59ead admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:59:05.557813 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b3f51c-6349-419a-bf29-88d2c6a59ead admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:59:05.580866 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1441/2879] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:59:05 2022] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:59:05.585123 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b3f51c-6349-419a-bf29-88d2c6a59ead admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:59:05.590549 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67456fb-cde8-4ac2-aca9-6384822f327f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '038537bd12174154ba259e097b97b8bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:59:05.592067 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67456fb-cde8-4ac2-aca9-6384822f327f service swift] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:59:05.592341 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67456fb-cde8-4ac2-aca9-6384822f327f service swift] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:59:05.592689 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67456fb-cde8-4ac2-aca9-6384822f327f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:59:05.595259 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b3f51c-6349-419a-bf29-88d2c6a59ead admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:59:05.599896 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3521216-515e-43d6-bdb4-162ac12a1ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:59:05.600580 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3521216-515e-43d6-bdb4-162ac12a1ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:59:05.600867 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3521216-515e-43d6-bdb4-162ac12a1ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:59:05.601145 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3521216-515e-43d6-bdb4-162ac12a1ab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:59:05.601877 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3521216-515e-43d6-bdb4-162ac12a1ab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:59:05.603612 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3521216-515e-43d6-bdb4-162ac12a1ab4 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:59:05.617682 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1442/2880] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 20:59:05.618506 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3521216-515e-43d6-bdb4-162ac12a1ab4 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:59:05.628311 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3521216-515e-43d6-bdb4-162ac12a1ab4 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:59:05.632909 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae176b24-7831-4e9f-bf7a-1563ea3a5c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:59:05.633582 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae176b24-7831-4e9f-bf7a-1563ea3a5c75 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:59:05.633855 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae176b24-7831-4e9f-bf7a-1563ea3a5c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:59:05.634135 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae176b24-7831-4e9f-bf7a-1563ea3a5c75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:59:05.634889 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae176b24-7831-4e9f-bf7a-1563ea3a5c75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:59:05.636503 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae176b24-7831-4e9f-bf7a-1563ea3a5c75 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:59:05.647672 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1443/2881] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 20:59:05.652059 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae176b24-7831-4e9f-bf7a-1563ea3a5c75 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:59:05.659240 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67456fb-cde8-4ac2-aca9-6384822f327f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:59:05.661085 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67456fb-cde8-4ac2-aca9-6384822f327f service swift] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:59:05.662561 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae176b24-7831-4e9f-bf7a-1563ea3a5c75 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:59:05.667275 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c69554-6d63-46b0-8fae-72670d6c3cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:59:05.668181 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c69554-6d63-46b0-8fae-72670d6c3cbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:59:05.668464 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c69554-6d63-46b0-8fae-72670d6c3cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:59:05.668742 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c69554-6d63-46b0-8fae-72670d6c3cbc admin admin] PATH_INFO: `/v3/projects/6a0b5515fa6b4b5f924759b2f49333c3/users/a6a654935ceb4e788b3364e1a68bc693/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:59:05.670136 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1439/2882] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jun 21 20:59:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 21 20:59:05.689202 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c69554-6d63-46b0-8fae-72670d6c3cbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a0b5515fa6b4b5f924759b2f49333c3, user_id=a6a654935ceb4e788b3364e1a68bc693, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:59:05.692478 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c69554-6d63-46b0-8fae-72670d6c3cbc admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:59:05.712496 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1444/2883] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:59:05 2022] PUT /identity/v3/projects/6a0b5515fa6b4b5f924759b2f49333c3/users/a6a654935ceb4e788b3364e1a68bc693/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:59:05.724644 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb9b0c-3b9e-4ae6-8188-707f02cec674 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:59:05.724949 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb9b0c-3b9e-4ae6-8188-707f02cec674 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:59:05.725412 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb9b0c-3b9e-4ae6-8188-707f02cec674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:59:05.755892 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-05fb9b0c-3b9e-4ae6-8188-707f02cec674 None None] MFA Rules not processed for user `a6a654935ceb4e788b3364e1a68bc693`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:59:05.757337 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-05fb9b0c-3b9e-4ae6-8188-707f02cec674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:59:05.826873 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1440/2884] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:59:05 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 20:59:05.837380 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c69554-6d63-46b0-8fae-72670d6c3cbc admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:59:05.840963 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-89c69554-6d63-46b0-8fae-72670d6c3cbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:59:05.906250 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c69554-6d63-46b0-8fae-72670d6c3cbc admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:59:05.909203 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d80677-3ae6-4a49-9b3d-7f97ff6bd976 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:59:05.909852 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d80677-3ae6-4a49-9b3d-7f97ff6bd976 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:59:05.910163 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d80677-3ae6-4a49-9b3d-7f97ff6bd976 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:59:05.910439 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d80677-3ae6-4a49-9b3d-7f97ff6bd976 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:59:05.919097 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d80677-3ae6-4a49-9b3d-7f97ff6bd976 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:59:05.920602 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d80677-3ae6-4a49-9b3d-7f97ff6bd976 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:59:05.930039 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1445/2885] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:59:05 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:59:07.735778 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb9b0c-3b9e-4ae6-8188-707f02cec674 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:59:07.737190 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-05fb9b0c-3b9e-4ae6-8188-707f02cec674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:59:07.796287 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:59:07.800937 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb9b0c-3b9e-4ae6-8188-707f02cec674 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:59:07.805580 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e2aed4-4ab7-4eca-9cbf-9fe82c4abdda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:59:07.806478 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2aed4-4ab7-4eca-9cbf-9fe82c4abdda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:59:07.806761 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2aed4-4ab7-4eca-9cbf-9fe82c4abdda admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:59:07.807063 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2aed4-4ab7-4eca-9cbf-9fe82c4abdda admin admin] PATH_INFO: `/v3/users/8b9932144eeb4aa4ab6c0cf6d7e9b37a` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:59:07.808253 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e2aed4-4ab7-4eca-9cbf-9fe82c4abdda admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b9932144eeb4aa4ab6c0cf6d7e9b37a)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:59:07.810182 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e2aed4-4ab7-4eca-9cbf-9fe82c4abdda admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:59:07.855843 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-95e2aed4-4ab7-4eca-9cbf-9fe82c4abdda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b9932144eeb4aa4ab6c0cf6d7e9b37a'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:59:07.856459 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-95e2aed4-4ab7-4eca-9cbf-9fe82c4abdda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b9932144eeb4aa4ab6c0cf6d7e9b37a'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:59:07.864440 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-95e2aed4-4ab7-4eca-9cbf-9fe82c4abdda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b9932144eeb4aa4ab6c0cf6d7e9b37a'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:59:07.876126 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-95e2aed4-4ab7-4eca-9cbf-9fe82c4abdda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b9932144eeb4aa4ab6c0cf6d7e9b37a'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:59:07.876964 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-95e2aed4-4ab7-4eca-9cbf-9fe82c4abdda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b9932144eeb4aa4ab6c0cf6d7e9b37a'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:59:07.890491 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1441/2886] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:59:07 2022] DELETE /identity/v3/users/8b9932144eeb4aa4ab6c0cf6d7e9b37a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:59:07.894899 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf17fc-1827-4ba3-8c9a-bc4629a808cf None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:59:07.895377 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf17fc-1827-4ba3-8c9a-bc4629a808cf None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:59:07.895476 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf17fc-1827-4ba3-8c9a-bc4629a808cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:59:07.912832 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-fddf17fc-1827-4ba3-8c9a-bc4629a808cf None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:59:07.914055 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-fddf17fc-1827-4ba3-8c9a-bc4629a808cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:59:07.928438 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:59:07.978576 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1446/2887] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:59:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:59:07.988688 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e2aed4-4ab7-4eca-9cbf-9fe82c4abdda admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:59:07.990114 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-95e2aed4-4ab7-4eca-9cbf-9fe82c4abdda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:59:08.048013 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e2aed4-4ab7-4eca-9cbf-9fe82c4abdda admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:59:08.051728 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dd41e4-06ac-4659-a229-3cb875d1c2da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:59:08.052406 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd41e4-06ac-4659-a229-3cb875d1c2da service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:59:08.052689 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd41e4-06ac-4659-a229-3cb875d1c2da service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:59:08.052966 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd41e4-06ac-4659-a229-3cb875d1c2da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:59:08.062661 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dd41e4-06ac-4659-a229-3cb875d1c2da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:59:08.064178 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dd41e4-06ac-4659-a229-3cb875d1c2da service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:59:08.073819 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1442/2888] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:59:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:59:08.234596 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf17fc-1827-4ba3-8c9a-bc4629a808cf None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:59:08.236063 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-fddf17fc-1827-4ba3-8c9a-bc4629a808cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:59:08.248801 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf17fc-1827-4ba3-8c9a-bc4629a808cf None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:59:08.254249 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b0013-0705-477f-9152-94415d5fe791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:59:08.255452 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b0013-0705-477f-9152-94415d5fe791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:59:08.256021 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b0013-0705-477f-9152-94415d5fe791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:59:08.256424 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b0013-0705-477f-9152-94415d5fe791 admin admin] PATH_INFO: `/v3/projects/5c4518607b40408e8f6cf6f1149c6406` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:59:08.257762 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3b0013-0705-477f-9152-94415d5fe791 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c4518607b40408e8f6cf6f1149c6406)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:59:08.259660 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3b0013-0705-477f-9152-94415d5fe791 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:59:08.306680 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ea3b0013-0705-477f-9152-94415d5fe791 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c4518607b40408e8f6cf6f1149c6406', 'request_id': 'req-ea3b0013-0705-477f-9152-94415d5fe791'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:59:08.314547 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ea3b0013-0705-477f-9152-94415d5fe791 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c4518607b40408e8f6cf6f1149c6406', 'request_id': 'req-ea3b0013-0705-477f-9152-94415d5fe791'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:59:08.320086 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ea3b0013-0705-477f-9152-94415d5fe791 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c4518607b40408e8f6cf6f1149c6406', 'request_id': 'req-ea3b0013-0705-477f-9152-94415d5fe791'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:59:08.333035 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ea3b0013-0705-477f-9152-94415d5fe791 admin admin] The token cache is being invalidate because project 5c4518607b40408e8f6cf6f1149c6406 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:59:08.333347 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ea3b0013-0705-477f-9152-94415d5fe791 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:59:08.333979 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ea3b0013-0705-477f-9152-94415d5fe791 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:59:08.335491 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1447/2889] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:59:08 2022] DELETE /identity/v3/projects/5c4518607b40408e8f6cf6f1149c6406 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:59:08.340648 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f47f0b-3912-4b66-a515-e16d4e74203e None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:59:08.340943 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f47f0b-3912-4b66-a515-e16d4e74203e None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:59:08.341229 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f47f0b-3912-4b66-a515-e16d4e74203e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:59:08.358581 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-18f47f0b-3912-4b66-a515-e16d4e74203e None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:59:08.359786 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-18f47f0b-3912-4b66-a515-e16d4e74203e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:59:08.419671 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1443/2890] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:59:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:59:08.427772 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b6d7e-f025-40b9-b170-c3ad55238798 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:59:08.428111 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b6d7e-f025-40b9-b170-c3ad55238798 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:59:08.428417 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b6d7e-f025-40b9-b170-c3ad55238798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:59:08.446196 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-b79b6d7e-f025-40b9-b170-c3ad55238798 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:59:08.447398 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b79b6d7e-f025-40b9-b170-c3ad55238798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:59:08.456606 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1448/2891] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:59:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:59:08.460898 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f47f0b-3912-4b66-a515-e16d4e74203e None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:59:08.470761 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f47f0b-3912-4b66-a515-e16d4e74203e None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:59:08.475382 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc433e-6c29-4d7b-997a-64deb1bd2eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:59:08.476066 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc433e-6c29-4d7b-997a-64deb1bd2eae admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:59:08.476360 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc433e-6c29-4d7b-997a-64deb1bd2eae admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:59:08.476644 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc433e-6c29-4d7b-997a-64deb1bd2eae admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:59:08.477376 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbc433e-6c29-4d7b-997a-64deb1bd2eae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 20:59:08.477689 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbc433e-6c29-4d7b-997a-64deb1bd2eae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:59:08.479297 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbc433e-6c29-4d7b-997a-64deb1bd2eae admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:59:08.490797 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1444/2892] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jun 21 20:59:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 20:59:08.494862 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b6d7e-f025-40b9-b170-c3ad55238798 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:59:08.504398 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b6d7e-f025-40b9-b170-c3ad55238798 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:59:08.508961 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d943a8-dacc-4479-95af-f29e30da0730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:59:08.509608 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d943a8-dacc-4479-95af-f29e30da0730 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:59:08.509891 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d943a8-dacc-4479-95af-f29e30da0730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:59:08.510168 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d943a8-dacc-4479-95af-f29e30da0730 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:59:08.510849 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d943a8-dacc-4479-95af-f29e30da0730 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:59:08.512755 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d943a8-dacc-4479-95af-f29e30da0730 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:59:08.537871 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1449/2893] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:59:08 2022] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:59:08.541837 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc433e-6c29-4d7b-997a-64deb1bd2eae admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:59:08.552101 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc433e-6c29-4d7b-997a-64deb1bd2eae admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:59:08.555726 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:59:08.610822 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7085bf-ebbe-4620-b6ee-9e5dba5515cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:59:08.611498 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7085bf-ebbe-4620-b6ee-9e5dba5515cd admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:59:08.611788 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7085bf-ebbe-4620-b6ee-9e5dba5515cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:59:08.612110 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7085bf-ebbe-4620-b6ee-9e5dba5515cd admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:59:08.612800 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7085bf-ebbe-4620-b6ee-9e5dba5515cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:59:08.614729 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7085bf-ebbe-4620-b6ee-9e5dba5515cd admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:59:08.634026 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1445/2894] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:59:08 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:59:08.638120 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d943a8-dacc-4479-95af-f29e30da0730 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:59:08.648803 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d943a8-dacc-4479-95af-f29e30da0730 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:59:08.653696 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4ac46-fa99-44d5-8cc3-f84a5b5eb805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:59:08.654361 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4ac46-fa99-44d5-8cc3-f84a5b5eb805 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:59:08.654645 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4ac46-fa99-44d5-8cc3-f84a5b5eb805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:59:08.654921 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4ac46-fa99-44d5-8cc3-f84a5b5eb805 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:59:08.655646 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca4ac46-fa99-44d5-8cc3-f84a5b5eb805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:59:08.657243 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca4ac46-fa99-44d5-8cc3-f84a5b5eb805 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:59:08.666939 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1450/2895] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:59:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:59:08.671264 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7085bf-ebbe-4620-b6ee-9e5dba5515cd admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:59:08.681334 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7085bf-ebbe-4620-b6ee-9e5dba5515cd admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:59:08.686617 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e74a43d-e2f7-4812-91a9-e1bdbba2e8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:59:08.687300 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74a43d-e2f7-4812-91a9-e1bdbba2e8c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:59:08.687590 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74a43d-e2f7-4812-91a9-e1bdbba2e8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:59:08.687876 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74a43d-e2f7-4812-91a9-e1bdbba2e8c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:59:08.688641 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e74a43d-e2f7-4812-91a9-e1bdbba2e8c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:59:08.690247 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e74a43d-e2f7-4812-91a9-e1bdbba2e8c5 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:59:08.700699 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1446/2896] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:59:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:59:08.704513 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4ac46-fa99-44d5-8cc3-f84a5b5eb805 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:59:08.714334 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4ac46-fa99-44d5-8cc3-f84a5b5eb805 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:59:08.719135 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f5438-40c6-43e9-9e72-b3c1ab7da632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:59:08.720051 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f5438-40c6-43e9-9e72-b3c1ab7da632 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:59:08.720341 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f5438-40c6-43e9-9e72-b3c1ab7da632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:59:08.720623 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f5438-40c6-43e9-9e72-b3c1ab7da632 admin admin] PATH_INFO: `/v3/projects/50b02971f2614de7a9280109a1564485/users/afa6042a2b6f4beb9f85d6f300ff5575/roles/0e9566d3696545f9b49bdc8a9574577c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:59:08.735665 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96f5438-40c6-43e9-9e72-b3c1ab7da632 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50b02971f2614de7a9280109a1564485, user_id=afa6042a2b6f4beb9f85d6f300ff5575, role_id=0e9566d3696545f9b49bdc8a9574577c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:59:08.738355 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96f5438-40c6-43e9-9e72-b3c1ab7da632 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:59:08.751541 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1451/2897] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:59:08 2022] PUT /identity/v3/projects/50b02971f2614de7a9280109a1564485/users/afa6042a2b6f4beb9f85d6f300ff5575/roles/0e9566d3696545f9b49bdc8a9574577c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:59:08.756751 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d7594-9d54-46a3-86b8-36336395b0b3 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:59:08.757236 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d7594-9d54-46a3-86b8-36336395b0b3 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:59:08.757364 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d7594-9d54-46a3-86b8-36336395b0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:59:08.774102 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-6c9d7594-9d54-46a3-86b8-36336395b0b3 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:59:08.775316 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-6c9d7594-9d54-46a3-86b8-36336395b0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:59:08.835242 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1447/2898] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:59:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:59:08.844664 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f5438-40c6-43e9-9e72-b3c1ab7da632 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:59:08.846423 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d96f5438-40c6-43e9-9e72-b3c1ab7da632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:59:08.891983 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:59:08.906480 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f5438-40c6-43e9-9e72-b3c1ab7da632 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:59:08.910134 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc11dc-88d8-4404-83d7-4a521d91cfa2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:59:08.910779 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc11dc-88d8-4404-83d7-4a521d91cfa2 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:59:08.911062 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc11dc-88d8-4404-83d7-4a521d91cfa2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:59:08.911338 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc11dc-88d8-4404-83d7-4a521d91cfa2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:59:08.920676 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bc11dc-88d8-4404-83d7-4a521d91cfa2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:59:08.922185 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bc11dc-88d8-4404-83d7-4a521d91cfa2 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:59:08.931903 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1452/2899] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:59:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:59:13.053545 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79c244-8506-47d2-a73b-eaf045340176 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:59:13.054042 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79c244-8506-47d2-a73b-eaf045340176 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:59:13.054144 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79c244-8506-47d2-a73b-eaf045340176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:59:13.113353 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-2e79c244-8506-47d2-a73b-eaf045340176 None None] MFA Rules not processed for user `afa6042a2b6f4beb9f85d6f300ff5575`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:59:13.114661 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-2e79c244-8506-47d2-a73b-eaf045340176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:59:13.208856 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1448/2900] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:59:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:59:13.212759 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc11dc-88d8-4404-83d7-4a521d91cfa2 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:59:13.223645 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc11dc-88d8-4404-83d7-4a521d91cfa2 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:59:13.235062 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d3c8e-eaaa-46a7-84ff-500209b64a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:59:13.235742 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d3c8e-eaaa-46a7-84ff-500209b64a90 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:59:13.236238 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d3c8e-eaaa-46a7-84ff-500209b64a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:59:13.236683 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d3c8e-eaaa-46a7-84ff-500209b64a90 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:59:13.240242 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d3c8e-eaaa-46a7-84ff-500209b64a90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:59:13.242305 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d3c8e-eaaa-46a7-84ff-500209b64a90 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:59:13.285206 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e79c244-8506-47d2-a73b-eaf045340176 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:59:13.291169 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1453/2901] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jun 21 20:59:13 2022] POST /identity/v3/projects => generated 371 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 20:59:13.296895 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e79c244-8506-47d2-a73b-eaf045340176 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:59:13.310244 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:59:13.388927 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f417c-d379-46df-9b0a-c95ab17eb320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:59:13.389736 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f417c-d379-46df-9b0a-c95ab17eb320 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:59:13.390161 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f417c-d379-46df-9b0a-c95ab17eb320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:59:13.390543 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f417c-d379-46df-9b0a-c95ab17eb320 admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:59:13.391355 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58f417c-d379-46df-9b0a-c95ab17eb320 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:59:13.393481 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58f417c-d379-46df-9b0a-c95ab17eb320 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:59:13.419964 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1449/2902] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jun 21 20:59:13 2022] POST /identity/v3/users => generated 292 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 20:59:13.424982 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d3c8e-eaaa-46a7-84ff-500209b64a90 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:59:13.438371 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d3c8e-eaaa-46a7-84ff-500209b64a90 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:59:13.446776 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056fc66-3e88-4e61-bd7a-82f798f9cd3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:59:13.447495 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056fc66-3e88-4e61-bd7a-82f798f9cd3c admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:59:13.447780 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056fc66-3e88-4e61-bd7a-82f798f9cd3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:59:13.448098 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056fc66-3e88-4e61-bd7a-82f798f9cd3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:59:13.448841 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0056fc66-3e88-4e61-bd7a-82f798f9cd3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:59:13.451020 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0056fc66-3e88-4e61-bd7a-82f798f9cd3c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:59:13.472372 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1454/2903] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:59:13 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:59:13.474061 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f417c-d379-46df-9b0a-c95ab17eb320 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:59:13.485786 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f417c-d379-46df-9b0a-c95ab17eb320 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:59:13.491021 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff71f6-bd15-499f-87a8-d068a7d13f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:59:13.492114 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff71f6-bd15-499f-87a8-d068a7d13f64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:59:13.492471 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff71f6-bd15-499f-87a8-d068a7d13f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:59:13.492808 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff71f6-bd15-499f-87a8-d068a7d13f64 admin admin] PATH_INFO: `/v3/projects/19343fe647bd41a19f6fc81ddb199c2f/users/3b28d76a00db4c55972733e627e34e3c/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:59:13.510236 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ff71f6-bd15-499f-87a8-d068a7d13f64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19343fe647bd41a19f6fc81ddb199c2f, user_id=3b28d76a00db4c55972733e627e34e3c, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:59:13.513675 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ff71f6-bd15-499f-87a8-d068a7d13f64 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:59:13.531136 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1450/2904] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:59:13 2022] PUT /identity/v3/projects/19343fe647bd41a19f6fc81ddb199c2f/users/3b28d76a00db4c55972733e627e34e3c/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:59:13.535063 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056fc66-3e88-4e61-bd7a-82f798f9cd3c admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:59:13.549835 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056fc66-3e88-4e61-bd7a-82f798f9cd3c admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:59:13.640927 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf22b6-dc23-4027-8b47-a956ce2302a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:59:13.645279 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf22b6-dc23-4027-8b47-a956ce2302a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:59:13.645770 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf22b6-dc23-4027-8b47-a956ce2302a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:59:13.646065 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf22b6-dc23-4027-8b47-a956ce2302a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:59:13.646964 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf22b6-dc23-4027-8b47-a956ce2302a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:59:13.648768 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf22b6-dc23-4027-8b47-a956ce2302a2 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:59:13.665756 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1455/2905] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jun 21 20:59:13 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 20:59:13.670244 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff71f6-bd15-499f-87a8-d068a7d13f64 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:59:13.680969 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff71f6-bd15-499f-87a8-d068a7d13f64 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:59:13.691130 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f3827-818a-4095-a6ca-3a6a1e0190ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:59:13.692176 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f3827-818a-4095-a6ca-3a6a1e0190ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:59:13.692635 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f3827-818a-4095-a6ca-3a6a1e0190ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:59:13.692982 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f3827-818a-4095-a6ca-3a6a1e0190ac admin admin] PATH_INFO: `/v3/projects/19343fe647bd41a19f6fc81ddb199c2f/users/3b28d76a00db4c55972733e627e34e3c/roles/1f5332f48d9e4c2aac866d0d546c94d5` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:59:13.695171 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032f3827-818a-4095-a6ca-3a6a1e0190ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=19343fe647bd41a19f6fc81ddb199c2f, user_id=3b28d76a00db4c55972733e627e34e3c, role_id=1f5332f48d9e4c2aac866d0d546c94d5)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:59:13.697959 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032f3827-818a-4095-a6ca-3a6a1e0190ac admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:59:13.710059 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1451/2906] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jun 21 20:59:13 2022] PUT /identity/v3/projects/19343fe647bd41a19f6fc81ddb199c2f/users/3b28d76a00db4c55972733e627e34e3c/roles/1f5332f48d9e4c2aac866d0d546c94d5 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:59:18.146993 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84caf60-3832-445e-ae3d-39b1406f2833 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:59:18.147498 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84caf60-3832-445e-ae3d-39b1406f2833 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:59:18.147498 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84caf60-3832-445e-ae3d-39b1406f2833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:59:18.175530 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-a84caf60-3832-445e-ae3d-39b1406f2833 None None] MFA Rules not processed for user `3b28d76a00db4c55972733e627e34e3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:59:18.176782 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a84caf60-3832-445e-ae3d-39b1406f2833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:59:18.248736 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1456/2907] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:59:18 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:59:18.262412 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f3827-818a-4095-a6ca-3a6a1e0190ac admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:59:18.264359 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-032f3827-818a-4095-a6ca-3a6a1e0190ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:59:18.340658 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f3827-818a-4095-a6ca-3a6a1e0190ac admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:59:18.346839 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1410a9-3937-49fa-b5bb-1badf6e81002 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3918fe05c8634bc39f3e295374701465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:59:18.347493 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1410a9-3937-49fa-b5bb-1badf6e81002 service nova] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:59:18.347775 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1410a9-3937-49fa-b5bb-1badf6e81002 service nova] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:59:18.348080 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1410a9-3937-49fa-b5bb-1badf6e81002 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:59:18.407531 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1410a9-3937-49fa-b5bb-1badf6e81002 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:59:18.409095 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1410a9-3937-49fa-b5bb-1badf6e81002 service nova] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:59:18.420456 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1452/2908] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:59:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:59:19.530002 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932470dc-6ade-4cd0-afb4-4febcb6741e4 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:59:19.530765 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932470dc-6ade-4cd0-afb4-4febcb6741e4 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:59:19.531193 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932470dc-6ade-4cd0-afb4-4febcb6741e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:59:19.568337 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-932470dc-6ade-4cd0-afb4-4febcb6741e4 None None] MFA Rules not processed for user `afa6042a2b6f4beb9f85d6f300ff5575`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:59:19.569585 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-932470dc-6ade-4cd0-afb4-4febcb6741e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:59:19.576693 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1457/2909] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:59:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:59:28.415846 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=93,keystone:INSERT=5 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:59:29.555530 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=88,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:59:32.274459 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1410a9-3937-49fa-b5bb-1badf6e81002 service nova] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:59:32.337818 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1410a9-3937-49fa-b5bb-1badf6e81002 service nova] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:59:32.341925 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b0591c-2233-4a85-89cd-10e59c9f7d2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:59:32.342570 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0591c-2233-4a85-89cd-10e59c9f7d2c service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:59:32.342858 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0591c-2233-4a85-89cd-10e59c9f7d2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:59:32.343140 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0591c-2233-4a85-89cd-10e59c9f7d2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:59:32.344923 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-73b0591c-2233-4a85-89cd-10e59c9f7d2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:59:32.408122 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b0591c-2233-4a85-89cd-10e59c9f7d2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:59:32.409562 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b0591c-2233-4a85-89cd-10e59c9f7d2c service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:59:32.419760 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1453/2910] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:59:32 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:59:33.980524 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932470dc-6ade-4cd0-afb4-4febcb6741e4 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:59:33.995272 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932470dc-6ade-4cd0-afb4-4febcb6741e4 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:59:34.000616 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4550e2-deb0-44a1-b448-9cfd33979d7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3918fe05c8634bc39f3e295374701465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:59:34.001277 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4550e2-deb0-44a1-b448-9cfd33979d7a service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:59:34.001563 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4550e2-deb0-44a1-b448-9cfd33979d7a service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:59:34.001848 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4550e2-deb0-44a1-b448-9cfd33979d7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:59:34.003656 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ef4550e2-deb0-44a1-b448-9cfd33979d7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:59:34.016049 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4550e2-deb0-44a1-b448-9cfd33979d7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:59:34.017662 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4550e2-deb0-44a1-b448-9cfd33979d7a service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:59:34.029386 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1458/2911] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:59:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:59:35.586078 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b0591c-2233-4a85-89cd-10e59c9f7d2c service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:59:35.587481 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-73b0591c-2233-4a85-89cd-10e59c9f7d2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:59:35.650967 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b0591c-2233-4a85-89cd-10e59c9f7d2c service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:59:35.655459 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f953f87-9518-48e4-82c6-08190e99e30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:59:35.656432 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f953f87-9518-48e4-82c6-08190e99e30d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:59:35.656721 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f953f87-9518-48e4-82c6-08190e99e30d admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:59:35.656994 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f953f87-9518-48e4-82c6-08190e99e30d admin admin] PATH_INFO: `/v3/users/a6a654935ceb4e788b3364e1a68bc693` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:59:35.658166 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f953f87-9518-48e4-82c6-08190e99e30d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6a654935ceb4e788b3364e1a68bc693)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:59:35.660099 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f953f87-9518-48e4-82c6-08190e99e30d admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:59:35.705626 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-8f953f87-9518-48e4-82c6-08190e99e30d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6a654935ceb4e788b3364e1a68bc693'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:59:35.706197 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-8f953f87-9518-48e4-82c6-08190e99e30d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6a654935ceb4e788b3364e1a68bc693'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:59:35.709679 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:59:35.713393 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-8f953f87-9518-48e4-82c6-08190e99e30d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6a654935ceb4e788b3364e1a68bc693'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:59:35.725862 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-8f953f87-9518-48e4-82c6-08190e99e30d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6a654935ceb4e788b3364e1a68bc693'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:59:35.726489 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-8f953f87-9518-48e4-82c6-08190e99e30d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6a654935ceb4e788b3364e1a68bc693'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:59:35.739117 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1454/2912] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 20:59:35 2022] DELETE /identity/v3/users/a6a654935ceb4e788b3364e1a68bc693 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:59:35.743598 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b7e72-5b46-4245-8994-4dc0a7fb08f2 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:59:35.744063 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b7e72-5b46-4245-8994-4dc0a7fb08f2 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:59:35.744173 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b7e72-5b46-4245-8994-4dc0a7fb08f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:59:35.761932 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-042b7e72-5b46-4245-8994-4dc0a7fb08f2 None None] MFA Rules not processed for user `6983efac1f89435f94ebc2dacd0b3544`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 20:59:35.763374 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-042b7e72-5b46-4245-8994-4dc0a7fb08f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:59:35.821035 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1459/2913] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 20:59:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 20:59:35.830318 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f953f87-9518-48e4-82c6-08190e99e30d admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:59:35.831722 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-8f953f87-9518-48e4-82c6-08190e99e30d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:59:35.890452 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f953f87-9518-48e4-82c6-08190e99e30d admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:59:35.894140 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adefe6f-de34-4f28-a35b-057f2e76e5dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:59:35.894787 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adefe6f-de34-4f28-a35b-057f2e76e5dc service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:59:35.895073 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adefe6f-de34-4f28-a35b-057f2e76e5dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:59:35.895353 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adefe6f-de34-4f28-a35b-057f2e76e5dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:59:35.904196 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adefe6f-de34-4f28-a35b-057f2e76e5dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:59:35.905616 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adefe6f-de34-4f28-a35b-057f2e76e5dc service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:59:35.914908 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1455/2914] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 20:59:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 20:59:36.182425 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b7e72-5b46-4245-8994-4dc0a7fb08f2 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 20:59:36.184027 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-042b7e72-5b46-4245-8994-4dc0a7fb08f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 20:59:36.200661 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b7e72-5b46-4245-8994-4dc0a7fb08f2 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 20:59:36.205986 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641c214-b6fb-4cd1-b107-0022343c150e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 20:59:36.206916 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641c214-b6fb-4cd1-b107-0022343c150e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 20:59:36.207202 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641c214-b6fb-4cd1-b107-0022343c150e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 20:59:36.207474 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641c214-b6fb-4cd1-b107-0022343c150e admin admin] PATH_INFO: `/v3/projects/6a0b5515fa6b4b5f924759b2f49333c3` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 20:59:36.208751 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b641c214-b6fb-4cd1-b107-0022343c150e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a0b5515fa6b4b5f924759b2f49333c3)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 20:59:36.210684 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b641c214-b6fb-4cd1-b107-0022343c150e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 20:59:36.256993 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b641c214-b6fb-4cd1-b107-0022343c150e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a0b5515fa6b4b5f924759b2f49333c3', 'request_id': 'req-b641c214-b6fb-4cd1-b107-0022343c150e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:59:36.264235 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b641c214-b6fb-4cd1-b107-0022343c150e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a0b5515fa6b4b5f924759b2f49333c3', 'request_id': 'req-b641c214-b6fb-4cd1-b107-0022343c150e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:59:36.269883 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b641c214-b6fb-4cd1-b107-0022343c150e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a0b5515fa6b4b5f924759b2f49333c3', 'request_id': 'req-b641c214-b6fb-4cd1-b107-0022343c150e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:59:36.281059 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b641c214-b6fb-4cd1-b107-0022343c150e admin admin] The token cache is being invalidate because project 6a0b5515fa6b4b5f924759b2f49333c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 20:59:36.281347 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b641c214-b6fb-4cd1-b107-0022343c150e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:59:36.281968 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b641c214-b6fb-4cd1-b107-0022343c150e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 20:59:36.283475 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1460/2915] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 20:59:36 2022] DELETE /identity/v3/projects/6a0b5515fa6b4b5f924759b2f49333c3 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 20:59:45.910767 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=38,keystone:DELETE=2 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 20:59:46.278181 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=60,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 21:00:05.205642 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adefe6f-de34-4f28-a35b-057f2e76e5dc service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 21:00:05.214310 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adefe6f-de34-4f28-a35b-057f2e76e5dc service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 21:00:05.264908 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aee066-370e-4f04-89a8-1846ebec29b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 21:00:05.265563 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aee066-370e-4f04-89a8-1846ebec29b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 21:00:05.265847 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aee066-370e-4f04-89a8-1846ebec29b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 21:00:05.266125 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aee066-370e-4f04-89a8-1846ebec29b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 21:00:05.267889 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-f2aee066-370e-4f04-89a8-1846ebec29b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 21:00:05.332233 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aee066-370e-4f04-89a8-1846ebec29b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 21:00:05.333685 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aee066-370e-4f04-89a8-1846ebec29b1 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 21:00:05.343200 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1456/2916] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 21:00:05 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 21:00:15.338925 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=50 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 21:01:02.631523 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641c214-b6fb-4cd1-b107-0022343c150e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 21:01:02.632960 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b641c214-b6fb-4cd1-b107-0022343c150e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 21:01:02.705896 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641c214-b6fb-4cd1-b107-0022343c150e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 21:01:02.710868 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026609db-df06-45e6-8ec9-51f1e8ae10ff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59294bff27c4b3f8aaeeab48ed35a0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 21:01:02.711522 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026609db-df06-45e6-8ec9-51f1e8ae10ff service placement] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 21:01:02.711805 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026609db-df06-45e6-8ec9-51f1e8ae10ff service placement] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 21:01:02.712110 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026609db-df06-45e6-8ec9-51f1e8ae10ff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 21:01:02.714385 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-026609db-df06-45e6-8ec9-51f1e8ae10ff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 21:01:02.725565 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026609db-df06-45e6-8ec9-51f1e8ae10ff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 21:01:02.727134 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026609db-df06-45e6-8ec9-51f1e8ae10ff service placement] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 21:01:02.736979 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1461/2917] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 21:01:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 21:01:12.732784 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=32 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 21:02:01.269586 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aee066-370e-4f04-89a8-1846ebec29b1 service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 21:02:01.271077 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-f2aee066-370e-4f04-89a8-1846ebec29b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 21:02:01.282556 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aee066-370e-4f04-89a8-1846ebec29b1 service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 21:02:01.286149 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de72d07-c966-4359-9f54-f771fe87be32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 21:02:01.286789 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de72d07-c966-4359-9f54-f771fe87be32 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 21:02:01.287073 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de72d07-c966-4359-9f54-f771fe87be32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 21:02:01.287356 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de72d07-c966-4359-9f54-f771fe87be32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 21:02:01.289179 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-0de72d07-c966-4359-9f54-f771fe87be32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 21:02:01.359519 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de72d07-c966-4359-9f54-f771fe87be32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 21:02:01.360987 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de72d07-c966-4359-9f54-f771fe87be32 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 21:02:01.372455 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1457/2918] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 21:02:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 21:02:02.547129 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026609db-df06-45e6-8ec9-51f1e8ae10ff service placement] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 21:02:02.556723 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026609db-df06-45e6-8ec9-51f1e8ae10ff service placement] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 21:02:02.560368 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11375fc8-820f-4b1d-8905-bb975088a539 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 21:02:02.561013 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11375fc8-820f-4b1d-8905-bb975088a539 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 21:02:02.561299 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11375fc8-820f-4b1d-8905-bb975088a539 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 21:02:02.561579 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11375fc8-820f-4b1d-8905-bb975088a539 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 21:02:02.563338 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-11375fc8-820f-4b1d-8905-bb975088a539 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 21:02:02.577082 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11375fc8-820f-4b1d-8905-bb975088a539 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 21:02:02.578499 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11375fc8-820f-4b1d-8905-bb975088a539 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 21:02:02.590194 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1462/2919] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 21:02:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 21:02:03.845553 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de72d07-c966-4359-9f54-f771fe87be32 service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 21:02:03.847026 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-0de72d07-c966-4359-9f54-f771fe87be32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 21:02:03.861736 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de72d07-c966-4359-9f54-f771fe87be32 service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 21:02:03.868032 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15abd710-ee00-4d61-8d0b-dfff3fd205de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3918fe05c8634bc39f3e295374701465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 21:02:03.868794 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15abd710-ee00-4d61-8d0b-dfff3fd205de service nova] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 21:02:03.869143 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15abd710-ee00-4d61-8d0b-dfff3fd205de service nova] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 21:02:03.869452 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15abd710-ee00-4d61-8d0b-dfff3fd205de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 21:02:03.872128 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-15abd710-ee00-4d61-8d0b-dfff3fd205de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 21:02:03.888894 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15abd710-ee00-4d61-8d0b-dfff3fd205de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 21:02:03.892340 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15abd710-ee00-4d61-8d0b-dfff3fd205de service nova] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 21:02:03.907452 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1458/2920] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 21:02:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 21:02:04.894966 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12e406-2d69-478b-9567-4737ce157988 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 21:02:04.895450 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12e406-2d69-478b-9567-4737ce157988 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 21:02:04.895554 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12e406-2d69-478b-9567-4737ce157988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 21:02:04.913706 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-7f12e406-2d69-478b-9567-4737ce157988 None None] MFA Rules not processed for user `8846803a5b8a4f5ab5a33feeddfc5138`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 21:02:04.914890 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7f12e406-2d69-478b-9567-4737ce157988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 21:02:04.968241 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1463/2921] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 21:02:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 21:02:05.270460 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15abd710-ee00-4d61-8d0b-dfff3fd205de service nova] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 21:02:05.279674 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15abd710-ee00-4d61-8d0b-dfff3fd205de service nova] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 21:02:05.283414 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b31c4a-1877-4be1-9aed-c9f709ba61d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 21:02:05.284087 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b31c4a-1877-4be1-9aed-c9f709ba61d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 21:02:05.284379 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b31c4a-1877-4be1-9aed-c9f709ba61d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 21:02:05.284662 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b31c4a-1877-4be1-9aed-c9f709ba61d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 21:02:05.286449 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-f2b31c4a-1877-4be1-9aed-c9f709ba61d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 21:02:05.296368 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b31c4a-1877-4be1-9aed-c9f709ba61d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 21:02:05.297783 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b31c4a-1877-4be1-9aed-c9f709ba61d3 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 21:02:05.305790 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1459/2922] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 21:02:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 21:02:05.737754 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12e406-2d69-478b-9567-4737ce157988 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 21:02:05.739236 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7f12e406-2d69-478b-9567-4737ce157988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 21:02:05.754503 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12e406-2d69-478b-9567-4737ce157988 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 21:02:05.759639 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb96a52-cdef-4b85-837c-d4ae564dee8d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59294bff27c4b3f8aaeeab48ed35a0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 21:02:05.760332 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb96a52-cdef-4b85-837c-d4ae564dee8d service placement] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 21:02:05.760618 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb96a52-cdef-4b85-837c-d4ae564dee8d service placement] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 21:02:05.760895 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb96a52-cdef-4b85-837c-d4ae564dee8d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 21:02:05.762721 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8fb96a52-cdef-4b85-837c-d4ae564dee8d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 21:02:05.774609 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb96a52-cdef-4b85-837c-d4ae564dee8d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 21:02:05.776196 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb96a52-cdef-4b85-837c-d4ae564dee8d service placement] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 21:02:05.786474 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1464/2923] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 21:02:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 21:02:15.302140 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=46 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 21:02:15.782106 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=37 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 21:02:19.334712 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b31c4a-1877-4be1-9aed-c9f709ba61d3 service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 21:02:19.336565 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-f2b31c4a-1877-4be1-9aed-c9f709ba61d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 21:02:19.353056 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b31c4a-1877-4be1-9aed-c9f709ba61d3 service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 21:02:19.359079 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff4e1a-e617-48a2-b86e-0d1d2306b1f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3918fe05c8634bc39f3e295374701465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 21:02:19.359720 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff4e1a-e617-48a2-b86e-0d1d2306b1f2 service nova] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 21:02:19.360032 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff4e1a-e617-48a2-b86e-0d1d2306b1f2 service nova] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 21:02:19.360309 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff4e1a-e617-48a2-b86e-0d1d2306b1f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 21:02:19.362067 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-c9ff4e1a-e617-48a2-b86e-0d1d2306b1f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 21:02:19.375668 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff4e1a-e617-48a2-b86e-0d1d2306b1f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 21:02:19.377373 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff4e1a-e617-48a2-b86e-0d1d2306b1f2 service nova] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 21:02:19.389635 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1460/2924] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 21:02:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 21:02:29.384482 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=6 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 21:02:34.682367 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badcb152-1337-4d69-bb67-d1e74d9874e7 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 21:02:34.682919 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badcb152-1337-4d69-bb67-d1e74d9874e7 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 21:02:34.683030 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badcb152-1337-4d69-bb67-d1e74d9874e7 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 21:02:34.684381 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1465/2925] 10.222.0.15 () {54 vars in 921 bytes} [Tue Jun 21 21:02:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 21:02:34.690526 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294a4fc-73c2-4ef0-aa41-fac9943c9a4b None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 21:02:34.690986 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294a4fc-73c2-4ef0-aa41-fac9943c9a4b None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 21:02:34.691079 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294a4fc-73c2-4ef0-aa41-fac9943c9a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 21:02:34.729529 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-9294a4fc-73c2-4ef0-aa41-fac9943c9a4b None None] MFA Rules not processed for user `1b01b53897d64bbaac6efb6f13d413a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 21:02:34.730759 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-9294a4fc-73c2-4ef0-aa41-fac9943c9a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 21:02:34.737332 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1461/2926] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Jun 21 21:02:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 21:02:34.749478 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badcb152-1337-4d69-bb67-d1e74d9874e7 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 21:02:34.751417 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-badcb152-1337-4d69-bb67-d1e74d9874e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 21:02:34.765078 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badcb152-1337-4d69-bb67-d1e74d9874e7 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 21:02:34.768584 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a5d744-ff6e-46a0-9ea1-b60379337c6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 21:02:34.769226 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5d744-ff6e-46a0-9ea1-b60379337c6e service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 21:02:34.769509 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5d744-ff6e-46a0-9ea1-b60379337c6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 21:02:34.769805 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5d744-ff6e-46a0-9ea1-b60379337c6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 21:02:34.776814 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a5d744-ff6e-46a0-9ea1-b60379337c6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 21:02:34.778232 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a5d744-ff6e-46a0-9ea1-b60379337c6e service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 21:02:34.787097 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1466/2927] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 21:02:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 21:02:34.867615 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0688e2-b0a8-47df-8b77-53f74287ec97 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 21:02:34.867912 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0688e2-b0a8-47df-8b77-53f74287ec97 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 21:02:34.868227 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0688e2-b0a8-47df-8b77-53f74287ec97 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 21:02:34.869618 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1462/2928] 10.222.0.15 () {54 vars in 921 bytes} [Tue Jun 21 21:02:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 21:02:34.875249 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efcaaf-a4ec-487d-80be-fdae2b8f82df None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 21:02:34.875566 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efcaaf-a4ec-487d-80be-fdae2b8f82df None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 21:02:34.875845 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efcaaf-a4ec-487d-80be-fdae2b8f82df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 21:02:34.912204 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-85efcaaf-a4ec-487d-80be-fdae2b8f82df None None] MFA Rules not processed for user `3918fe05c8634bc39f3e295374701465`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 21:02:34.913335 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-85efcaaf-a4ec-487d-80be-fdae2b8f82df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 21:02:34.922832 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1467/2929] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Jun 21 21:02:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 21:02:34.933235 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0688e2-b0a8-47df-8b77-53f74287ec97 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 21:02:34.944417 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0688e2-b0a8-47df-8b77-53f74287ec97 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 21:02:34.948068 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb113c-2056-41b9-a0b8-c3e4a81fbb56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 21:02:34.948712 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb113c-2056-41b9-a0b8-c3e4a81fbb56 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 21:02:34.949002 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb113c-2056-41b9-a0b8-c3e4a81fbb56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 21:02:34.949284 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb113c-2056-41b9-a0b8-c3e4a81fbb56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 21:02:34.960028 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb113c-2056-41b9-a0b8-c3e4a81fbb56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 21:02:34.961549 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb113c-2056-41b9-a0b8-c3e4a81fbb56 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 21:02:34.972811 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1463/2930] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 21:02:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 21:02:44.909823 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=15 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 21:02:44.968240 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=15 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 21:04:07.346746 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85efcaaf-a4ec-487d-80be-fdae2b8f82df None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 21:04:07.356098 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85efcaaf-a4ec-487d-80be-fdae2b8f82df None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 21:04:07.360126 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe06c29-f20d-43c5-b965-db598fa9914d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 21:04:07.360768 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe06c29-f20d-43c5-b965-db598fa9914d service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 21:04:07.361055 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe06c29-f20d-43c5-b965-db598fa9914d service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 21:04:07.361333 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe06c29-f20d-43c5-b965-db598fa9914d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 21:04:07.363090 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9fe06c29-f20d-43c5-b965-db598fa9914d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 21:04:07.372335 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe06c29-f20d-43c5-b965-db598fa9914d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 21:04:07.374403 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe06c29-f20d-43c5-b965-db598fa9914d service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 21:04:07.382265 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1468/2931] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 21:04:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 21:04:17.378718 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=6 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 21:04:18.346376 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb113c-2056-41b9-a0b8-c3e4a81fbb56 service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 21:04:18.354983 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb113c-2056-41b9-a0b8-c3e4a81fbb56 service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 21:04:18.358619 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987ed349-08b9-4d65-b437-f7e912f2b12a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 21:04:18.359255 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ed349-08b9-4d65-b437-f7e912f2b12a service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 21:04:18.359537 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ed349-08b9-4d65-b437-f7e912f2b12a service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 21:04:18.359813 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ed349-08b9-4d65-b437-f7e912f2b12a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 21:04:18.361583 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-987ed349-08b9-4d65-b437-f7e912f2b12a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 21:04:18.422848 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987ed349-08b9-4d65-b437-f7e912f2b12a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 21:04:18.424328 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987ed349-08b9-4d65-b437-f7e912f2b12a service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 21:04:18.433350 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1464/2932] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 21:04:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 21:04:21.401095 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe06c29-f20d-43c5-b965-db598fa9914d service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 21:04:21.410787 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe06c29-f20d-43c5-b965-db598fa9914d service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 21:04:21.414612 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a31498-4b46-4f6b-b14c-46e028565c00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 21:04:21.415258 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a31498-4b46-4f6b-b14c-46e028565c00 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 21:04:21.415856 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a31498-4b46-4f6b-b14c-46e028565c00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 21:04:21.416171 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a31498-4b46-4f6b-b14c-46e028565c00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 21:04:21.417954 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-60a31498-4b46-4f6b-b14c-46e028565c00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 21:04:21.479725 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a31498-4b46-4f6b-b14c-46e028565c00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 21:04:21.481178 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a31498-4b46-4f6b-b14c-46e028565c00 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 21:04:21.490449 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1469/2933] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 21:04:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 21:04:24.402523 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987ed349-08b9-4d65-b437-f7e912f2b12a service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 21:04:24.414773 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987ed349-08b9-4d65-b437-f7e912f2b12a service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 21:04:24.420052 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429e35e-2fad-4cde-9b0c-d275c66bf3bf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59294bff27c4b3f8aaeeab48ed35a0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 21:04:24.420701 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429e35e-2fad-4cde-9b0c-d275c66bf3bf service placement] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 21:04:24.420992 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429e35e-2fad-4cde-9b0c-d275c66bf3bf service placement] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 21:04:24.421274 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429e35e-2fad-4cde-9b0c-d275c66bf3bf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 21:04:24.423643 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-4429e35e-2fad-4cde-9b0c-d275c66bf3bf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 21:04:24.436187 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4429e35e-2fad-4cde-9b0c-d275c66bf3bf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 21:04:24.438125 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4429e35e-2fad-4cde-9b0c-d275c66bf3bf service placement] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 21:04:24.449569 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1465/2934] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 21:04:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 21:04:26.612364 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a31498-4b46-4f6b-b14c-46e028565c00 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 21:04:26.614383 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-60a31498-4b46-4f6b-b14c-46e028565c00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 21:04:26.684735 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a31498-4b46-4f6b-b14c-46e028565c00 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 21:04:26.690689 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6bf09-b6c2-4c43-84d3-c19c959548b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95478de171141ce85876e852d081149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 21:04:26.691501 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6bf09-b6c2-4c43-84d3-c19c959548b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 21:04:26.691789 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6bf09-b6c2-4c43-84d3-c19c959548b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 21:04:26.692227 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6bf09-b6c2-4c43-84d3-c19c959548b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 21:04:26.694172 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b9d6bf09-b6c2-4c43-84d3-c19c959548b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 21:04:26.707613 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d6bf09-b6c2-4c43-84d3-c19c959548b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 21:04:26.709686 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d6bf09-b6c2-4c43-84d3-c19c959548b4 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 21:04:26.721277 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1470/2935] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 21:04:26 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 21:04:27.271607 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429e35e-2fad-4cde-9b0c-d275c66bf3bf service placement] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 21:04:27.273271 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-4429e35e-2fad-4cde-9b0c-d275c66bf3bf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 21:04:27.288803 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429e35e-2fad-4cde-9b0c-d275c66bf3bf service placement] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 21:04:27.294038 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e0c6b8-2df3-4a23-ad03-f1e28dddc005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 21:04:27.295096 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e0c6b8-2df3-4a23-ad03-f1e28dddc005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 21:04:27.295432 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e0c6b8-2df3-4a23-ad03-f1e28dddc005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 21:04:27.295835 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e0c6b8-2df3-4a23-ad03-f1e28dddc005 admin admin] PATH_INFO: `/v3/users/afa6042a2b6f4beb9f85d6f300ff5575` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 21:04:27.297924 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e0c6b8-2df3-4a23-ad03-f1e28dddc005 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afa6042a2b6f4beb9f85d6f300ff5575)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 21:04:27.300182 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e0c6b8-2df3-4a23-ad03-f1e28dddc005 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 21:04:27.362370 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-54e0c6b8-2df3-4a23-ad03-f1e28dddc005 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afa6042a2b6f4beb9f85d6f300ff5575'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 21:04:27.363189 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-54e0c6b8-2df3-4a23-ad03-f1e28dddc005 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afa6042a2b6f4beb9f85d6f300ff5575'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 21:04:27.370990 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-54e0c6b8-2df3-4a23-ad03-f1e28dddc005 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afa6042a2b6f4beb9f85d6f300ff5575'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 21:04:27.384028 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-54e0c6b8-2df3-4a23-ad03-f1e28dddc005 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afa6042a2b6f4beb9f85d6f300ff5575'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 21:04:27.384707 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-54e0c6b8-2df3-4a23-ad03-f1e28dddc005 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afa6042a2b6f4beb9f85d6f300ff5575'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 21:04:27.396918 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1466/2936] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 21:04:27 2022] DELETE /identity/v3/users/afa6042a2b6f4beb9f85d6f300ff5575 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 21:04:27.566924 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6bf09-b6c2-4c43-84d3-c19c959548b4 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 21:04:27.578819 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6bf09-b6c2-4c43-84d3-c19c959548b4 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 21:04:27.636086 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1db5b4-1ea9-4509-8305-bf81e86766ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 21:04:27.637102 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1db5b4-1ea9-4509-8305-bf81e86766ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 21:04:27.637478 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1db5b4-1ea9-4509-8305-bf81e86766ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 21:04:27.637744 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1db5b4-1ea9-4509-8305-bf81e86766ee admin admin] PATH_INFO: `/v3/projects/50b02971f2614de7a9280109a1564485` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 21:04:27.638984 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1db5b4-1ea9-4509-8305-bf81e86766ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=50b02971f2614de7a9280109a1564485)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 21:04:27.641467 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1db5b4-1ea9-4509-8305-bf81e86766ee admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 21:04:27.681850 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 21:04:27.690201 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-cc1db5b4-1ea9-4509-8305-bf81e86766ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50b02971f2614de7a9280109a1564485', 'request_id': 'req-cc1db5b4-1ea9-4509-8305-bf81e86766ee'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 21:04:27.697473 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-cc1db5b4-1ea9-4509-8305-bf81e86766ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50b02971f2614de7a9280109a1564485', 'request_id': 'req-cc1db5b4-1ea9-4509-8305-bf81e86766ee'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 21:04:27.703418 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-cc1db5b4-1ea9-4509-8305-bf81e86766ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50b02971f2614de7a9280109a1564485', 'request_id': 'req-cc1db5b4-1ea9-4509-8305-bf81e86766ee'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 21:04:27.714450 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-cc1db5b4-1ea9-4509-8305-bf81e86766ee admin admin] The token cache is being invalidate because project 50b02971f2614de7a9280109a1564485 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 21:04:27.714734 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-cc1db5b4-1ea9-4509-8305-bf81e86766ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 21:04:27.715383 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-cc1db5b4-1ea9-4509-8305-bf81e86766ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 21:04:27.716934 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1471/2937] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 21:04:27 2022] DELETE /identity/v3/projects/50b02971f2614de7a9280109a1564485 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 21:04:27.721504 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e0c6b8-2df3-4a23-ad03-f1e28dddc005 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 21:04:27.722893 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-54e0c6b8-2df3-4a23-ad03-f1e28dddc005 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 21:04:27.735865 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e0c6b8-2df3-4a23-ad03-f1e28dddc005 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 21:04:27.789586 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 21:04:27.796296 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3df70-1967-495c-8253-3ede02914f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 21:04:27.797202 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3df70-1967-495c-8253-3ede02914f5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 21:04:27.797853 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3df70-1967-495c-8253-3ede02914f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 21:04:27.798198 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3df70-1967-495c-8253-3ede02914f5b admin admin] PATH_INFO: `/v3/users/3b28d76a00db4c55972733e627e34e3c` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 21:04:27.799370 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c3df70-1967-495c-8253-3ede02914f5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b28d76a00db4c55972733e627e34e3c)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 21:04:27.801941 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c3df70-1967-495c-8253-3ede02914f5b admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 21:04:27.847449 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-c7c3df70-1967-495c-8253-3ede02914f5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b28d76a00db4c55972733e627e34e3c'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 21:04:27.848133 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-c7c3df70-1967-495c-8253-3ede02914f5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b28d76a00db4c55972733e627e34e3c'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 21:04:27.855680 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-c7c3df70-1967-495c-8253-3ede02914f5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b28d76a00db4c55972733e627e34e3c'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 21:04:27.868377 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-c7c3df70-1967-495c-8253-3ede02914f5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b28d76a00db4c55972733e627e34e3c'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 21:04:27.869031 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-c7c3df70-1967-495c-8253-3ede02914f5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b28d76a00db4c55972733e627e34e3c'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 21:04:27.881879 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1467/2938] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 21:04:27 2022] DELETE /identity/v3/users/3b28d76a00db4c55972733e627e34e3c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 21:04:28.053378 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1db5b4-1ea9-4509-8305-bf81e86766ee admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 21:04:28.055145 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-cc1db5b4-1ea9-4509-8305-bf81e86766ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 21:04:28.073445 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1db5b4-1ea9-4509-8305-bf81e86766ee admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 21:04:28.129200 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55a3a1-8416-44ae-a381-ec8cc77ebd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 21:04:28.130068 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55a3a1-8416-44ae-a381-ec8cc77ebd12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 21:04:28.130360 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55a3a1-8416-44ae-a381-ec8cc77ebd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 21:04:28.130641 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55a3a1-8416-44ae-a381-ec8cc77ebd12 admin admin] PATH_INFO: `/v3/projects/19343fe647bd41a19f6fc81ddb199c2f` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 21:04:28.131824 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c55a3a1-8416-44ae-a381-ec8cc77ebd12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19343fe647bd41a19f6fc81ddb199c2f)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 21:04:28.133770 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c55a3a1-8416-44ae-a381-ec8cc77ebd12 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 21:04:28.179325 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-4c55a3a1-8416-44ae-a381-ec8cc77ebd12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19343fe647bd41a19f6fc81ddb199c2f', 'request_id': 'req-4c55a3a1-8416-44ae-a381-ec8cc77ebd12'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 21:04:28.186954 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-4c55a3a1-8416-44ae-a381-ec8cc77ebd12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19343fe647bd41a19f6fc81ddb199c2f', 'request_id': 'req-4c55a3a1-8416-44ae-a381-ec8cc77ebd12'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 21:04:28.192862 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-4c55a3a1-8416-44ae-a381-ec8cc77ebd12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19343fe647bd41a19f6fc81ddb199c2f', 'request_id': 'req-4c55a3a1-8416-44ae-a381-ec8cc77ebd12'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 21:04:28.203290 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-4c55a3a1-8416-44ae-a381-ec8cc77ebd12 admin admin] The token cache is being invalidate because project 19343fe647bd41a19f6fc81ddb199c2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 21:04:28.203574 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-4c55a3a1-8416-44ae-a381-ec8cc77ebd12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 21:04:28.204218 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-4c55a3a1-8416-44ae-a381-ec8cc77ebd12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 21:04:28.205705 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1472/2939] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 21:04:28 2022] DELETE /identity/v3/projects/19343fe647bd41a19f6fc81ddb199c2f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 21:04:37.702409 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15602ea0-86a5-4f4b-b038-17683fd85a99 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 21:04:37.702878 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15602ea0-86a5-4f4b-b038-17683fd85a99 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 21:04:37.702982 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15602ea0-86a5-4f4b-b038-17683fd85a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 21:04:37.720673 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-15602ea0-86a5-4f4b-b038-17683fd85a99 None None] MFA Rules not processed for user `8846803a5b8a4f5ab5a33feeddfc5138`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 21:04:37.722177 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-15602ea0-86a5-4f4b-b038-17683fd85a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 21:04:37.775836 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1468/2940] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jun 21 21:04:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 21:04:38.082715 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55a3a1-8416-44ae-a381-ec8cc77ebd12 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 21:04:38.084157 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4c55a3a1-8416-44ae-a381-ec8cc77ebd12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 21:04:38.139232 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55a3a1-8416-44ae-a381-ec8cc77ebd12 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 21:04:38.143307 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32188229-08e5-4588-b06b-fcd709c516d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 21:04:38.143969 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32188229-08e5-4588-b06b-fcd709c516d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 21:04:38.144259 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32188229-08e5-4588-b06b-fcd709c516d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 21:04:38.144537 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32188229-08e5-4588-b06b-fcd709c516d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 21:04:38.146280 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-32188229-08e5-4588-b06b-fcd709c516d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 21:04:38.155591 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32188229-08e5-4588-b06b-fcd709c516d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 21:04:38.157071 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32188229-08e5-4588-b06b-fcd709c516d0 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 21:04:38.161702 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 21:04:38.166429 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1473/2941] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 21:04:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 21:04:47.769312 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=52,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 21:04:55.348831 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15602ea0-86a5-4f4b-b038-17683fd85a99 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 21:04:55.358437 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15602ea0-86a5-4f4b-b038-17683fd85a99 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 21:04:55.361981 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee989f3-bd4c-4133-b371-8bd748268c3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 21:04:55.362624 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee989f3-bd4c-4133-b371-8bd748268c3a service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 21:04:55.362912 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee989f3-bd4c-4133-b371-8bd748268c3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 21:04:55.363196 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee989f3-bd4c-4133-b371-8bd748268c3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 21:04:55.364973 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-6ee989f3-bd4c-4133-b371-8bd748268c3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 21:04:55.427468 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee989f3-bd4c-4133-b371-8bd748268c3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 21:04:55.428926 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee989f3-bd4c-4133-b371-8bd748268c3a service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 21:04:55.438510 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1469/2942] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 21:04:55 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 21:05:05.434109 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=30 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 21:06:10.612142 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32188229-08e5-4588-b06b-fcd709c516d0 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 21:06:10.613563 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-32188229-08e5-4588-b06b-fcd709c516d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 21:06:10.705254 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32188229-08e5-4588-b06b-fcd709c516d0 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 21:06:10.710952 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca7a322-256e-469d-a0c9-da3dcd3823fd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59294bff27c4b3f8aaeeab48ed35a0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 21:06:10.711599 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7a322-256e-469d-a0c9-da3dcd3823fd service placement] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 21:06:10.711885 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7a322-256e-469d-a0c9-da3dcd3823fd service placement] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 21:06:10.712195 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7a322-256e-469d-a0c9-da3dcd3823fd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 21:06:10.713938 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-eca7a322-256e-469d-a0c9-da3dcd3823fd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 21:06:10.725156 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca7a322-256e-469d-a0c9-da3dcd3823fd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 21:06:10.726713 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca7a322-256e-469d-a0c9-da3dcd3823fd service placement] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 21:06:10.737046 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1474/2943] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 21:06:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 21:06:20.732298 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=41 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 21:06:53.690961 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee989f3-bd4c-4133-b371-8bd748268c3a service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 21:06:53.692478 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-6ee989f3-bd4c-4133-b371-8bd748268c3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 21:06:53.815726 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee989f3-bd4c-4133-b371-8bd748268c3a service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 21:06:53.822498 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e039483-bc3c-4145-8e32-938569fbe143 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3918fe05c8634bc39f3e295374701465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 21:06:53.823148 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e039483-bc3c-4145-8e32-938569fbe143 service nova] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 21:06:53.823442 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e039483-bc3c-4145-8e32-938569fbe143 service nova] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 21:06:53.823728 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e039483-bc3c-4145-8e32-938569fbe143 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 21:06:53.825701 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-9e039483-bc3c-4145-8e32-938569fbe143 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 21:06:53.841038 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e039483-bc3c-4145-8e32-938569fbe143 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 21:06:53.842680 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e039483-bc3c-4145-8e32-938569fbe143 service nova] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 21:06:53.856932 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1470/2944] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 21:06:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 21:06:59.159356 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca7a322-256e-469d-a0c9-da3dcd3823fd service placement] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 21:06:59.160798 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-eca7a322-256e-469d-a0c9-da3dcd3823fd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 21:06:59.202364 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca7a322-256e-469d-a0c9-da3dcd3823fd service placement] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 21:06:59.205942 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bfb8e0-ffe4-4bbf-a5d2-2de5b36c209a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b01b53897d64bbaac6efb6f13d413a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 21:06:59.206587 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfb8e0-ffe4-4bbf-a5d2-2de5b36c209a service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 21:06:59.206903 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfb8e0-ffe4-4bbf-a5d2-2de5b36c209a service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 21:06:59.207183 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfb8e0-ffe4-4bbf-a5d2-2de5b36c209a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 21:06:59.208965 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-85bfb8e0-ffe4-4bbf-a5d2-2de5b36c209a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 21:06:59.310675 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bfb8e0-ffe4-4bbf-a5d2-2de5b36c209a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 21:06:59.312144 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bfb8e0-ffe4-4bbf-a5d2-2de5b36c209a service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 21:06:59.331496 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1475/2945] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 21:06:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 21:07:03.850365 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=46 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 21:07:05.383164 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e039483-bc3c-4145-8e32-938569fbe143 service nova] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 21:07:05.385347 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-9e039483-bc3c-4145-8e32-938569fbe143 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 21:07:05.435902 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e039483-bc3c-4145-8e32-938569fbe143 service nova] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 21:07:05.440603 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125dac5c-e608-490f-9fe6-a3a74c70f806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 21:07:05.441480 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125dac5c-e608-490f-9fe6-a3a74c70f806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 21:07:05.441767 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125dac5c-e608-490f-9fe6-a3a74c70f806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 21:07:05.442048 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125dac5c-e608-490f-9fe6-a3a74c70f806 admin admin] PATH_INFO: `/v3/users/8846803a5b8a4f5ab5a33feeddfc5138` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 21:07:05.443246 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125dac5c-e608-490f-9fe6-a3a74c70f806 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8846803a5b8a4f5ab5a33feeddfc5138)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 21:07:05.445191 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125dac5c-e608-490f-9fe6-a3a74c70f806 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 21:07:05.496287 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-125dac5c-e608-490f-9fe6-a3a74c70f806 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8846803a5b8a4f5ab5a33feeddfc5138'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 21:07:05.496965 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-125dac5c-e608-490f-9fe6-a3a74c70f806 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8846803a5b8a4f5ab5a33feeddfc5138'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 21:07:05.504327 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-125dac5c-e608-490f-9fe6-a3a74c70f806 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8846803a5b8a4f5ab5a33feeddfc5138'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 21:07:05.516252 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-125dac5c-e608-490f-9fe6-a3a74c70f806 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8846803a5b8a4f5ab5a33feeddfc5138'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 21:07:05.516886 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-125dac5c-e608-490f-9fe6-a3a74c70f806 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8846803a5b8a4f5ab5a33feeddfc5138'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 21:07:05.528828 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1471/2946] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 21:07:05 2022] DELETE /identity/v3/users/8846803a5b8a4f5ab5a33feeddfc5138 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 21:07:05.697002 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bfb8e0-ffe4-4bbf-a5d2-2de5b36c209a service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 21:07:05.707324 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bfb8e0-ffe4-4bbf-a5d2-2de5b36c209a service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 21:07:05.764324 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a020cb-19d5-41b7-b53a-5652fcd0c3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 21:07:05.765114 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a020cb-19d5-41b7-b53a-5652fcd0c3b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 21:07:05.765394 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a020cb-19d5-41b7-b53a-5652fcd0c3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 21:07:05.765667 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a020cb-19d5-41b7-b53a-5652fcd0c3b9 admin admin] PATH_INFO: `/v3/projects/657e2b67c445440d9300a9b1633f1038` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 21:07:05.766859 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a020cb-19d5-41b7-b53a-5652fcd0c3b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=657e2b67c445440d9300a9b1633f1038)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 21:07:05.768805 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a020cb-19d5-41b7-b53a-5652fcd0c3b9 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 21:07:05.788695 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 21:07:05.814267 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-30a020cb-19d5-41b7-b53a-5652fcd0c3b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '657e2b67c445440d9300a9b1633f1038', 'request_id': 'req-30a020cb-19d5-41b7-b53a-5652fcd0c3b9'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 21:07:05.821232 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-30a020cb-19d5-41b7-b53a-5652fcd0c3b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '657e2b67c445440d9300a9b1633f1038', 'request_id': 'req-30a020cb-19d5-41b7-b53a-5652fcd0c3b9'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 21:07:05.826803 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-30a020cb-19d5-41b7-b53a-5652fcd0c3b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '657e2b67c445440d9300a9b1633f1038', 'request_id': 'req-30a020cb-19d5-41b7-b53a-5652fcd0c3b9'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 21:07:05.838043 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-30a020cb-19d5-41b7-b53a-5652fcd0c3b9 admin admin] The token cache is being invalidate because project 657e2b67c445440d9300a9b1633f1038 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 21:07:05.838335 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-30a020cb-19d5-41b7-b53a-5652fcd0c3b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 21:07:05.838970 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-30a020cb-19d5-41b7-b53a-5652fcd0c3b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 21:07:05.840773 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1476/2947] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 21:07:05 2022] DELETE /identity/v3/projects/657e2b67c445440d9300a9b1633f1038 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 21:07:05.844715 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125dac5c-e608-490f-9fe6-a3a74c70f806 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 21:07:05.846124 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-125dac5c-e608-490f-9fe6-a3a74c70f806 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 21:07:05.859696 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125dac5c-e608-490f-9fe6-a3a74c70f806 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 21:07:05.914002 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb11f42-ebe7-40fc-86a6-bbab882754b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 21:07:05.915477 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb11f42-ebe7-40fc-86a6-bbab882754b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 21:07:05.915761 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb11f42-ebe7-40fc-86a6-bbab882754b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 21:07:05.916084 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb11f42-ebe7-40fc-86a6-bbab882754b0 admin admin] PATH_INFO: `/v3/users/97ee7547d5fb4100aad420bda5312d29` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 21:07:05.917514 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb11f42-ebe7-40fc-86a6-bbab882754b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97ee7547d5fb4100aad420bda5312d29)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 21:07:05.919393 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb11f42-ebe7-40fc-86a6-bbab882754b0 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 21:07:05.957855 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 21:07:05.964585 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-3cb11f42-ebe7-40fc-86a6-bbab882754b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97ee7547d5fb4100aad420bda5312d29'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 21:07:05.965323 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-3cb11f42-ebe7-40fc-86a6-bbab882754b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97ee7547d5fb4100aad420bda5312d29'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 21:07:05.972370 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-3cb11f42-ebe7-40fc-86a6-bbab882754b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97ee7547d5fb4100aad420bda5312d29'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 21:07:05.984552 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-3cb11f42-ebe7-40fc-86a6-bbab882754b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97ee7547d5fb4100aad420bda5312d29'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 21:07:05.985172 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-3cb11f42-ebe7-40fc-86a6-bbab882754b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97ee7547d5fb4100aad420bda5312d29'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 21:07:05.997444 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1472/2948] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jun 21 21:07:05 2022] DELETE /identity/v3/users/97ee7547d5fb4100aad420bda5312d29 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 21:07:06.162381 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a020cb-19d5-41b7-b53a-5652fcd0c3b9 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 21:07:06.163795 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-30a020cb-19d5-41b7-b53a-5652fcd0c3b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 21:07:06.178726 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a020cb-19d5-41b7-b53a-5652fcd0c3b9 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 21:07:06.240249 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90839149-7ff7-40f3-87f0-c5c26e8bab51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983efac1f89435f94ebc2dacd0b3544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef19f22f6a3d44fc841048b493a62bd9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 21:07:06.241115 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90839149-7ff7-40f3-87f0-c5c26e8bab51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 21:07:06.241400 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90839149-7ff7-40f3-87f0-c5c26e8bab51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 21:07:06.241677 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90839149-7ff7-40f3-87f0-c5c26e8bab51 admin admin] PATH_INFO: `/v3/projects/9f43d66f5c4e4cef8eccdde1c984365b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 21:07:06.242991 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90839149-7ff7-40f3-87f0-c5c26e8bab51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f43d66f5c4e4cef8eccdde1c984365b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 21:07:06.244965 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90839149-7ff7-40f3-87f0-c5c26e8bab51 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 21:07:06.291323 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-90839149-7ff7-40f3-87f0-c5c26e8bab51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f43d66f5c4e4cef8eccdde1c984365b', 'request_id': 'req-90839149-7ff7-40f3-87f0-c5c26e8bab51'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 21:07:06.298427 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-90839149-7ff7-40f3-87f0-c5c26e8bab51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f43d66f5c4e4cef8eccdde1c984365b', 'request_id': 'req-90839149-7ff7-40f3-87f0-c5c26e8bab51'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 21:07:06.303860 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-90839149-7ff7-40f3-87f0-c5c26e8bab51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f43d66f5c4e4cef8eccdde1c984365b', 'request_id': 'req-90839149-7ff7-40f3-87f0-c5c26e8bab51'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 21:07:06.314504 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-90839149-7ff7-40f3-87f0-c5c26e8bab51 admin admin] The token cache is being invalidate because project 9f43d66f5c4e4cef8eccdde1c984365b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 21:07:06.314790 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-90839149-7ff7-40f3-87f0-c5c26e8bab51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 21:07:06.315411 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-90839149-7ff7-40f3-87f0-c5c26e8bab51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 21:07:06.316995 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1477/2949] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jun 21 21:07:06 2022] DELETE /identity/v3/projects/9f43d66f5c4e4cef8eccdde1c984365b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 21:07:15.994404 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=14,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 21:07:16.311616 dv-cinder-835384-8-iscsi devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=67,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 21:11:15.611298 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb11f42-ebe7-40fc-86a6-bbab882754b0 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 21:11:15.612753 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-3cb11f42-ebe7-40fc-86a6-bbab882754b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 21:11:15.684121 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb11f42-ebe7-40fc-86a6-bbab882754b0 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 21:11:15.741841 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7203b4a-ea08-48ed-8560-66f11ec0fde0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59294bff27c4b3f8aaeeab48ed35a0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dcb71ef7b6e49148edd61a1eb8da7bb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 21:11:15.742420 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7203b4a-ea08-48ed-8560-66f11ec0fde0 service placement] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 21:11:15.742704 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7203b4a-ea08-48ed-8560-66f11ec0fde0 service placement] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 21:11:15.742984 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7203b4a-ea08-48ed-8560-66f11ec0fde0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 21:11:15.744743 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-e7203b4a-ea08-48ed-8560-66f11ec0fde0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 21:11:15.756344 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7203b4a-ea08-48ed-8560-66f11ec0fde0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 21:11:15.757939 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7203b4a-ea08-48ed-8560-66f11ec0fde0 service placement] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 21:11:15.767742 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1473/2950] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jun 21 21:11:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 21:11:25.763598 dv-cinder-835384-8-iscsi devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=58 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}